Salinity. Grade 5 Science Language Usage. Maryland School Maryland School Performance Assessment Program (MSPAP): Resource Library. Public Release Task.

ERIC Educational Resources Information Center

Maryland State Dept. of Education. Baltimore. Div. of Planning, Results and Information Management.

One component of the Maryland School Performance Assessment; Program (MSPAP) is the state's performance-based assessments, criterion-referenced tests that require students to apply what they know and can do to solve problems and display other higher-order thinking skills. This document helps parents, teachers, students, and other citizens…

The use of CellaVision competency software for external quality assessment and continuing professional development.

PubMed

Horiuchi, Yuki; Tabe, Yoko; Idei, Mayumi; Bengtsson, Hans-Inge; Ishii, Kiyoshi; Horii, Takashi; Miyake, Kazunori; Satoh, Naotake; Miida, Takashi; Ohsaka, Akimichi

2011-07-01

Quality assessment of blood cell morphological testing, such as white blood cell (WBC) differential and its interpretation, is one of the most important and difficult assignments in haematology laboratories. A monthly survey was performed to assess the possible role of the proficiency testing program produced by CellaVision competency software (CCS) in external quality assessment (EQA) of the clinical laboratories of affiliated university hospitals and the effective utilisation of this program in continuing professional development (CPD). Four monthly proficiency surveys were conducted in collaboration with four clinical laboratories affiliated with the teaching hospitals of Juntendo University of Medicine in Japan. EQA results by the CCS proficiency testing program revealed a difference of performance levels of WBC differential and morphological interpretation and a discrepancy in the WBC differential criteria among laboratories. With regard to the utilisation of this proficiency program as a tool for CPD, this program successfully improved the performance of the low-scoring laboratories and less experienced individuals. The CCS proficiency testing program was useful for the quality assessment of laboratory performance, for education, and for the storage and distribution of cell images to be utilised for further standardisation and education.

42 CFR 460.136 - Internal quality assessment and performance improvement activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

..., DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance Improvement § 460...

Evaluation of staff performance and interpretation of the screening program for prevention of thalassemia.

PubMed

Prommetta, Simaporn; Sanchaisuriya, Kanokwan; Fucharoen, Goonnapa; Yamsri, Supawadee; Chaiboonroeng, Attawut; Fucharoen, Supan

2017-06-15

Thalassemia screening program has been implemented for years in Southeast Asia, but no external quality assessment program has been established. We have developed and initiated the proficiency testing (PT) program for the first time in Thailand with the aim to assess the screening performance of laboratory staff and their competency in interpretation of the screening results. Three PT cycles per year were organized. From the first to the third cycle of the PT scheme, a total number of participant laboratories increased from 59 to 67. In each cycle, 2 PT items (assigned as blood samples of the couple) were provided. Performance evaluation was based on the accuracy of screening results, i.e . mean corpuscular volume (MCV), mean corpuscular haemoglobin (MCH) and the dichlorophenolindophenol (DCIP) test for haemoglobin E, including the competency in interpretation of screening results and assessment of foetal risk. Performance was assessed by comparing the participants' result against the assigned value. Of all 3 cycles, most laboratories reported acceptable MCV and MCH values. From the first to the third cycle, incorrect DCIP test and misinterpretation rates were decreased while incorrect risk assessment varied by cycle to cycle. Combining the accuracy of thalassemia screening and the competency in interpretation and risk assessment, approximately half of participants showed excellent performance. Improved performance observed in many laboratories reflects the achievement and benefit of the PT program which should be regularly provided.

Translating Theory Into Practice: Implementing a Program of Assessment.

PubMed

Hauer, Karen E; O'Sullivan, Patricia S; Fitzhenry, Kristen; Boscardin, Christy

2018-03-01

A program of assessment addresses challenges in learner assessment using a centrally planned, coordinated approach that emphasizes assessment for learning. This report describes the steps taken to implement a program of assessment framework within a medical school. A literature review on best practices in assessment highlighted six principles that guided implementation of the program of assessment in 2016-2017: (1) a centrally coordinated plan for assessment aligns with and supports a curricular vision; (2) multiple assessment tools used longitudinally generate multiple data points; (3) learners require ready access to information-rich feedback to promote reflection and informed self-assessment; (4) mentoring is essential to facilitate effective data use for reflection and learning planning; (5) the program of assessment fosters self-regulated learning behaviors; and (6) expert groups make summative decisions about grades and readiness for advancement. Implementation incorporated stakeholder engagement, use of multiple assessment tools, design of a coaching program, and creation of a learner performance dashboard. The assessment team monitors adherence to principles defining the program of assessment and gathers and responds to regular feedback from key stakeholders, including faculty, staff, and students. Next steps include systematically collecting evidence for validity of individual assessments and the program overall. Iterative review of student performance data informs curricular improvements. The program of assessment also highlights technology needs that will be addressed with information technology experts. The outcome ultimately will entail showing evidence of validity that the program produces physicians who engage in lifelong learning and provide high-quality patient care.

Implementation of the External Quality Assessment Program in Brazil.

PubMed

Fleury, Marcos Kneip; Menezes, Maria Elizabeth; Correa, José Abol

2017-02-15

The External Quality Assessment (EQA) in Brazil is performed by the National Health Ministry for diseases that are under supervision of Public Health Department. In addition to the government program, the Brazilian Society of Clinical Analysis and the Brazilian Society of Medical Pathology are allowed to provide their programs under the Supervision of National Agency for Sanitary Surveillance (ANVISA) that regulates laboratories to perform EQA programs.

Environment, Safety, and Health Self-Assessment Report, Fiscal Year 2008

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chernowski, John

2009-02-27

Lawrence Berkeley National Laboratory's Environment, Safety, and Health (ES&H) Self-Assessment Program ensures that Integrated Safety Management (ISM) is implemented institutionally and by all divisions. The Self-Assessment Program, managed by the Office of Contract Assurance (OCA), provides for an internal evaluation of all ES&H programs and systems at LBNL. The functions of the program are to ensure that work is conducted safely, and with minimal negative impact to workers, the public, and the environment. The Self-Assessment Program is also the mechanism used to institute continuous improvements to the Laboratory's ES&H programs. The program is described in LBNL/PUB 5344, Environment, Safety, andmore » Health Self-Assessment Program and is composed of four distinct assessments: the Division Self-Assessment, the Management of Environment, Safety, and Health (MESH) review, ES&H Technical Assurance, and the Appendix B Self-Assessment. The Division Self-Assessment uses the five core functions and seven guiding principles of ISM as the basis of evaluation. Metrics are created to measure performance in fulfilling ISM core functions and guiding principles, as well as promoting compliance with applicable regulations. The five core functions of ISM are as follows: (1) Define the Scope of Work; (2) Identify and Analyze Hazards; (3) Control the Hazards; (4) Perform the Work; and (5) Feedback and Improvement. The seven guiding principles of ISM are as follows: (1) Line Management Responsibility for ES&H; (2) Clear Roles and Responsibilities; (3) Competence Commensurate with Responsibilities; (4) Balanced Priorities; (5) Identification of ES&H Standards and Requirements; (6) Hazard Controls Tailored to the Work Performed; and (7) Operations Authorization. Performance indicators are developed by consensus with OCA, representatives from each division, and Environment, Health, and Safety (EH&S) Division program managers. Line management of each division performs the Division Self-Assessment annually. The primary focus of the review is workplace safety. The MESH review is an evaluation of division management of ES&H in its research and operations, focusing on implementation and effectiveness of the division's ISM plan. It is a peer review performed by members of the LBNL Safety Review Committee (SRC), with staff support from OCA. Each division receives a MESH review every two to four years, depending on the results of the previous review. The ES&H Technical Assurance Program (TAP) provides the framework for systematic reviews of ES&H programs and processes. The intent of ES&H Technical Assurance assessments is to provide assurance that ES&H programs and processes comply with their guiding regulations, are effective, and are properly implemented by LBNL divisions. The Appendix B Performance Evaluation and Measurement Plan (PEMP) requires that LBNL sustain and enhance the effectiveness of integrated safety, health, and environmental protection through a strong and well-deployed system. Information required for Appendix B is provided by EH&S Division functional managers. The annual Appendix B report is submitted at the close of the fiscal year. This assessment is the Department of Energy's (DOE) primary mechanism for evaluating LBNL's contract performance in ISM.« less

Performance assessment of small-package-class nonintrusive inspection systems

NASA Astrophysics Data System (ADS)

Spradling, Michael L.; Hyatt, Roger

1997-02-01

The DoD Counterdrug Technology Development Program has addressed the development and demonstration of technology to enhance nonintrusive inspection of small packages such as passenger baggage, commercially delivered parcels, and breakbulk cargo items. Within the past year they have supported several small package-class nonintrusive inspection system performance assessment activities. All performance assessment programs involved the use of a red/blue team concept and were conducted in accordance with approved assessment protocols. This paper presents a discussion related to the systematic performance assessment of small package-class nonintrusive inspection technologies, including transmission, backscatter and computed tomography x-ray imaging, and protocol-related considerations for the assessment of these systems.

A conative educational model for an intervention program in obese youth.

PubMed

Vanhelst, Jérémy; Béghin, Laurent; Fardy, Paul Stephen; Bui-Xuan, Gilles; Mikulovic, Jacques

2012-06-07

Obesity in children has increased in recent years throughout the world and is associated with adverse health consequences. Early interventions, including appropriate pedagogy strategies, are important for a successful intervention program. The aim of this study was to assess changes in body mass index, the ability to perform sport activities, behavior in the classroom and academic performance following one year of a health-wellness intervention program in obese youth. The CEMHaVi program included 37 obese children (19 girls and 18 boys). Participants received an intervention program consisting of physical activity and health education. Assessment included body mass index, academic performance, classroom performance and ability to perform sport activities. Paired t tests were used to assess the effects of intervention, and chi square was used to assess inter-action between measures. Findings of the study suggest significant decrease in Z scores of Body Mass Index and an improvement of academic performance, classroom behavior and the ability to perform sport activities (p < 0.05). Chi square testing showed significant positive inter-actions between body mass index, classroom behavior and academic performance. Results following year one of CEMHaVi showed that a program of physical activity and health education had positive effects on obesity, behavior in the classroom and the ability to perform sport activities in obese adolescents. Significant inter-action in changes between variables was observed. Findings are important for designing intervention models to improve health in obese youth.

Developing a longitudinal cancer nursing education program in Honduras.

PubMed

Sheldon, Lisa Kennedy; Wise, Barbara; Carlson, Julie R; Dowds, Cynthia; Sarchet, Vanessa; Sanchez, Jose Angel

2013-12-01

The present paper is a longitudinal study which aims to develop and deliver cancer nursing education conferences in Honduras using volunteer nurse educators. This program intends to (1) perform site assessments of work environments and resources for cancer care in Honduras, (2) develop cancer nursing education programs, (3) survey conference participants continuing education needs, (4) deliver cancer nursing education conferences, and (5) share data with local and global partners for future cancer programs. The study draws on a longitudinal program development with site assessments, data collection, and educational conferences at two time points. Assessments and surveys were used for conference development and delivery by volunteer nurse educators. Site assessments and conferences were delivered twice. Data were collected regarding assessments and surveys to inform program development. Survey data revealed that <4 % had formal training in cancer care and >65 % had internet access. Participants desired more information about handling of chemotherapy, symptom management, and palliative care. Volunteer nurse educators perform site assessments and develop educational programming for cancer nurses. Local and global partners should explore internet-based programs between site visits to create sustainable education programs.

42 CFR 460.134 - Minimum requirements for quality assessment and performance improvement program.

Code of Federal Regulations, 2012 CFR

2012-10-01

...) Quality of life of participants. (4) Effectiveness and safety of staff-provided and contracted services... 42 Public Health 4 2012-10-01 2012-10-01 false Minimum requirements for quality assessment and... ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance...

42 CFR 460.134 - Minimum requirements for quality assessment and performance improvement program.

Code of Federal Regulations, 2011 CFR

2011-10-01

...) Quality of life of participants. (4) Effectiveness and safety of staff-provided and contracted services... 42 Public Health 4 2011-10-01 2011-10-01 false Minimum requirements for quality assessment and... ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance...

42 CFR 460.134 - Minimum requirements for quality assessment and performance improvement program.

Code of Federal Regulations, 2010 CFR

2010-10-01

...) Quality of life of participants. (4) Effectiveness and safety of staff-provided and contracted services... 42 Public Health 4 2010-10-01 2010-10-01 false Minimum requirements for quality assessment and... ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance...

42 CFR 460.134 - Minimum requirements for quality assessment and performance improvement program.

Code of Federal Regulations, 2013 CFR

2013-10-01

...) Quality of life of participants. (4) Effectiveness and safety of staff-provided and contracted services... 42 Public Health 4 2013-10-01 2013-10-01 false Minimum requirements for quality assessment and... ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance...

42 CFR 460.134 - Minimum requirements for quality assessment and performance improvement program.

Code of Federal Regulations, 2014 CFR

2014-10-01

...) Quality of life of participants. (4) Effectiveness and safety of staff-provided and contracted services... 42 Public Health 4 2014-10-01 2014-10-01 false Minimum requirements for quality assessment and... ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance...

Development of a Criterion-Referenced, Performance-Based Assessment of Reading Comprehension in a Whole Literacy Program.

ERIC Educational Resources Information Center

Tibbetts, Katherine A.; And Others

This paper describes the development of a criterion-referenced, performance-based measure of third grade reading comprehension. The primary purpose of the assessment is to contribute unique and valid information for use in the formative evaluation of a whole literacy program. A secondary purpose is to supplement other program efforts to…

ORD Human Health Risk Assessment (HHRA) Research Program Mid-Cycle Progress Report and Review - 2010

EPA Pesticide Factsheets

The principal charge to the BOSC reviewers was to evaluate ORD’s HHRA Program from a program assessment framework relative to program relevance, structure, performance, quality, leadership, communication, and outcomes.

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

Gender differences in partner interactions during an after-school science peer tutoring program

NASA Astrophysics Data System (ADS)

Brei-Crawley, M. Jo

This teacher research study examined an after-school science program called SSTAR (Science Students Teaching as Resources) to determine if this program encourages early scientific involvement for girls, specifically the investigation of simple machines. SSTAR's overall goal was to develop scientific skills in fourth grade tutors who were partnered with second grade tutees. This study was conducted during two different SSTAR study sessions, identified as the pilot study (year one) and the expanded study (year two). The SSTAR program and the data collection instruments were refined and modified during this two-year process. Four data collection instruments were used to gather data and insights into this program; video-taped interactions between tutor and tutee, a writing assessment, a performance assessment and focus group discussions. The video taped partnership interactions found that tutors used similar instructional strategies and tutees gave similar response strategies. However, these strategies varied according to the gender of the partner. A written assessment, in the form of an open ended question was given to just the tutors at the beginning and end of their session. Additionally, a performance assessment was given. This assessment asked the tutors to construct a machine from the Legos(c) that were provided. This assessment was also done in a pretest/post-test format. Scores from the writing and performance assessment were then compared and the performance assessment showed more tutor growth in knowledge of simple machines than the writing assessment. Overall students made comments stating they enjoyed the SSTAR program and would sign up again. They had no preference for a same gender or opposite gender partner among either tutor or tutee discussions. All the data examined shows evidence that SSTAR was an effective program for tutor growth in the scientific area of simple machines. While the original study focus was specifically on girls, both genders benefited from the program and all students involved stated they had positive experiences during SSTAR.

Assessment without Testing: Using Performance Measures Embedded in a Technology-Based Instructional Program as Indicators of Reading Ability

ERIC Educational Resources Information Center

Mitchell, Alison; Baron, Lauren; Macaruso, Paul

2018-01-01

Screening and monitoring student reading progress can be costly and time consuming. Assessment embedded within the context of online instructional programs can capture ongoing student performance data while limiting testing time outside of instruction. This paper presents two studies that examined the validity of using performance measures from a…

42 CFR 460.136 - Internal quality assessment and performance improvement activities.

Code of Federal Regulations, 2014 CFR

2014-10-01

... in quality assessment and performance improvement activities, including providing information about... 42 Public Health 4 2014-10-01 2014-10-01 false Internal quality assessment and performance...) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance Improvement § 460...

42 CFR 460.136 - Internal quality assessment and performance improvement activities.

Code of Federal Regulations, 2012 CFR

2012-10-01

... in quality assessment and performance improvement activities, including providing information about... 42 Public Health 4 2012-10-01 2012-10-01 false Internal quality assessment and performance...) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance Improvement § 460...

42 CFR 460.136 - Internal quality assessment and performance improvement activities.

Code of Federal Regulations, 2013 CFR

2013-10-01

... in quality assessment and performance improvement activities, including providing information about... 42 Public Health 4 2013-10-01 2013-10-01 false Internal quality assessment and performance...) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance Improvement § 460...

20 CFR 658.604 - Assessment and evaluation of program performance data.

Code of Federal Regulations, 2010 CFR

2010-04-01

..., whether overall or relative to a particular program activity, indicate poor program performance does not... that a State agency's performance is poor that the data may raise a presumption (prima facie case) that... performance data. 658.604 Section 658.604 Employees' Benefits EMPLOYMENT AND TRAINING ADMINISTRATION...

Introducing a laparoscopic simulation training and credentialing program in gynaecology: an observational study.

PubMed

Janssens, Sarah; Beckmann, Michael; Bonney, Donna

2015-08-01

Simulation training in laparoscopic surgery has been shown to improve surgical performance. To describe the implementation of a laparoscopic simulation training and credentialing program for gynaecology registrars. A pilot program consisting of protected, supervised laparoscopic simulation time, a tailored curriculum and a credentialing process, was developed and implemented. Quantitative measures assessing simulated surgical performance were measured over the simulation training period. Laparoscopic procedures requiring credentialing were assessed for both the frequency of a registrar being the primary operator and the duration of surgery and compared to a presimulation cohort. Qualitative measures regarding quality of surgical training were assessed pre- and postsimulation. Improvements were seen in simulated surgical performance in efficiency domains. Operative time for procedures requiring credentialing was reduced by 12%. Primary operator status in the operating theatre for registrars was unchanged. Registrar assessment of training quality improved. The introduction of a laparoscopic simulation training and credentialing program resulted in improvements in simulated performance, reduced operative time and improved registrar assessment of the quality of training. © 2015 The Royal Australian and New Zealand College of Obstetricians and Gynaecologists.

Program and Management Support for the Office for Military Performance Assessment Technology

DTIC Science & Technology

1993-03-01

AD-A270 790 AD_ _ _ _ CONTRACT NO: DAMDI7-90-C-0061 TITLE: PROGRAM AND MANAGEMENT SUPPORT FOR THE OFFICE FOR MILITARY PERFORMANCE ASSESSMENT... the Office of Military Performance Assessment Technology (OMPAT). 1.1 Bag-kg n m. The OMPAT evolved from the Joint Working Group on Drug Dependent...facility was located, leased and occupied by Morgan Management Systems, Inc. staff and designated as the OMPAT Field Office. The office was located at 12075B

A survey of physical assessment techniques performed by RNs: lessons for nursing education.

PubMed

Giddens, Jean F

2007-02-01

There is ongoing concern about the adequacy of the educational preparation of nursing graduates; at the same time, there is concern regarding excessive content within nursing curricula. The purpose of this study was to identify physical examination skills performed by practicing nurses to better understand the competencies needed by graduates of nursing programs. A sample of 193 nurses completed a survey indicating the frequency they performed various physical assessment techniques. Thirty skills routinely performed by nurses were identified; the remaining skills were reportedly performed occasionally or were not performed. The fact that only 30 skills were reportedly performed regularly by the sample raises questions about the depth at which examinations should be conducted in the clinical setting and the depth at which physical examination skills should be taught in nursing programs. Nurse educators should assess the skills currently taught in nursing programs and consider what skills graduates actually need to enter nursing practice.

Taiwan industrial cooperation program technology transfer for low-level radioactive waste final disposal - phase I.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Knowlton, Robert G.; Cochran, John Russell; Arnold, Bill Walter

2007-01-01

Sandia National Laboratories and the Institute of Nuclear Energy Research, Taiwan have collaborated in a technology transfer program related to low-level radioactive waste (LLW) disposal in Taiwan. Phase I of this program included regulatory analysis of LLW final disposal, development of LLW disposal performance assessment capabilities, and preliminary performance assessments of two potential disposal sites. Performance objectives were based on regulations in Taiwan and comparisons to those in the United States. Probabilistic performance assessment models were constructed based on limited site data using software including GoldSim, BLT-MS, FEHM, and HELP. These software codes provided the probabilistic framework, container degradation, waste-formmore » leaching, groundwater flow, radionuclide transport, and cover infiltration simulation capabilities in the performance assessment. Preliminary performance assessment analyses were conducted for a near-surface disposal system and a mined cavern disposal system at two representative sites in Taiwan. Results of example calculations indicate peak simulated concentrations to a receptor within a few hundred years of LLW disposal, primarily from highly soluble, non-sorbing radionuclides.« less

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

ERIC Educational Resources Information Center

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

The Feasibility of Real-Time Intraoperative Performance Assessment With SIMPL (System for Improving and Measuring Procedural Learning): Early Experience From a Multi-institutional Trial.

PubMed

Bohnen, Jordan D; George, Brian C; Williams, Reed G; Schuller, Mary C; DaRosa, Debra A; Torbeck, Laura; Mullen, John T; Meyerson, Shari L; Auyang, Edward D; Chipman, Jeffrey G; Choi, Jennifer N; Choti, Michael A; Endean, Eric D; Foley, Eugene F; Mandell, Samuel P; Meier, Andreas H; Smink, Douglas S; Terhune, Kyla P; Wise, Paul E; Soper, Nathaniel J; Zwischenberger, Joseph B; Lillemoe, Keith D; Dunnington, Gary L; Fryer, Jonathan P

Intraoperative performance assessment of residents is of growing interest to trainees, faculty, and accreditors. Current approaches to collect such assessments are limited by low participation rates and long delays between procedure and evaluation. We deployed an innovative, smartphone-based tool, SIMPL (System for Improving and Measuring Procedural Learning), to make real-time intraoperative performance assessment feasible for every case in which surgical trainees participate, and hypothesized that SIMPL could be feasibly integrated into surgical training programs. Between September 1, 2015 and February 29, 2016, 15 U.S. general surgery residency programs were enrolled in an institutional review board-approved trial. SIMPL was made available after 70% of faculty and residents completed a 1-hour training session. Descriptive and univariate statistics analyzed multiple dimensions of feasibility, including training rates, volume of assessments, response rates/times, and dictation rates. The 20 most active residents and attendings were evaluated in greater detail. A total of 90% of eligible users (1267/1412) completed training. Further, 13/15 programs began using SIMPL. Totally, 6024 assessments were completed by 254 categorical general surgery residents (n = 3555 assessments) and 259 attendings (n = 2469 assessments), and 3762 unique operations were assessed. There was significant heterogeneity in participation within and between programs. Mean percentage (range) of users who completed ≥1, 5, and 20 assessments were 62% (21%-96%), 34% (5%-75%), and 10% (0%-32%) across all programs, and 96%, 75%, and 32% in the most active program. Overall, response rate was 70%, dictation rate was 24%, and mean response time was 12 hours. Assessments increased from 357 (September 2015) to 1146 (February 2016). The 20 most active residents each received mean 46 assessments by 10 attendings for 20 different procedures. SIMPL can be feasibly integrated into surgical training programs to enhance the frequency and timeliness of intraoperative performance assessment. We believe SIMPL could help facilitate a national competency-based surgical training system, although local and systemic challenges still need to be addressed. Copyright © 2016. Published by Elsevier Inc.

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

PubMed

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Performance Analysis of GAME: A Generic Automated Marking Environment

ERIC Educational Resources Information Center

Blumenstein, Michael; Green, Steve; Fogelman, Shoshana; Nguyen, Ann; Muthukkumarasamy, Vallipuram

2008-01-01

This paper describes the Generic Automated Marking Environment (GAME) and provides a detailed analysis of its performance in assessing student programming projects and exercises. GAME has been designed to automatically assess programming assignments written in a variety of languages based on the "structure" of the source code and the correctness…

The Impact of Diagnosing Skill Deficiencies and Assessment-Based Communication Training on Managerial Performance.

ERIC Educational Resources Information Center

Papa, Michael J.; Graham, Elizabeth E.

1991-01-01

Evaluates an organizational diagnosis program that assesses managerial communication skills and provides the frame for follow-up training programs. Finds that managers participating in follow-up communication skills training performed significantly higher on interpersonal skills, problem-solving ability, and productivity over three long-term…

Teaching Machines, Programming, Computers, and Instructional Technology: The Roots of Performance Technology.

ERIC Educational Resources Information Center

Deutsch, William

1992-01-01

Reviews the history of the development of the field of performance technology. Highlights include early teaching machines, instructional technology, learning theory, programed instruction, the systems approach, needs assessment, branching versus linear program formats, programing languages, and computer-assisted instruction. (LRW)

Improving HIV outcomes in resource-limited countries: the importance of quality indicators.

PubMed

Ahonkhai, Aima A; Bassett, Ingrid V; Ferris, Timothy G; Freedberg, Kenneth A

2012-11-24

Resource-limited countries increasingly depend on quality indicators to improve outcomes within HIV treatment programs, but indicators of program performance suitable for use at the local program level remain underdeveloped. Using the existing literature as a guide, we applied standard quality improvement (QI) concepts to the continuum of HIV care from HIV diagnosis, to enrollment and retention in care, and highlighted critical service delivery process steps to identify opportunities for performance indicator development. We then identified existing indicators to measure program performance, citing examples used by pivotal donor agencies, and assessed their feasibility for use in surveying local program performance. Clinical delivery steps without existing performance measures were identified as opportunities for measure development. Using National Quality Forum (NQF) criteria as a guide, we developed measurement concepts suitable for use at the local program level that address existing gaps in program performance assessment. This analysis of the HIV continuum of care identified seven critical process steps providing numerous opportunities for performance measurement. Analysis of care delivery process steps and the application of NQF criteria identified 24 new measure concepts that are potentially useful for improving operational performance in HIV care at the local level. An evidence-based set of program-level quality indicators is critical for the improvement of HIV care in resource-limited settings. These performance indicators should be utilized as treatment programs continue to grow.

Assessing the Functional Knowledge of Participants in the Virginia Beginning Teacher Assistance Program.

ERIC Educational Resources Information Center

Medley, Donald M.; And Others

1989-01-01

Describes the development of an assessment program for beginning teachers and the program's effect on teaching and teacher education in Virginia. Discusses definitions of competence and performance, development of a system for assessing competence, training of classroom recorders, and measurement of competence by observations of teachers'…

A Quantitative Analysis of an Arts Program

ERIC Educational Resources Information Center

Gallagher, Faustina

2013-01-01

This study assessed the relationship of an Arts Summer Learning Program (Arts Program) to student academic performance and college readiness. A North Texas school district collaborated with a research-based Arts Program in 2010, and a new approach was implemented in the summer school program for low-performing students who had failed courses in…

20 CFR 670.975 - How is the performance of the Job Corps program assessed?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 3 2010-04-01 2010-04-01 false How is the performance of the Job Corps program assessed? 670.975 Section 670.975 Employees' Benefits EMPLOYMENT AND TRAINING ADMINISTRATION, DEPARTMENT OF LABOR THE JOB CORPS UNDER TITLE I OF THE WORKFORCE INVESTMENT ACT Administrative and Management...

Assessing Logo Programming among Jordanian Seventh Grade Students through Turtle Geometry

ERIC Educational Resources Information Center

Khasawneh, Amal A.

2009-01-01

The present study is concerned with assessing Logo programming experiences among seventh grade students. A formal multiple-choice test and five performance tasks were used to collect data. The results provided that students' performance was better than the expected score by the probabilistic laws, and a very low correlation between their Logo…

Beginning Teachers' Perceptions of the California Teaching Performance Assessment (TPA)

ERIC Educational Resources Information Center

Campbell, Conni; Ayala, Carlos Cuauhtémoc; Railsback, Gary; Freking, Frederick W.; McKenna, Corey; Lausch, David

2016-01-01

The teaching performance assessment (TPA) seeks to measure the knowledge, skills, and competencies of teachers during the credential phase of their training. The TPA was introduced in California in 2004 with programs piloting it and then became mandatory for candidates enrolling in preliminary programs in 2008. Although California has multiple…

Correlation of United States Medical Licensing Examination and Internal Medicine In-Training Examination Performance

ERIC Educational Resources Information Center

Perez, Jose A., Jr.; Greer, Sharon

2009-01-01

The Internal Medicine In-Training Examination (ITE) is administered during residency training in the United States as a self-assessment and program assessment tool. Performance on this exam correlates with outcome on the American Board of Internal Medicine Certifying examination. Internal Medicine Program Directors use the United States Medical…

Design and Implementation of Performance Metrics for Evaluation of Assessments Data

ERIC Educational Resources Information Center

Ahmed, Irfan; Bhatti, Arif

2016-01-01

Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though…

A National Estimate of Performance: Statewide Highway Safety Program Assessment.

ERIC Educational Resources Information Center

National Highway Traffic Safety Administration (DOT), Washington, DC.

A nationwide systematic approach to assess the developments and achievements of highway safety activities was conducted to measure program outputs from 1969 through 1974 using key indicators of performance such as ratios and percentages. A sample of 10 states was selected with overall sample of 105 local jurisdictions which would provide estimated…

Value-Added Models for Teacher Preparation Programs: Validity and Reliability Threats, and a Manageable Alternative

ERIC Educational Resources Information Center

Brady, Michael P.; Heiser, Lawrence A.; McCormick, Jazarae K.; Forgan, James

2016-01-01

High-stakes standardized student assessments are increasingly used in value-added evaluation models to connect teacher performance to P-12 student learning. These assessments are also being used to evaluate teacher preparation programs, despite validity and reliability threats. A more rational model linking student performance to candidates who…

Performance Tasks: An Assessment Technique Used at TOSTP.

ERIC Educational Resources Information Center

Galway, Janis; Whittington, Andrew

1984-01-01

Discusses evolution of task performance assessment technique of the Toronto Office Skills Training Project (TOSTP), a 45-week training program for women from Vietnam, Laos, and Cambodia. Training in office skills, language, and life skills is uniquely integrated in a program designed to enable the women to overcome the obstacles of language…

A multi-level assessment of a program to teach medical students to teach.

PubMed

Blatt, Benjamin; Greenberg, Larrie

2007-02-01

Few longitudinal programs exist to teach senior students (MS4s) to be teachers, nor have there been any reports of comprehensive program evaluation in this area. The primary objectives of this study were to describe our ongoing faculty development effort and to develop a multi-level program evaluation, using Dixon's model. The TALKS (Teaching and Learning Communication Skills) program is a senior elective and open to all MS4s. We evaluated our program through assessment of its participants at three levels: level 1, opinion; level 2, competence; and level 3, performance; but not level 4, patient outcomes. The authors used a retrospective, pre-post questionnaire to assess MS4 attitudes about their educational experiences, a traditional instrument to assess their teaching, an interaction analysis technique using Bloom's taxonomy to assess MS4s' feedback skills, and a SP exam to assess MS4 communication skills. The authors hypothesized that MS4s participating in TALKS would view medical education more positively and informatively, would demonstrate important principles in giving feedback, would be assessed as excellent teachers, and would perform better than controls in an SP exam emphasizing communication skills. Results revealed that MS4s' ratings as teachers were very good to excellent, with the highest scores on the items "knowledgeable, supportive of me, and answering questions clearly." (Level 1, Opinion) MS4s' perceptions of their knowledge, attitudes and skills increased significantly from the pre to the post-questionnaire. (Level 2, Competence) MS4 feedback skills to MS2s revealed they did more talking than ideal, often at the lowest levels of Bloom's taxonomy. (Level 3, Performance) MS4s demonstrated better communication skills than controls on an evaluation by professional SPs. (Level 3, Performance).

The effect of the rehabilitation program on balance, gait, physical performance and trunk rotation in Parkinson's disease.

PubMed

Stożek, Joanna; Rudzińska, Monika; Pustułka-Piwnik, Urszula; Szczudlik, Andrzej

2016-12-01

Parkinson's disease (PD) is a progressive, neurodegenerative disease which leads to postural and gait disorders, limitation in mobility, activities of daily living and disability. The aim of the study is to assess the effects of the rehabilitation program on balance, gait, motor performance and trunk rotations in PD patients. Sixty-four patients with 1.5-3.0 stage PD in the Hoehn and Yahr scale were randomly allocated to rehabilitation and control groups. Sixty-one patients completed the study. Patients were assessed three times, at month intervals. Between the first and second assessments, the rehabilitation group participated in a rehabilitation training program focused on mobility, balance and gait exercises, consisting of 28 sessions. Balance was assessed with tandem stance and the Pastor test (shoulder tug). Gait was assessed with a 10 m walk at preferred speed and 360° turn. Motor performance was evaluated by means of the Physical Performance Test (PPT) and timed motor activities. The trunk rotations were measured in the lumbar and thoraco-lumbar spine with a tape measure. The rehabilitation group significantly improved (p < 0.05) in balance and gait outcomes, PPT score, timed activities and trunk rotations both in comparison to the control group and baseline results. The positive effects of the exercise program maintained for at least 1 month. The 4-week rehabilitation training program focused on mobility, balance and gait exercises improved balance, gait, physical performance and trunk rotations in patients with PD.

A Program Manager’s Guide for Program Improvement in Ongoing Psychological Health and Traumatic Brain Injury Programs. The RAND Toolkit, Volume 4

DTIC Science & Technology

2014-01-01

Hughes EFX, Boerstler H, O’Connor EJ. “Assessing the Impact of Continuous Quality Improvement/ Total Quality Management : Concept versus...facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity. Gery...RAND Program Manager’s Guide helps managers assess program performance, consider options for improvement, implement solutions, then assess whether the

Peer-Mediated Multimodal Intervention Program for the Treatment of Children with ADHD in India: One-Year Followup

PubMed Central

Mehta, Sagar; Shah, Devesh; Shah, Kushal; Mehta, Sanjiv; Mehta, Neelam; Mehta, Vivek; Mehta, Vijay; Mehta, Vaishali; Motiwala, Smita; Mehta, Naina; Mehta, Devendra

2012-01-01

The objective was to assess the efficacy of a one-year, peer-mediated interventional program consisting of yoga, meditation and play therapy maintained by student volunteers in a school in India. The population consisted of 69 students between the ages of 6 and 11 years, previously identified as having attention deficit hyperactivity disorder (ADHD). A program, known as Climb-Up, was initially embedded in the school twice weekly. Local high school student volunteers were then trained to continue to implement the program weekly over the period of one year. Improvements in ADHD symptoms and academic performance were assessed using Vanderbilt questionnaires completed by both parents and teachers. The performance impairment scores for ADHD students assessed by teachers improved by 6 weeks and were sustained through 12 months in 46 (85%) of the enrolled students. The improvements in their Vanderbilt scores assessed by parents were also seen in 92% (P < 0.0001, Wilcoxon). The Climb-Up program resulted in remarkable improvements in the students' school performances that were sustained throughout the year. These results show promise for a cost-effective program that could easily be implemented in any school. PMID:23316384

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

Government regulation of forestry practices on private forest land in the United States: an assessment of state government responsibilities and program performance

Treesearch

Paul V. Ellefson; Michael A. Kilgore; James E. Granskog

2006-01-01

In 2003, a comprehensive assessment of state government, forest practice regulatory programs in the United States was undertaken. Involved was an extensive review of the literature and information gathering h m program administration in all 50 states. The assessment determined that regulatory programs focus on a wide range of forestry practices applied to private...

GASP- General Aviation Synthesis Program. Volume 1: Main program. Part 1: Theoretical development

NASA Technical Reports Server (NTRS)

Hague, D.

1978-01-01

The General Aviation synthesis program performs tasks generally associated with aircraft preliminary design and allows an analyst the capability of performing parametric studies in a rapid manner. GASP emphasizes small fixed-wing aircraft employing propulsion systems varying froma single piston engine with fixed pitch propeller through twin turboprop/ turbofan powered business or transport type aircraft. The program, which may be operated from a computer terminal in either the batch or interactive graphic mode, is comprised of modules representing the various technical disciplines integrated into a computational flow which ensures that the interacting effects of design variables are continuously accounted for in the aircraft sizing procedure. The model is a useful tool for comparing configurations, assessing aircraft performance and economics, performing tradeoff and sensitivity studies, and assessing the impact of advanced technologies on aircraft performance and economics.

A Mandarin/English Two-Way Immersion Program: Language Proficiency and Academic Achievement

ERIC Educational Resources Information Center

Padilla, Amado M.; Fan, Lorraine; Xu, Xiaoqiu; Silva, Duarte

2013-01-01

A Mandarin/English two-way immersion elementary program is described from its inception and implementation through the fifth grade, the culminating year of the program. All students in all grades were assessed on their oral/listening, reading, and writing performance in Mandarin using program-created assessment measures. Fifth-grade students also…

Enhancing Students' Computer Programming Performances, Critical Thinking Awareness and Attitudes towards Programming: An Online Peer-Assessment Attempt

ERIC Educational Resources Information Center

Wang, Xiao-Ming; Hwang, Gwo-Jen; Liang, Zi-Yun; Wang, Hsiu-Ying

2017-01-01

It has become an important and challenging issue to foster students' concepts and skills of computer programming. Scholars believe that programming training could promote students' higher order thinking performance; however, many school teachers have reported the difficulty of teaching programming courses. Although several previous studies have…

Effects of a multimodal exercise program on balance, functional mobility and fall risk in older adults with cognitive impairment: a randomized controlled single-blind study.

PubMed

Kovács, E; Sztruhár Jónásné, I; Karóczi, C K; Korpos, A; Gondos, T

2013-10-01

Exercise programs have important role in prevention of falls, but to date, there are conflicting findings about the effects of exercise programs on balance, functional performance and fall risk among cognitively impaired older adults. AIM. To investigate the effects of a multimodal exercise program on static and dynamic balance, and risk of falls in older adults with mild or moderate cognitive impairment. A randomized controlled study. A long-term care institute. Cognitively impaired individuals aged over 60 years. Eighty-six participants were randomized to an exercise group providing multimodal exercise program for 12 months or a control group which did not participate in any exercise program. The Performance Oriented Mobility Assessment scale, Timed Up and Go test, and incidence of falls were measured at baseline, at 6 months and at 12 months. There was a significant improvement in balance-related items of Performance Oriented Mobility Assessment scale in the exercise group both at 6 month and 12 month (P<0.0001, P=0.002; respectively). There was no statistically significant increase in gait-related items of Performance Oriented Mobility Assessment scale after the first 6-month treatment period (P=0.210), but in the second 6-month treatment period the POMA-G score improved significantly (P=0.001). There was no significant difference between groups regarding falls. Our results confirmed that a 12-month multimodal exercise program can improve the balance in cognitively impaired older adults. Based on our results, the multimodal exercise program may be a promising fall prevention exercise program for older adults with mild or moderate cognitive impairment improving static balance but it is supposed that more emphasis should be put on walking component of exercise program and environmental fall risk assessment.

Competency assessment of microbiology medical laboratory technologists in Ontario, Canada.

PubMed

Desjardins, Marc; Fleming, Christine Ann

2014-08-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program--Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. Copyright © 2014, American Society for Microbiology. All Rights Reserved.

Year One Implications of a Teacher Performance Assessment's Impact on Multicultural Education across a Secondary Education Teacher Preparation Program

ERIC Educational Resources Information Center

Liu, Laura B.; Milman, Natalie B.

2013-01-01

This case study examines the impact of the 1-year implementation of a state-mandated, standardized teacher performance assessment (TPA) on a faculty's infusion of multicultural education across a secondary education teacher preparation program. Findings show that faculty and teacher candidate (TC) perceptions predominantly concluded that the TPA…

42 CFR 460.140 - Additional quality assessment activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... SERVICES (CONTINUED) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) Quality Assessment and Performance Improvement § 460.140 Additional quality...

What does a Performance Measurement System Tell Us about the National Comprehensive Cancer Control Program?

PubMed Central

Townsend, Julie S.; Moore, Angela R.; Mulder, Tiffani N.; Boyd, Mary

2015-01-01

Context The National Comprehensive Cancer Control Program (NCCCP) performance measurement system seeks to understand both the processes that funded programs undertake with their respective coalitions to implement the objectives of their cancer plans and outcomes of those efforts. Objective To identify areas of achievement and technical assistance needs of NCCCP awardees. Design Program performance was assessed through surveys completed by program directors on performance indicators in 2009 and 2010 and queries from a web-based management information system in 2011 and 2012. Setting Programs funded by CDC’s NCCCP. Participants 69 programs. Main Outcome Measure(s) The key performance measures assessed were: inclusion of diverse partners and key sectors in cancer coalitions; partners’ involvement in activities; receiving in-kind resources from partners; using evidence-based interventions and data for setting priorities; conducting program evaluation; using community- or organization-level strategies to address cancer control efforts; and demonstrating progress toward achieving health outcomes. Results Most programs reported having active coalitions that represent diverse organizational sectors. Nearly all programs routinely assess the burden of cancer. In-kind resources to implement activities peaked at $64,716 in the second year of a five year funding cycle, and declined in subsequent project years. By year 3, over 70% of programs reported having an evaluation plan. While programs reported that nearly two-thirds of their interventions were evidence-based, some programs implemented non-evidence-based interventions. A majority of programs successfully used at least one community- or organization-level change strategy. However, many programs did not incorporate objectives linked to health outcomes as they reported progress in implementing interventions. Conclusions: While NCCCP programs were strong at building and maintaining infrastructure, some programs may need additional technical assistance to increase the adoption of evidence-based interventions, develop solid and responsive evaluation plans, and better link efforts to population-based measures that demonstrate impact toward reducing the burden of cancer. PMID:25136936

Teaching and assessing technical proficiency in surgical subspecialty fellowships.

PubMed

Gearhart, Susan L; Wang, Ming-Hsien; Gilson, Marta M; Chen, Belinda; Kern, David E

2012-01-01

To determine how programs are teaching and assessing procedural skills, and their perceived success. Cross-sectional survey. Accreditation Council for Graduate Medical Education (ACGME) approved training programs in pediatric urology and colorectal surgery. Program directors and recent graduates (2007-2009). Thirty-nine program directors (60%), and 57 graduates (64%) responded; 89.5% of graduates and 94.9% of program directors felt training occurred successfully for the procedures that trainees were performing in their present practice. Nearly 90% of trainees and all program directors reported that there was no formal assessment of procedural competency at the beginning of training, although 66.7% of program directors reported that trainees were assessed "informally." Both program directors and trainees reported dialogue with faculty was the most frequent method used in preparing for operative procedures. Other methods (textbook/atlas, journals, web-based programs, videos) were used less frequently. Program directors with shorter tenure were more likely to use web-based and video methods; younger trainees were less likely to use textbooks/atlases. Faculty feedback on clinical decision-making and postprocedural review were perceived by both program directors and trainees as the most effective assessment methods for improving performance; however, trainees were more likely than program directors to report that postprocedure reviews were not included in their training (15.8% vs 9%, p = 0.045). Patient outcomes, written feedback from peers, and self-assessment were included in most programs, but valued less. Simulation was used in only about half the programs and was valued more highly by trainees than program directors (p = 0.011). Training in procedural proficiency was viewed as successful by both program directors and graduates. Dialogue with, assessment by, and feedback from faculty were frequently used and most valued; stressing the importance of the facilitator role of faculty in the education of the trainee. These findings provide guidance for the development of newer methods of teaching and assessment. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Program Performance Inventory: Six Juvenile Offender Programs.

ERIC Educational Resources Information Center

Thomalla, Terri Groff; Dougherty, Victoria J.

This report describes the performance of 6 Connecticut juvenile justice alternative sanction programs in 14 qualitative areas: community reintegration; outcomes and evaluation; assessment methods; risk factors; escalation of criminal activity; family involvement; community involvement; work ethic and vocational training; education and life skills;…

Critical Assessment of Metagenome Interpretation – a benchmark of computational metagenomics software

PubMed Central

Sczyrba, Alexander; Hofmann, Peter; Belmann, Peter; Koslicki, David; Janssen, Stefan; Dröge, Johannes; Gregor, Ivan; Majda, Stephan; Fiedler, Jessika; Dahms, Eik; Bremges, Andreas; Fritz, Adrian; Garrido-Oter, Ruben; Jørgensen, Tue Sparholt; Shapiro, Nicole; Blood, Philip D.; Gurevich, Alexey; Bai, Yang; Turaev, Dmitrij; DeMaere, Matthew Z.; Chikhi, Rayan; Nagarajan, Niranjan; Quince, Christopher; Meyer, Fernando; Balvočiūtė, Monika; Hansen, Lars Hestbjerg; Sørensen, Søren J.; Chia, Burton K. H.; Denis, Bertrand; Froula, Jeff L.; Wang, Zhong; Egan, Robert; Kang, Dongwan Don; Cook, Jeffrey J.; Deltel, Charles; Beckstette, Michael; Lemaitre, Claire; Peterlongo, Pierre; Rizk, Guillaume; Lavenier, Dominique; Wu, Yu-Wei; Singer, Steven W.; Jain, Chirag; Strous, Marc; Klingenberg, Heiner; Meinicke, Peter; Barton, Michael; Lingner, Thomas; Lin, Hsin-Hung; Liao, Yu-Chieh; Silva, Genivaldo Gueiros Z.; Cuevas, Daniel A.; Edwards, Robert A.; Saha, Surya; Piro, Vitor C.; Renard, Bernhard Y.; Pop, Mihai; Klenk, Hans-Peter; Göker, Markus; Kyrpides, Nikos C.; Woyke, Tanja; Vorholt, Julia A.; Schulze-Lefert, Paul; Rubin, Edward M.; Darling, Aaron E.; Rattei, Thomas; McHardy, Alice C.

2018-01-01

In metagenome analysis, computational methods for assembly, taxonomic profiling and binning are key components facilitating downstream biological data interpretation. However, a lack of consensus about benchmarking datasets and evaluation metrics complicates proper performance assessment. The Critical Assessment of Metagenome Interpretation (CAMI) challenge has engaged the global developer community to benchmark their programs on datasets of unprecedented complexity and realism. Benchmark metagenomes were generated from ~700 newly sequenced microorganisms and ~600 novel viruses and plasmids, including genomes with varying degrees of relatedness to each other and to publicly available ones and representing common experimental setups. Across all datasets, assembly and genome binning programs performed well for species represented by individual genomes, while performance was substantially affected by the presence of related strains. Taxonomic profiling and binning programs were proficient at high taxonomic ranks, with a notable performance decrease below the family level. Parameter settings substantially impacted performances, underscoring the importance of program reproducibility. While highlighting current challenges in computational metagenomics, the CAMI results provide a roadmap for software selection to answer specific research questions. PMID:28967888

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Guiding dental student learning and assessing performance in critical thinking with analysis of emerging strategies.

PubMed

Johnsen, David C; Lipp, Mitchell J; Finkelstein, Michael W; Cunningham-Ford, Marsha A

2012-12-01

Patient-centered care involves an inseparable set of knowledge, abilities, and professional traits on the part of the health care provider. For practical reasons, health professions education is segmented into disciplines or domains like knowledge, technical skills, and critical thinking, and the culture of dental education is weighted toward knowledge and technical skills. Critical thinking, however, has become a growing presence in dental curricula. To guide student learning and assess performance in critical thinking, guidelines have been developed over the past several decades in the educational literature. Prominent among these guidelines are the following: engage the student in multiple situations/exercises reflecting critical thinking; for each exercise, emulate the intended activity for validity; gain agreement of faculty members across disciplines and curriculum years on the learning construct, application, and performance assessment protocol for reliability; and use the same instrument to guide learning and assess performance. The purposes of this article are 1) to offer a set of concepts from the education literature potentially helpful to guide program design or corroborate existing programs in dental education; 2) to offer an implementation model consolidating these concepts as a guide for program design and execution; 3) to cite specific examples of exercises and programs in critical thinking in the dental education literature analyzed against these concepts; and 4) to discuss opportunities and challenges in guiding student learning and assessing performance in critical thinking for dentistry.

Performance Assessment Links in Science.

ERIC Educational Resources Information Center

Quellmalz, Edys; Schank, Patricia; Hinojosa, Thomas; Padilla, Christine

1999-01-01

Describes work in progress at SRI International in the Performance Assessment Links in Science (PALS) project, which is developing an online, standards-based, interactive resource bank of science performance assessments. Coupled with the development of the resource bank is a program of research on effective use of these resources. (SLD)

A rater training protocol to assess team performance.

PubMed

Eppich, Walter; Nannicelli, Anna P; Seivert, Nicholas P; Sohn, Min-Woong; Rozenfeld, Ranna; Woods, Donna M; Holl, Jane L

2015-01-01

Simulation-based methodologies are increasingly used to assess teamwork and communication skills and provide team training. Formative feedback regarding team performance is an essential component. While effective use of simulation for assessment or training requires accurate rating of team performance, examples of rater-training programs in health care are scarce. We describe our rater training program and report interrater reliability during phases of training and independent rating. We selected an assessment tool shown to yield valid and reliable results and developed a rater training protocol with an accompanying rater training handbook. The rater training program was modeled after previously described high-stakes assessments in the setting of 3 facilitated training sessions. Adjacent agreement was used to measure interrater reliability between raters. Nine raters with a background in health care and/or patient safety evaluated team performance of 42 in-situ simulations using post-hoc video review. Adjacent agreement increased from the second training session (83.6%) to the third training session (85.6%) when evaluating the same video segments. Adjacent agreement for the rating of overall team performance was 78.3%, which was added for the third training session. Adjacent agreement was 97% 4 weeks posttraining and 90.6% at the end of independent rating of all simulation videos. Rater training is an important element in team performance assessment, and providing examples of rater training programs is essential. Articulating key rating anchors promotes adequate interrater reliability. In addition, using adjacent agreement as a measure allows differentiation between high- and low-performing teams on video review. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Texas Nutrition Education and Training Program. Final Evaluation Report for Federal Fiscal Year 1994.

ERIC Educational Resources Information Center

Ahmad, Mahassen

This report presents federally mandated evaluations and needs assessments conducted by the Texas Nutrition Education and Training (NET) program during Federal Fiscal Year 1994. General program performance of NET reflected an increase in the number of children in Texas and expansion in NET program activities. Needs assessment data collected from…

The Effects of the Home Instruction Program for Preschool Youngsters (HIPPY) on Children's School Performance at the End of the Program and One Year Later.

ERIC Educational Resources Information Center

Baker, Amy J. L.; Piotrkowski, Chaya S.; Brooks-Gunn, Jeanne

1998-01-01

Evaluated whether participation in HIPPY (Home Instruction Program for Preschool Youngsters) has a positive impact on young children's performance in school. Assessed 182 children at baseline, the program's end, and one year later. Interpreted findings as mixed support for the effectiveness of the HIPPY program. (JS)

Students' Midprogram Content Area Performance as a Predictor of End-of-Program NCLEX Readiness.

PubMed

Brussow, Jennifer A; Dunham, Michelle

2017-12-22

Many programs have implemented end-of-program predictive testing to identify students at risk of NCLEX-RN failure. Unfortunately, for many students, end-of-program testing comes too late. Regression and relative importance analysis were used to explore relationships between 9 content area assessments and an end-of-program assessment shown to be predictive of NCLEX-RN success. Results indicate that scores on assessments for content areas such as medical surgical nursing and care of children are predictive of end-of-program test scores, suggesting that instructors should provide remediation at the first sign of lagging performance.This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in anyway or used commercially without permission from the journal.

What Assessment Knowledge and Skills Do Initial Teacher Education Programs Address? A Western Canadian Perspective

ERIC Educational Resources Information Center

Poth, Cheryl-Anne

2012-01-01

Teacher education programs play a crucial role in preparing teachers for their future assessment roles and responsibilities, yet many beginning teachers feel unprepared to assess their students' performances (Mertler, 2009). To address concerns related to the relevancy of pre-service assessment education, this study examined 57 syllabi from…

Public Management Reform and Organizational Performance: An Empirical Assessment of the U.K. Labour Government's Public Service Improvement Strategy

ERIC Educational Resources Information Center

Walker, Richard M.; Boyne, George A.

2006-01-01

We present the first empirical assessment of the U.K. Labour government's program of public management reform. This reform program is based on rational planning, devolution and delegation, flexibility and incentives, and enhanced choice. Measures of these variables are tested against external and internal indicators of organizational performance.…

Direct assessment as a measure of institutional effectiveness in a dental hygiene distance education program.

PubMed

Olmsted, Jodi L

2014-10-01

This ten-year, longitudinal examination of a dental hygiene distance education (DE) program considered student performance on standard benchmark assessments as direct measures of institutional effectiveness. The aim of the study was to determine if students face-to-face in a classroom with an instructor performed differently from their counterparts in a DE program, taking courses through the alternative delivery system of synchronous interactive television (ITV). This study used students' grade point averages and National Board Dental Hygiene Examination scores to assess the impact of ITV on student learning, filling a crucial gap in current evidence. The study's research population consisted of 189 students who graduated from one dental hygiene program between 1997 and 2006. One hundred percent of the institution's data files for these students were used: 117 students were face-to-face with the instructor, and seventy-two received instruction through the ITV system. The results showed that, from a year-by-year perspective, no statistically significant performance differences were apparent between the two student groups when t-tests were used for data analysis. The DE system examined was considered effective for delivering education if similar performance outcomes were the evaluation criteria used for assessment.

Failure Is Not an Option: A Root Cause Analysis of Failed Acquisition Programs

DTIC Science & Technology

2017-12-01

Kendall (2012, 2015). ..................................................................................4 Table 3. Description and Decision Authority...Assessment and Program Evaluation DAE Defense Acquisition Executive DAMIR Defense Acquisition Management Information Retrieval DARPA Defense Advanced...and evaluation OTA other transactions authority PARCA performance assessments and root cause analyses PBD program budget decisions PDR preliminary

Assessment in the context of licensure and certification.

PubMed

Norcini, John J; Lipner, Rebecca S; Grosso, Louis J

2013-01-01

Over the past 25 years, three major forces have had a significant influence on licensure and certification: the shift in focus from educational process to educational outcomes, the increasing recognition of the need for learning and assessment throughout a physician's career, and the changes in technology and psychometrics that have opened new vistas for assessment. These forces have led to significant changes in assessment for licensure and certification. To respond to these forces, licensure and certification programs have improved the ways in which their examinations are constructed, scored, and delivered. In particular, we note the introduction of adaptive testing; automated item creation, scoring, and test assembly; assessment engineering; and data forensics. Licensure and certification programs have also expanded their repertoire of assessments with the rapid development and adoption of simulation and workplace-based assessment. Finally, they have invested in research intended to validate their programs in four ways: (a) the acceptability of the program to stakeholders, (b) the extent to which stakeholders are encouraged to learn and improve, (c) the extent to which there is a relationship between performance in the programs and external measures, and (d) the extent to which there is a relationship between performance as measured by the assessment and performance in practice. Over the past 25 years, changes in licensure and certification have been driven by the educational outcomes movement, the need for lifelong learning, and advances in technology and psychometrics. Over the next 25 years, we expect these forces to continue to exert pressure for change which will lead to additional improvement and expansion in examination processes, methods of assessment, and validation research.

Evaluation of an external quality assessment program for HIV testing in Haiti, 2006-2011.

PubMed

Louis, Frantz Jean; Anselme, Renette; Ndongmo, Clement; Buteau, Josiane; Boncy, Jacques; Dahourou, Georges; Vertefeuille, John; Marston, Barbara; Balajee, S Arunmozhi

2013-12-01

To evaluate an external quality assessment (EQA) program for human immunodeficiency virus (HIV) rapid diagnostics testing by the Haitian National Public Health Laboratory (French acronym: LNSP). Acceptable performance was defined as any proficiency testing (PT) score more than 80%. The PT database was reviewed and analyzed to assess the testing performance of the participating laboratories and the impact of the program over time. A total of 242 laboratories participated in the EQA program from 2006 through 2011; participation increased from 70 laboratories in 2006 to 159 in 2011. In 2006, 49 (70%) laboratories had a PT score of 80% or above; by 2011, 145 (97.5%) laboratories were proficient (P < .05). The EQA program for HIV testing ensures quality of testing and allowed the LNSP to document improvements in the quality of HIV rapid testing over time.

Assessing the effect of high school students’ training program on peers performance suffering from asthma

PubMed Central

Ghazavi, Zohreh; Hemmati, Zeinab; Hasanpour, Marziyeh; Iranpour, Ramin

2010-01-01

BACKGROUND: Asthma is the most common disease in childhood which is considered as the forerunner of the acute diseases and simply can cause disability among the children. Since childhood and adolescence are the most important periods of growth and perfection and incidence of asthma can bring about distortion in this process, the present study done aimed to assess the effect of conducting high school training program on peers’ performance with asthma. METHODS: This was a quasi-experimental study in which the performance rate of the students at the time of artificial attack of asthma was directly observed, assessed and compared through demographic data questionnaire and performance assessment check list. Eighty individuals from the second grade of high school students in 2010 in Isfahan City were randomly selected to participate in the present study, among which, 40 individuals were entered in the test group and 40 of them also were placed in the control group. After conducting the training program for the test group, which had been designed both by direct method (in person and face to face by asking and answering and group discussion) and by indirect method (using pamphlet and other educational materials), the level of the training effectiveness was assessed on the students’ performance. RESULTS: The findings of the present study indicated that the performance of students at the test group increased from 2.2 (0.6) to 91.8 (1.3) which emphasized that the training program for the young adolescent peers had a positive effect on promoting their health. CONCLUSIONS: Considering the results of the present study and regarding to the importance and role of students as the future makers of the country, and also the cost-effectiveness of the training programs and the positive effect of peers on increasing the level of health among the students with asthma and consequently decreasing the school absence, it obviously seems necessary to generalize and expand these training programs. PMID:22069400

Predictive Validity of Measures of the Pathfinder Scaling Algorithm on Programming Performance: Alternative Assessment Strategy for Programming Education

ERIC Educational Resources Information Center

Lau, Wilfred W. F.; Yuen, Allan H. K.

2009-01-01

Recent years have seen a shift in focus from assessment of learning to assessment for learning and the emergence of alternative assessment methods. However, the reliability and validity of these methods as assessment tools are still questionable. In this article, we investigated the predictive validity of measures of the Pathfinder Scaling…

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2010 CFR

2010-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...

Computer program for assessing the theoretical performance of a three dimensional inlet

NASA Technical Reports Server (NTRS)

Agnone, A. M.; Kung, F.

1972-01-01

A computer program for determining the theoretical performance of a three dimensional inlet is presented. An analysis for determining the capture area, ram force, spillage force, and surface pressure force is presented, along with the necessary computer program. A sample calculation is also included.

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2010 CFR

2010-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality assurance assessments; (ii) Equal Employment Opportunity (EEO) Compliance Reviews; and (iii) Completion... 29 Labor 1 2010-07-01 2010-07-01 true Program performance standards. 29.6 Section 29.6 Labor...

A Paradigm Shift toward Evidence-Based Clinical Practice: Developing a Performance Assessment

ERIC Educational Resources Information Center

Wentworth, Nancy; Erickson, Lynnette B.; Lawrence, Barbara; Popham, J. Aaron; Korth, Byran

2009-01-01

The Clinical Practice Assessment System (CPAS), developed in response to teacher preparation program accreditation requirements, represents a paradigm shift of one university toward data-based decision-making in teacher education programs. The new assessment system is a scale aligned with INTASC Standards, which allows for observation and…

What and How to Assess Teacher's Performance? A Proposal Based on the Factors That Support Learning

ERIC Educational Resources Information Center

Carlos-Guzmán, Jesús

2016-01-01

A proposal is presented to assess teacher's performance based on the aspects that educational research has found as fundamental to achieve students' learning. The proposal is aimed mainly at teachers and people responsible for teacher's assessment programs. After criticizing the traditional way of assessing teacher's performance, it is shown a…

Using a Scoring Rubric to Assess the Writing of Bioethics Students.

PubMed

Stoddard, Hugh A; Labrecque, Cory A; Schonfeld, Toby

2016-04-01

Educators in bioethics have struggled to find valid and reliable assessments that transcend the "reproduction of knowledge" to target more important skill sets. This manuscript reports on the process of developing and grading a minimal-competence comprehensive examination in a bioethics master's degree program. We describe educational theory and practice for the creation and deployment of scoring rubrics for high-stakes performance assessments that reduce scoring inconsistencies. The rubric development process can also benefit the program by building consensus among stakeholders regarding program goals and student outcomes. We describe the Structure of the Observed Learning Outcome taxonomy as a mechanism for rubric design and provide an example of how we applied that taxonomy to define pass/fail cut scores. Details about domains of assessment and writing descriptors of performance are also presented. Despite the laborious work required to create a scoring rubric, we found the effort to be worthwhile for our program.

[Standardization in laboratory hematology by participating in external quality assurance programs].

PubMed

Nazor, Aida; Siftar, Zoran; Flegar-Mestrić, Zlata

2011-09-01

Since 1985, Department of Clinical Chemistry and Laboratory Medicine, Merkur University Hospital, Zagreb, has been participating in the International External Quality Assessment Scheme for Hematology (IEQAS-H) organized by the World Health Organization (WHO). Owing to very good results, in 1987 the Department received a certificate of participation in this control scheme. Department has been cooperating in the external quality assessment program in laboratory hematology which has been continuously performed in Croatia since 1986 by the Committee for External Quality Assessment Schemes under the auspices of the Croatian Society of Medical Biochemists and School of Pharmacy and Biochemistry, University of Zagreb. Nowadays, 186 medical biochemical laboratories are included in the National External Quality Assessment program, which is performed three times per year. Our Department has participated in the international projects of the European Committee for External Quality Assurance Programs in Laboratory Medicine (EQALM).

Teaching and assessing competence in cataract surgery.

PubMed

Henderson, Bonnie An; Ali, Rasha

2007-02-01

To review recent literature regarding innovative techniques, methods of teaching and assessing competence and skill in cataract surgery. The need for assessment of surgical competency and the requirement of wet lab facilities in ophthalmic training programs are being increasingly emphasized. Authors have proposed the use of standardized forms to collect objective and subjective data regarding the residents' surgical performance. Investigators have reported methods to improve visualization of cadaver and animal eyes for the wet lab, including the use of capsular dyes. The discussion of virtual reality as a teaching tool for surgical programs continues. Studies have proven that residents trained on a laparoscopic simulator outperformed nontrained residents during actual surgery for both surgical times and numbers of errors. Besides virtual reality systems, a program is being developed to separate the cognitive portion from the physical aspects of surgery. Another program couples surgical videos with three-dimensional animation to enhance the trainees' topographical understanding. Proper assessment of surgical competency is becoming an important focus of training programs. The use of surgical data forms may assist in standardizing objective assessments. Virtual reality, cognitive curriculum and animation video programs can be helpful in improving residents' surgical performance.

Organizational Change Efforts: Methodologies for Assessing Organizational Effectiveness and Program Costs versus Benefits.

ERIC Educational Resources Information Center

Macy, Barry A.; Mirvis, Philip H.

1982-01-01

A standardized methodology for identifying, defining, and measuring work behavior and performance rather than production, and a methodology that estimates the costs and benefits of work innovation are presented for assessing organizational effectiveness and program costs versus benefits in organizational change programs. Factors in a cost-benefit…

Resident self-other assessor agreement: influence of assessor, competency, and performance level.

PubMed

Lipsett, Pamela A; Harris, Ilene; Downing, Steven

2011-08-01

To review the literature on self-assessment in the context of resident performance and to determine the correlation between self-assessment across competencies in high- and low-performing residents and assessments performed by raters from a variety of professional roles (peers, nurses, and faculty). Retrospective analysis of prospectively collected anonymous self-assessment and multiprofessional (360) performance assessments by competency and overall. University-based academic general surgical program. Sixty-two residents rotating in general surgery. Mean difference for each self-assessment dyad (self-peer, self-nurse, and self-attending physician) by resident performance quartile, adjusted for measurement error, correlation coefficients, and summed differences across all competencies. Irrespective of self-other dyad, residents asked to rate their global performance overestimated their skills. Residents in the upper quartile underestimated their specific skills while those in the lowest-performing quartile overestimated their abilities when compared with faculty, peers, and especially nurse raters. Moreover, overestimation was greatest in competencies related to interpersonal skills, communication, teamwork, and professionalism. Rater, level of performance, and the competency being assessed all influence the comparison of the resident's self-assessment and those of other raters. Self-assessment of competencies related to behavior may be inaccurate when compared with raters from various professions. Residents in the lowest-performing quartile are least able to identify their weakness. These data have important implications for residents, program directors, and the public and suggest that strategies that help the lowest-performing residents recognize areas in need of improvement are needed.

Diversity in Teacher Assessment: What's Working, What's Not?

ERIC Educational Resources Information Center

Nweke, Winifred; Noland, Juanie

The purpose of this study was to evaluate the effectiveness of using performance and portfolio assessment techniques to diversify assessment in a minority teacher education program at Tuskegee University (Alabama). Both performance and portfolio assessments served as the exit examination. These techniques were used for three reasons: a state…

A web-based micro-simulation program for self-learning BLS skills and the use of an AED. Can laypeople train themselves without a manikin?

PubMed

de Vries, Wiebe; Handley, Anthony J

2007-12-01

Various methods, including self-instruction, have been used to try to improve the acquisition of basic life support skills. This is a preliminary report of the effectiveness of a web-based self-training program for BLS and the use of an AED. Sixteen volunteers completed on-line training in their own time over a period of 8 weeks. The program included theory, scenario training and self-testing, but without practice on a manikin, or any instructor input. The volunteers were assessed, without prior warning, in a scenario setting. A recording manikin, expert assessors and video recording were used with a modified version of the Cardiff Test. All 16 volunteers performed the assessed skills in the use of an AED correctly. Most of the skills of BLS assessed were performed well. Chest compression depth and rate were performed less well (59% and 67% of participants, respectively, performed correctly). Opening the airway and lung inflation were performed poorly (38% and 13% of participants performed correctly), as was checking for safety (19% participants performed correctly). There was no significant correlation between the time a participant spent on-line and the quality of performance. Only 5 of the volunteers had ever attended a BLS course or used a resuscitation manikin before the assessment; their performance scores were not significantly better than those of the other 11 volunteers. These results suggest that it may be possible to train people in BLS and AED skills using a micro-simulation web-based interactive program but without any practice on a manikin. This seems to be particularly the case for the use of an AED, where performance achieved a uniformly high standard.

Coverage of Large-Scale Food Fortification of Edible Oil, Wheat Flour, and Maize Flour Varies Greatly by Vehicle and Country but Is Consistently Lower among the Most Vulnerable: Results from Coverage Surveys in 8 Countries123

PubMed Central

Aaron, Grant J; Friesen, Valerie M; Jungjohann, Svenja; Garrett, Greg S; Myatt, Mark

2017-01-01

Background: Large-scale food fortification (LSFF) of commonly consumed food vehicles is widely implemented in low- and middle-income countries. Many programs have monitoring information gaps and most countries fail to assess program coverage. Objective: The aim of this work was to present LSFF coverage survey findings (overall and in vulnerable populations) from 18 programs (7 wheat flour, 4 maize flour, and 7 edible oil programs) conducted in 8 countries between 2013 and 2015. Methods: A Fortification Assessment Coverage Toolkit (FACT) was developed to standardize the assessments. Three indicators were used to assess the relations between coverage and vulnerability: 1) poverty, 2) poor dietary diversity, and 3) rural residence. Three measures of coverage were assessed: 1) consumption of the vehicle, 2) consumption of a fortifiable vehicle, and 3) consumption of a fortified vehicle. Individual program performance was assessed based on the following: 1) achieving overall coverage ≥50%, 2) achieving coverage of ≥75% in ≥1 vulnerable group, and 3) achieving equity in coverage for ≥1 vulnerable group. Results: Coverage varied widely by food vehicle and country. Only 2 of the 18 LSFF programs assessed met all 3 program performance criteria. The 2 main program bottlenecks were a poor choice of vehicle and failure to fortify a fortifiable vehicle (i.e., absence of fortification). Conclusions: The results highlight the importance of sound program design and routine monitoring and evaluation. There is strong evidence of the impact and cost-effectiveness of LSFF; however, impact can only be achieved when the necessary activities and processes during program design and implementation are followed. The FACT approach fills an important gap in the availability of standardized tools. The LSFF programs assessed here need to be re-evaluated to determine whether to further invest in the programs, whether other vehicles are appropriate, and whether other approaches are needed. PMID:28404836

Coverage of Large-Scale Food Fortification of Edible Oil, Wheat Flour, and Maize Flour Varies Greatly by Vehicle and Country but Is Consistently Lower among the Most Vulnerable: Results from Coverage Surveys in 8 Countries.

PubMed

Aaron, Grant J; Friesen, Valerie M; Jungjohann, Svenja; Garrett, Greg S; Neufeld, Lynnette M; Myatt, Mark

2017-05-01

Background: Large-scale food fortification (LSFF) of commonly consumed food vehicles is widely implemented in low- and middle-income countries. Many programs have monitoring information gaps and most countries fail to assess program coverage. Objective: The aim of this work was to present LSFF coverage survey findings (overall and in vulnerable populations) from 18 programs (7 wheat flour, 4 maize flour, and 7 edible oil programs) conducted in 8 countries between 2013 and 2015. Methods: A Fortification Assessment Coverage Toolkit (FACT) was developed to standardize the assessments. Three indicators were used to assess the relations between coverage and vulnerability: 1 ) poverty, 2 ) poor dietary diversity, and 3 ) rural residence. Three measures of coverage were assessed: 1 ) consumption of the vehicle, 2 ) consumption of a fortifiable vehicle, and 3 ) consumption of a fortified vehicle. Individual program performance was assessed based on the following: 1 ) achieving overall coverage ≥50%, 2) achieving coverage of ≥75% in ≥1 vulnerable group, and 3 ) achieving equity in coverage for ≥1 vulnerable group. Results: Coverage varied widely by food vehicle and country. Only 2 of the 18 LSFF programs assessed met all 3 program performance criteria. The 2 main program bottlenecks were a poor choice of vehicle and failure to fortify a fortifiable vehicle (i.e., absence of fortification). Conclusions: The results highlight the importance of sound program design and routine monitoring and evaluation. There is strong evidence of the impact and cost-effectiveness of LSFF; however, impact can only be achieved when the necessary activities and processes during program design and implementation are followed. The FACT approach fills an important gap in the availability of standardized tools. The LSFF programs assessed here need to be re-evaluated to determine whether to further invest in the programs, whether other vehicles are appropriate, and whether other approaches are needed.

[Performance assessment employing slide sets: A tool for the classification of senior microscopists from Colombia´s Malaria Control Program].

PubMed

Mendoza, Nohora Marcela; González, Nohora Elizabeth

2015-01-01

One of the most important activities for quality assurance of malaria diagnosis is performance assessment. In Colombia, performance assessment of malaria microscopists has been done through the external performance assessment and indirect external performance assessment programs. To assess the performance of malaria microscopists of public reference laboratories using slide sets, and to describe the methodology used for this purpose. This was a retrospective study to evaluate the concordance of senior microscopists regarding parasite detection, species identification and parasite count based on the results of the assessment of competences using two sets, one comprising 40 slides, and another one with 17 slides. The concordance for parasite detection was 96.9% (95% CI: 96.0-97.5) and 88.7% (95% CI: 86.6-90.5) for species identification. The average percentage of concordant slides in the group evaluated was 89.7% (95% CI: 87.5-91.6). Most of the senior microscopists in Colombia were classified in the two top categories in the performance assessment using slide sets. The most common difficulty encountered was the identification of parasite species. The use of this tool to assess individual performance of microscopists in the evaluation of samples with different degrees of difficulty allows for characterizing the members of the malaria diagnosis network and strengthening the abilities of those who require it.

Can outcome-based continuing medical education improve performance of immigrant physicians?

PubMed

Castel, Orit Cohen; Ezra, Vered; Alperin, Mordechai; Nave, Rachel; Porat, Tamar; Golan, Avivit Cohen; Vinker, Shlomo; Karkabi, Khaled

2011-01-01

Immigrant physicians are a valued resource for physician workforces in many countries. Few studies have explored the education and training needs of immigrant physicians and ways to facilitate their integration into the health care system in which they work. Using an educational program developed for immigrant civilian physicians working in military primary care clinics at the Israel Defence Force, we illustrate how an outcome-based CME program can address practicing physicians' needs for military-specific primary care education and improve patient care. Following an extensive needs assessment, a 3-year curriculum was developed. The curriculum was delivered by a multidisciplinary educational team. Pre/post multiple-choice examinations, objective structured clinical examinations (OSCE), and end-of-program evaluations were administered for curriculum evaluation. To evaluate change in learners' performance, data from the 2003 (before-program) and 2006 (after-program) work-based assessments were retrieved retrospectively. Change in the performance of program participants was compared with that of immigrant physicians who did not participate in the program. Out of 28 learners, 23 (82%) completed the program. Learners did significantly better in the annual post-tests compared with the pretests (p <.01) and improved their OSCE scores (p <.001). Most program graduates (90%) rated overall satisfaction as very good or excellent. In comparison with nonparticipants, program graduates performed better on work-based assessments (Cohen's d =.63). Our intensive, outcome-based, longitudinal CME program has yielded encouraging results. Other medical educators, facing the challenge of integrating immigrant physicians to fit their health care system, may consider adapting our approach. Copyright © 2011 The Alliance for Continuing Medical Education, the Society for Academic Continuing Medical Education, and the Council on CME, Association for Hospital Medical Education.

Telephone-administered cognitive-behavioral therapy for clients with depressive symptoms in an employee assistance program: a pilot study.

PubMed

Lam, Raymond W; Lutz, Kevin; Preece, Melady; Cayley, Paula M; Bowen Walker, Anne

2011-02-01

To assess the clinical and work productivity effects of a brief intervention using telephone-administered cognitive-behavioral therapy (CBT) for clients with depressive symptoms attending an employee assistance program (EAP). Self-referred clients attending the PPC Canada EAP with clinically relevant depressive symptoms at initial assessment were offered an 8-session telephone-administered CBT program. Outcomes before and after intervention were assessed with the 9-item Personal Health Questionnaire (PHQ-9), Global Assessment of Functioning (GAF), and clinician ratings of work absence and performance impairment. Fifty clients were referred to the pilot program; 39 participated and 31 completed the telephone CBT program. Among program participants, there was significant improvement in PHQ-9 and GAF scores. There was also a significant reduction in performance impairment but not work absence. Anecdotal reports indicated high satisfaction ratings among participants. The results of this pilot study, although limited by the absence of a comparison or control group, suggest that a brief telephone-administered CBT program can improve depressive symptomatology, work productivity, and general function in depressed clients attending an EAP. Further controlled studies are needed to confirm these preliminary findings.

The Italian pilot external quality assessment program for cystic fibrosis sweat test.

PubMed

Salvatore, Marco; Floridia, Giovanna; Amato, Annalisa; Censi, Federica; Carta, Claudio; de Stefano, Maria Chiara; Ferrari, Gianluca; Tosto, Fabrizio; Capoluongo, Ettore; Caruso, Ubaldo; Castaldo, Giuseppe; Cirilli, Natalia; Corbetta, Carlo; Padoan, Rita; Raia, Valeria; Taruscio, Domenica

2016-05-01

Sweat chloride test is the gold standard test for cystic fibrosis (CF) diagnosis. In 2014 the Istituto Superiore di Sanità established the Italian pilot external quality assessment program for CF sweat test (IEQA-ST). Ten laboratories, included among the 33 Italian CF Referral Centers, were selected and enrolled on the basis of their attitude to perform sweat test (ST) analysis by using methods recommended by the Italian Guidelines. They received three different sweat-like samples (normal, borderline and pathologic chloride concentration), with mock clinical indications, for analysis according to routine procedures. Assessment, performed by a panel of experts, covered analytical performance, interpretation and reporting of results; categories of "poor" and "satisfactory" performance were not defined. All data were managed through a web utility. The program identified important areas of interest and, in some case, of concern. It is important to underline that results are referred to a small proportion, i.e. about 30%, of Italian laboratories performing CF ST in the context of the Referral Centers. Data collected highlight the importance of participation in EQA programs as it may improve laboratory/clinical performance; our study represents a model for the setting up of a large-scale EQA scheme for ST. Copyright © 2016 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

Maximizing Energy Savings Reliability in BC Hydro Industrial Demand-side Management Programs: An Assessment of Performance Incentive Models

NASA Astrophysics Data System (ADS)

Gosman, Nathaniel

For energy utilities faced with expanded jurisdictional energy efficiency requirements and pursuing demand-side management (DSM) incentive programs in the large industrial sector, performance incentive programs can be an effective means to maximize the reliability of planned energy savings. Performance incentive programs balance the objectives of high participation rates with persistent energy savings by: (1) providing financial incentives and resources to minimize constraints to investment in energy efficiency, and (2) requiring that incentive payments be dependent on measured energy savings over time. As BC Hydro increases its DSM initiatives to meet the Clean Energy Act objective to reduce at least 66 per cent of new electricity demand with DSM by 2020, the utility is faced with a higher level of DSM risk, or uncertainties that impact the costeffective acquisition of planned energy savings. For industrial DSM incentive programs, DSM risk can be broken down into project development and project performance risks. Development risk represents the project ramp-up phase and is the risk that planned energy savings do not materialize due to low customer response to program incentives. Performance risk represents the operational phase and is the risk that planned energy savings do not persist over the effective measure life. DSM project development and performance risks are, in turn, a result of industrial economic, technological and organizational conditions, or DSM risk factors. In the BC large industrial sector, and characteristic of large industrial sectors in general, these DSM risk factors include: (1) capital constraints to investment in energy efficiency, (2) commodity price volatility, (3) limited internal staffing resources to deploy towards energy efficiency, (4) variable load, process-based energy saving potential, and (5) a lack of organizational awareness of an operation's energy efficiency over time (energy performance). This research assessed the capacity of alternative performance incentive program models to manage DSM risk in BC. Three performance incentive program models were assessed and compared to BC Hydro's current large industrial DSM incentive program, Power Smart Partners -- Transmission Project Incentives, itself a performance incentive-based program. Together, the selected program models represent a continuum of program design and implementation in terms of the schedule and level of incentives provided, the duration and rigour of measurement and verification (M&V), energy efficiency measures targeted and involvement of the private sector. A multi criteria assessment framework was developed to rank the capacity of each program model to manage BC large industrial DSM risk factors. DSM risk management rankings were then compared to program costeffectiveness, targeted energy savings potential in BC and survey results from BC industrial firms on the program models. The findings indicate that the reliability of DSM energy savings in the BC large industrial sector can be maximized through performance incentive program models that: (1) offer incentives jointly for capital and low-cost operations and maintenance (O&M) measures, (2) allow flexible lead times for project development, (3) utilize rigorous M&V methods capable of measuring variable load, process-based energy savings, (4) use moderate contract lengths that align with effective measure life, and (5) integrate energy management software tools capable of providing energy performance feedback to customers to maximize the persistence of energy savings. While this study focuses exclusively on the BC large industrial sector, the findings of this research have applicability to all energy utilities serving large, energy intensive industrial sectors.

A Correlational Study of the Tennessee Formative Assessment Program (TFAP) to the Tennessee Comprehensive Assessment Program (TCAP) on Fifth Grade Reading/Language Arts

ERIC Educational Resources Information Center

Williams, Tina R.

2009-01-01

The approach of high-stakes testing and accountability of student learning has resulted in an increase of ongoing assessments and continual instructional adjustments by teachers to achieve maximum student performance on standardized tests. According to Black and Wiliam (1998a), formative assessments can produce significant learning gains by…

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.

PubMed

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t -test, and comparisons between Groups A and B were analyzed with an independent t -test. Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient

PubMed Central

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Background Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. Methods We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test. Results Compared to the preseminar result, Group A’s postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Conclusion Improved pre–post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence. PMID:28794664

Do Training Programs Work? An Assessment of Pharmacists Activities in the Field of Chemical Dependency.

ERIC Educational Resources Information Center

Brooks, Valerie G.; Brock, Tina Penick; Ahn, Jungeun

2001-01-01

Seeks to determine if pharmacists who attended a chemical dependency training program were performing more chemical dependency related activities. Results reveal that participants were more likely to perform the following activities: lecture to community groups about chemical dependency; participate in a pharmacists' recovery program; provide…

Privacy Impact Assessment for the TRIO Programs Annual Performance Report (APR) System

ERIC Educational Resources Information Center

US Department of Education, 2008

2008-01-01

The TRIO Programs Annual Performance Report (APR) System collects individual student records on individuals served by the following Federal TRIO Programs: Upward Bound (which includes regular Upward Bound (UB), Upward Bound Math-Science (UBMS), and Veterans Upward Bound (VUB)); Student Support Services (SSS); and the Ronald E. McNair Post…

42 CFR 416.43 - Conditions for coverage-Quality assessment and performance improvement.

Code of Federal Regulations, 2011 CFR

2011-10-01

... outcomes, patient safety, and quality of care. (2) Performance improvement activities must track adverse... patient safety by using quality indicators or performance measures associated with improved health... that includes care and services furnished in the ASC. (b) Standard: Program data. (1) The program must...

Competency Assessment of Microbiology Medical Laboratory Technologists in Ontario, Canada

PubMed Central

Fleming, Christine Ann

2014-01-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program—Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. PMID:24899030

External quality-assurance programs managed by the U.S. Geological Survey in support of the National Atmospheric Deposition Program/National Trends Network

USGS Publications Warehouse

Latysh, Natalie E.; Wetherbee, Gregory A.

2005-01-01

The U.S. Geological Survey, Branch of Quality Systems, operates the external quality-assurance programs for the National Atmospheric Deposition Program/National Trends Network (NADP/NTN). Beginning in 1978, six different programs have been implemented?the intersite-comparison program, the blind-audit program, the sample-handling evaluation program, the field-audit program, the interlaboratory-comparison program, and the collocated-sampler program. Each program was designed to measure error contributed by specific components in the data-collection process. The intersite-comparison program, which was discontinued in 2004, was designed to assess the accuracy and reliability of field pH and specific-conductance measurements made by site operators. The blind-audit and sample-handling evaluation programs, which also were discontinued in 2002 and 2004, respectively, assessed contamination that may result from sampling equipment and routine handling and processing of the wet-deposition samples. The field-audit program assesses the effects of sample handling, processing, and field exposure. The interlaboratory-comparison program evaluates bias and precision of analytical results produced by the contract laboratory for NADP, the Illinois State Water Survey, Central Analytical Laboratory, and compares its performance with the performance of international laboratories. The collocated-sampler program assesses the overall precision of wet-deposition data collected by NADP/NTN. This report documents historical operations and the operating procedures for each of these external quality-assurance programs. USGS quality-assurance information allows NADP/NTN data users to discern between actual environmental trends and inherent measurement variability.

A Multifaceted Approach to Teamwork Assessment in an Undergraduate Business Program

ERIC Educational Resources Information Center

Kemery, Edward R.; Stickney, Lisa T.

2014-01-01

We describe a multifaceted, multilevel approach to teamwork learning and assessment. It includes teamwork knowledge, peer and self-appraisal of teamwork behavior, and individual and team performance on objective tests for teaching and assessing teamwork in an undergraduate business program. At the beginning of this semester-long process, students…

DOD Financial Management: Effect of Continuing Weaknesses on Management and Operations and Status of Key Challenges

DTIC Science & Technology

2014-05-13

the information needed to effectively (1) manage its assets, (2) assess program performance and make budget decisions , (3) make cost- effective ... decision making, including the information needed to effectively (1) manage its assets, (2) assess program performance and make budget decisions , (3...incorporating key elements of a comprehensive management approach , such as a complete analysis of the return on investment, quantitatively -defined goals

Valid and reliable authentic assessment of culminating student performance in the biomedical sciences.

PubMed

Oh, Deborah M; Kim, Joshua M; Garcia, Raymond E; Krilowicz, Beverly L

2005-06-01

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.

15 CFR 286.2 - Scope.

Code of Federal Regulations, 2014 CFR

2014-01-01

... accreditation body which satisfies the established requirements. (b) NIST operates the NVCASE program as follows: (1) Conformity level: Under this program NIST accepts requests for evaluations of U.S. bodies involved in activities related to conformity assessment. NIST does not perform conformity assessments as...

15 CFR 286.2 - Scope.

Code of Federal Regulations, 2012 CFR

2012-01-01

... accreditation body which satisfies the established requirements. (b) NIST operates the NVCASE program as follows: (1) Conformity level: Under this program NIST accepts requests for evaluations of U.S. bodies involved in activities related to conformity assessment. NIST does not perform conformity assessments as...

15 CFR 286.2 - Scope.

Code of Federal Regulations, 2011 CFR

2011-01-01

... accreditation body which satisfies the established requirements. (b) NIST operates the NVCASE program as follows: (1) Conformity level: Under this program NIST accepts requests for evaluations of U.S. bodies involved in activities related to conformity assessment. NIST does not perform conformity assessments as...

15 CFR 286.2 - Scope.

Code of Federal Regulations, 2010 CFR

2010-01-01

... accreditation body which satisfies the established requirements. (b) NIST operates the NVCASE program as follows: (1) Conformity level: Under this program NIST accepts requests for evaluations of U.S. bodies involved in activities related to conformity assessment. NIST does not perform conformity assessments as...

15 CFR 286.2 - Scope.

Code of Federal Regulations, 2013 CFR

2013-01-01

... accreditation body which satisfies the established requirements. (b) NIST operates the NVCASE program as follows: (1) Conformity level: Under this program NIST accepts requests for evaluations of U.S. bodies involved in activities related to conformity assessment. NIST does not perform conformity assessments as...

Army Enlisted Personnel Competency Assessment Program: Phase 2 Report

DTIC Science & Technology

2006-01-01

benefit analysis of a notional Army program will be conducted. v Findings: The prototype Army core assessment was successfully administered to over 600...about competency assessment. They will also be incorporated into a cost and benefit analysis to be conducted in Phase III. vi CONTENTS Page Chapter 1...Conduct a Cost- Benefit Analysis, and Make System Recommendations Phase I of PerformM21 resulted in program design recommendations that included such

Measuring Program Quality, Part 2: Addressing Potential Cultural Bias in a Rater Reliability Exam

ERIC Educational Resources Information Center

Richer, Amanda; Charmaraman, Linda; Ceder, Ineke

2018-01-01

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

Curriculum Mapping: A Before-and-After Look at Faculty Perceptions of Their Courses and the Mapping Process

ERIC Educational Resources Information Center

Joyner, Helen S.

2016-01-01

The increased interest in program- and university-level assessment over the past few decades has led to increased faculty involvement in developing program learning outcomes and performing program assessment activities. Depending on the level of support and encouragement faculty receive from administration and other entities, they may support or…

Implementation of a national external quality assessment program for medical laboratories in Burkina Faso: challenges, lessons learned, and perspectives.

PubMed

Sakandé, Jean; Nikièma, Abdoulaye; Kabré, Elie; Sawadogo, Charles; Nacoulma, Eric W; Sanou, Mamadou; Sangaré, Lassana; Traoré-Ouédraogo, Rasmata; Sawadogo, Mamadou; Gershy-Damet, Guy Michel

2014-02-01

The National External Quality Assessment (NEQA) program of Burkina Faso is a proficiency testing program mandatory for all laboratories in the country since 2006. The program runs two cycles per year and covers all areas of laboratories. All panels were validated by the expert committee before dispatch under optimal storage and transport conditions to participating laboratories along with report forms. Performance in the last 5 years varied by panel, with average annual performance of bacteriology panels for all laboratories rising from 75% in 2006 to 81% in 2010 and with a best average performance of 87% in 2007 and 2008. During the same period, malaria microscopy performance varied from 85% to 94%, with a best average performance of 94% in 2010; chemistry performance increased from 87% to 94%, with a best average annual performance of 97% in 2009. Hematology showed more variation in performance, ranging from 61% to 86%, with a best annual average performance of 90% in 2008. Average annual performance for immunology varied less between 2006 and 2010, recording 97%, 90%, and 95%. Except for malaria microscopy, annual performances for enrolled panels varied substantially from year to year, indicating some difficulty in maintaining consistency in quality. The main challenges of the NEQA program observed between 2006 to 2010 were funding, sourcing, and safe transportation of quality panels to all laboratories countrywide.

From mission to measures: performance measure development for a Teen Pregnancy Prevention Program.

PubMed

Farb, Amy Feldman; Burrus, Barri; Wallace, Ina F; Wilson, Ellen K; Peele, John E

2014-03-01

The Office of Adolescent Health (OAH) sought to create a comprehensive set of performance measures to capture the performance of the Teen Pregnancy Prevention (TPP) program. This performance measurement system needed to provide measures that could be used internally (by both OAH and the TPP grantees) for management and program improvement as well as externally to communicate the program's progress to other interested stakeholders and Congress. This article describes the selected measures and outlines the considerations behind the TPP measurement development process. Issues faced, challenges encountered, and lessons learned have broad applicability for other federal agencies and, specifically, for TPP programs interested in assessing their own performance and progress. Published by Elsevier Inc.

Performance assessments of Android-powered military applications operating on tactical handheld devices

NASA Astrophysics Data System (ADS)

Weiss, Brian A.; Fronczek, Lisa; Morse, Emile; Kootbally, Zeid; Schlenoff, Craig

2013-05-01

Transformative Apps (TransApps) is a Defense Advanced Research Projects Agency (DARPA) funded program whose goal is to develop a range of militarily-relevant software applications ("apps") to enhance the operational-effectiveness of military personnel on (and off) the battlefield. TransApps is also developing a military apps marketplace to facilitate rapid development and dissemination of applications to address user needs by connecting engaged communities of endusers with development groups. The National Institute of Standards and Technology's (NIST) role in the TransApps program is to design and implement evaluation procedures to assess the performance of: 1) the various software applications, 2) software-hardware interactions, and 3) the supporting online application marketplace. Specifically, NIST is responsible for evaluating 50+ tactically-relevant applications operating on numerous Android™-powered platforms. NIST efforts include functional regression testing and quantitative performance testing. This paper discusses the evaluation methodologies employed to assess the performance of three key program elements: 1) handheld-based applications and their integration with various hardware platforms, 2) client-based applications and 3) network technologies operating on both the handheld and client systems along with their integration into the application marketplace. Handheld-based applications are assessed using a combination of utility and usability-based checklists and quantitative performance tests. Client-based applications are assessed to replicate current overseas disconnected (i.e. no network connectivity between handhelds) operations and to assess connected operations envisioned for later use. Finally, networked applications are assessed on handhelds to establish baselines of performance for when connectivity will be common usage.

The Integrated Performance Assessment (IPA): Connecting Assessment to Instruction and Learning

ERIC Educational Resources Information Center

Adair-Hauck, Bonnie; Glisan, Eileen W.; Koda, Keiko; Swender, Elvira B.; Sandrock, Paul

2006-01-01

This article reports on "Beyond the OPI: Integrated Performance Assessment (IPA) Design Project," a three-year (1997-2000) research initiative sponsored by the U.S. Department of Education International Research and Studies Program. The primary goal of the project was to develop an integrated skills assessment prototype that would measure…

Preliminary Performance Analyses of the Constellation Program ARES 1 Crew Launch Vehicle

NASA Technical Reports Server (NTRS)

Phillips, Mark; Hanson, John; Shmitt, Terri; Dukemand, Greg; Hays, Jim; Hill, Ashley; Garcia, Jessica

2007-01-01

By the time NASA's Exploration Systems Architecture Study (ESAS) report had been released to the public in December 2005, engineers at NASA's Marshall Space Flight Center had already initiated the first of a series of detailed design analysis cycles (DACs) for the Constellation Program Crew Launch Vehicle (CLV), which has been given the name Ares I. As a major component of the Constellation Architecture, the CLV's initial role will be to deliver crew and cargo aboard the newly conceived Crew Exploration Vehicle (CEV) to a staging orbit for eventual rendezvous with the International Space Station (ISS). However, the long-term goal and design focus of the CLV will be to provide launch services for a crewed CEV in support of lunar exploration missions. Key to the success of the CLV design effort and an integral part of each DAC is a detailed performance analysis tailored to assess nominal and dispersed performance of the vehicle, to determine performance sensitivities, and to generate design-driving dispersed trajectories. Results of these analyses provide valuable design information to the program for the current design as well as provide feedback to engineers on how to adjust the current design in order to maintain program goals. This paper presents a condensed subset of the CLV performance analyses performed during the CLV DAC-1 cycle. Deterministic studies include development of the CLV DAC-1 reference trajectories, identification of vehicle stage impact footprints, an assessment of launch window impacts to payload performance, and the computation of select CLV payload partials. Dispersion studies include definition of input uncertainties, Monte Carlo analysis of trajectory performance parameters based on input dispersions, assessment of CLV flight performance reserve (FPR), assessment of orbital insertion accuracy, and an assessment of bending load indicators due to dispersions in vehicle angle of attack and side slip angle. A short discussion of the various customers for the dispersion results, along with results and ramifications of each study, are also provided.

Introducing a design exigency to promote student learning through assessment: A case study.

PubMed

Grealish, Laurie A; Shaw, Julie M

2018-02-01

Assessment technologies are often used to classify student and newly qualified nurse performance as 'pass' or 'fail', with little attention to how these decisions are achieved. Examining the design exigencies of classification technologies, such as performance assessment technologies, provides opportunities to explore flexibility and change in the process of using those technologies. Evaluate an established assessment technology for nursing performance as a classification system. A case study analysis that is focused on the assessment approach and a priori design exigencies of performance assessment technology, in this case the Australian Nursing Standards Assessment Tool 2016. Nurse assessors are required to draw upon their expertise to judge performance, but that judgement is described as a source of bias, creating confusion. The definition of satisfactory performance is 'ready to enter practice'. To pass, the performance on each criterion must be at least satisfactory, indicating to the student that no further improvement is required. The Australian Nursing Standards Assessment Tool 2016 does not have a third 'other' category, which is usually found in classification systems. Introducing a 'not yet competent' category and creating a two-part, mixed methods assessment process can improve the Australian Nursing Standards Assessment Tool 2016 assessment technology. Using a standards approach in the first part, judgement is valued and can generate learning opportunities across a program. Using a measurement approach in the second part, student performance can be 'not yet competent' but still meet criteria for year level performance and a graded pass. Subjecting the Australian Nursing Standards Assessment Tool 2016 assessment technology to analysis as a classification system provides opportunities for innovation in design. This design innovation has the potential to support students who move between programs and clinicians who assess students from different universities. Copyright © 2017 Elsevier Ltd. All rights reserved.

National Weatherization Assistance Program Evaluation: Assessment of Refrigerator Energy Use

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tonn, Bruce Edward; Goeltz, Rick

2015-03-01

This report assesses the energy consumption characteristics and performance of refrigerators that were monintored as a component of the Indoor Air Quality Study that itself was a component of the retrospective evaluation of the Department of Energy's Weatherization Assistance Program.

Education Reforms and Innovations to Improve Student Assessment Performance

ERIC Educational Resources Information Center

McAfee, Wade J.

2014-01-01

International assessments such as the Trends in International Mathematics and Science Study (TIMSS) and Program for International Student Assessment (PISA) have exhibited United States students specifically in the fourth and eighth grades, are not performing well when compared to their international peers. Educational stakeholders including…

External Quality Assurance Programs Managed by the U.S. Geological Survey in Support of the National Atmospheric Deposition Program/Mercury Deposition Network

USGS Publications Warehouse

Latysh, Natalie E.; Wetherbee, Gregory A.

2007-01-01

The U.S. Geological Survey (USGS) Branch of Quality Systems operates external quality assurance programs for the National Atmospheric Deposition Program/Mercury Deposition Network (NADP/MDN). Beginning in 2004, three programs have been implemented: the system blank program, the interlaboratory comparison program, and the blind audit program. Each program was designed to measure error contributed by specific components in the data-collection process. The system blank program assesses contamination that may result from sampling equipment, field exposure, and routine handling and processing of the wet-deposition samples. The interlaboratory comparison program evaluates bias and precision of analytical results produced by the Mercury Analytical Laboratory (HAL) for the NADP/MDN, operated by Frontier GeoSciences, Inc. The HAL's performance is compared with the performance of five other laboratories. The blind audit program assesses bias and variability of MDN data produced by the HAL using solutions disguised as environmental samples to ascertain true laboratory performance. This report documents the implementation of quality assurance procedures for the NADP/MDN and the operating procedures for each of the external quality assurance programs conducted by the USGS. The USGS quality assurance information provides a measure of confidence to NADP/MDN data users that measurement variability is distinguished from environmental signals.

Longitudinal Analysis of Student Performance in a Dental Hygiene Distance Education Program.

ERIC Educational Resources Information Center

Olmsted, Jodi L.

2002-01-01

Examined over the course of five years whether learners who receive face-to-face instruction in a dental hygiene program performed statistically better on established benchmark assessments than learners at a distance. Found no significant differences. (EV)

A Three-Year Reflective Writing Program as Part of Introductory Pharmacy Practice Experiences

PubMed Central

Vaughn, Jessica; Kerr, Kevin; Zielenski, Christopher; Toppel, Brianna; Johnson, Lauren; McCauley, Patrina; Turner, Christopher J.

2013-01-01

Objectives. To implement and evaluate a 3-year reflective writing program incorporated into introductory pharmacy practice experiences (IPPEs) in the first- through third-year of a doctor of pharmacy (PharmD) program. Design. Reflective writing was integrated into 6 IPPE courses to develop students’ lifelong learning skills. In their writing, students were required to self-assess their performance in patient care activities, identify and describe how they would incorporate learning opportunities, and then evaluate their progress. Practitioners, faculty members, and fourth-year PharmD students served as writing preceptors. Assessment. The success of the writing program was assessed by reviewing class performance and surveying writing preceptor’s opinions regarding the student’s achievement of program objectives. Class pass rates averaged greater than 99% over the 8 years of the program and the large majority of the writing preceptors reported that student learning objectives were met. A support pool of 99 writing preceptors was created. Conclusions. A 3-year reflective writing program improved pharmacy students’ reflection and reflective writing skills. PMID:23788811

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

NASA Technical Reports Server (NTRS)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

NASA Astrophysics Data System (ADS)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-09-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

The Defense Life Cycle Management System as a Working Model for Academic Application

ERIC Educational Resources Information Center

Burian, Philip E.; Keffel, Leslie M.; Maffei, Francis R., III

2011-01-01

Performing the review and assessment of masters' level degree programs can be an overwhelming and challenging endeavor. Getting organized and mapping out the entire review and assessment process can be extremely helpful and more importantly provide a path for successfully accomplishing the review and assessment of the entire program. This paper…

Using an Assessment of Learning System to Integrate Core Content across the Curriculum

ERIC Educational Resources Information Center

Rosales, Jean; Sarbaum, Jeff; Sheran, Michelle; Allen, Stuart

2013-01-01

College and university programs are under increasing pressure to effectively measure and assess student performance, knowledge, and skills in their classes, majors and programs. We discuss how embracing this assessment charge can lead to a more cohesive and educational curriculum in which students and educators alike see the connections from one…

A Continuity Principle for Calibration of Scores within Mastery Assessment Systems.

ERIC Educational Resources Information Center

Tucker, Ledyard R.

A continuity principle is suggested for scaling of assessment scores from different levels of a multilevel mastery training program. In such training programs students are self-paced and work at levels of tasks appropriate for their levels of performance. The problem addressed in this report concerns the scaling of assessment scores at different…

Utilizing global data to estimate analytical performance on the Sigma scale: A global comparative analysis of methods, instruments, and manufacturers through external quality assurance and proficiency testing programs.

PubMed

Westgard, Sten A

2016-06-01

To assess the analytical performance of instruments and methods through external quality assessment and proficiency testing data on the Sigma scale. A representative report from five different EQA/PT programs around the world (2 US, 1 Canadian, 1 UK, and 1 Australasian) was accessed. The instrument group standard deviations were used as surrogate estimates of instrument imprecision. Performance specifications from the US CLIA proficiency testing criteria were used to establish a common quality goal. Then Sigma-metrics were calculated to grade the analytical performance. Different methods have different Sigma-metrics for each analyte reviewed. Summary Sigma-metrics estimate the percentage of the chemistry analytes that are expected to perform above Five Sigma, which is where optimized QC design can be implemented. The range of performance varies from 37% to 88%, exhibiting significant differentiation between instruments and manufacturers. Median Sigmas for the different manufacturers in three analytes (albumin, glucose, sodium) showed significant differentiation. Chemistry tests are not commodities. Quality varies significantly from manufacturer to manufacturer, instrument to instrument, and method to method. The Sigma-assessments from multiple EQA/PT programs provide more insight into the performance of methods and instruments than any single program by itself. It is possible to produce a ranking of performance by manufacturer, instrument and individual method. Laboratories seeking optimal instrumentation would do well to consult this data as part of their decision-making process. To confirm that these assessments are stable and reliable, a longer term study should be conducted that examines more results over a longer time period. Copyright © 2016 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

A Conceptual Methodology for Assessing Acquisition Requirements Robustness against Technology Uncertainties

NASA Astrophysics Data System (ADS)

Chou, Shuo-Ju

2011-12-01

In recent years the United States has shifted from a threat-based acquisition policy that developed systems for countering specific threats to a capabilities-based strategy that emphasizes the acquisition of systems that provide critical national defense capabilities. This shift in policy, in theory, allows for the creation of an "optimal force" that is robust against current and future threats regardless of the tactics and scenario involved. In broad terms, robustness can be defined as the insensitivity of an outcome to "noise" or non-controlled variables. Within this context, the outcome is the successful achievement of defense strategies and the noise variables are tactics and scenarios that will be associated with current and future enemies. Unfortunately, a lack of system capability, budget, and schedule robustness against technology performance and development uncertainties has led to major setbacks in recent acquisition programs. This lack of robustness stems from the fact that immature technologies have uncertainties in their expected performance, development cost, and schedule that cause to variations in system effectiveness and program development budget and schedule requirements. Unfortunately, the Technology Readiness Assessment process currently used by acquisition program managers and decision-makers to measure technology uncertainty during critical program decision junctions does not adequately capture the impact of technology performance and development uncertainty on program capability and development metrics. The Technology Readiness Level metric employed by the TRA to describe program technology elements uncertainties can only provide a qualitative and non-descript estimation of the technology uncertainties. In order to assess program robustness, specifically requirements robustness, against technology performance and development uncertainties, a new process is needed. This process should provide acquisition program managers and decision-makers with the ability to assess or measure the robustness of program requirements against such uncertainties. A literature review of techniques for forecasting technology performance and development uncertainties and subsequent impacts on capability, budget, and schedule requirements resulted in the conclusion that an analysis process that coupled a probabilistic analysis technique such as Monte Carlo Simulations with quantitative and parametric models of technology performance impact and technology development time and cost requirements would allow the probabilities of meeting specific constraints of these requirements to be established. These probabilities of requirements success metrics can then be used as a quantitative and probabilistic measure of program requirements robustness against technology uncertainties. Combined with a Multi-Objective Genetic Algorithm optimization process and computer-based Decision Support System, critical information regarding requirements robustness against technology uncertainties can be captured and quantified for acquisition decision-makers. This results in a more informed and justifiable selection of program technologies during initial program definition as well as formulation of program development and risk management strategies. To meet the stated research objective, the ENhanced TEchnology Robustness Prediction and RISk Evaluation (ENTERPRISE) methodology was formulated to provide a structured and transparent process for integrating these enabling techniques to provide a probabilistic and quantitative assessment of acquisition program requirements robustness against technology performance and development uncertainties. In order to demonstrate the capabilities of the ENTERPRISE method and test the research Hypotheses, an demonstration application of this method was performed on a notional program for acquiring the Carrier-based Suppression of Enemy Air Defenses (SEAD) using Unmanned Combat Aircraft Systems (UCAS) and their enabling technologies. The results of this implementation provided valuable insights regarding the benefits and inner workings of this methodology as well as its limitations that should be addressed in the future to narrow the gap between current state and the desired state.

Completing EdTPA: TSOL Candidate Performance and Reflection

ERIC Educational Resources Information Center

Micek, Timothy A.

2017-01-01

edTPA is a pre-service assessment process designed to determine if a new teacher is ready for the job. edTPA is part of a national movement towards the use of performance assessments in teacher education. As of 2014, 41 states (a) require a state-approved performance assessment like edTPA for program completion or for state licensure and/or state…

The SERI solar energy storage program

NASA Technical Reports Server (NTRS)

Copeland, R. J.; Wright, J. D.; Wyman, C. E.

1980-01-01

In support of the DOE thermal and chemical energy storage program, the solar energy storage program (SERI) provides research on advanced technologies, systems analyses, and assessments of thermal energy storage for solar applications in support of the Thermal and Chemical Energy Storage Program of the DOE Division of Energy Storage Systems. Currently, research is in progress on direct contact latent heat storage and thermochemical energy storage and transport. Systems analyses are being performed of thermal energy storage for solar thermal applications, and surveys and assessments are being prepared of thermal energy storage in solar applications. A ranking methodology for comparing thermal storage systems (performance and cost) is presented. Research in latent heat storage and thermochemical storage and transport is reported.

The Management Aspect of the e-Portfolio as an Assessment Tool: Sample of Anadolu University

ERIC Educational Resources Information Center

Ozgur, Aydin Ziya; Kaya, Secil

2011-01-01

This article intends to introduce an e-portfolio system to help mentors assess the teacher candidates' performances and products in a large scale open and distance learning teacher training program. The Pre-School Teacher Training Program (PSTTP) of Anadolu University is a completely distance program that helps around 12.000 students get the…

Additional Support for the Information Systems Analyst Exam as a Valid Program Assessment Tool

ERIC Educational Resources Information Center

Carpenter, Donald A.; Snyder, Johnny; Slauson, Gayla Jo; Bridge, Morgan K.

2011-01-01

This paper presents a statistical analysis to support the notion that the Information Systems Analyst (ISA) exam can be used as a program assessment tool in addition to measuring student performance. It compares ISA exam scores earned by students in one particular Computer Information Systems program with scores earned by the same students on the…

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

PubMed

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Making the Grade in America's Cities: Assessing Student Achievement in Urban Districts

ERIC Educational Resources Information Center

Blagg, Kristin

2016-01-01

Many US education reform efforts focus on student performance in large, urban school districts. The National Assessment of Educational Progress's Trial Urban District Assessment (TUDA) program provides data on student achievement in these districts, but differences in student characteristics complicate comparisons of district performance. I use…

34 CFR 668.10 - Direct assessment programs.

Code of Federal Regulations, 2011 CFR

2011-07-01

... of direct measures include projects, papers, examinations, presentations, performances, and... academic year in a direct assessment program is a period of instructional time that consists of a minimum...), or (c), as applicable, using the academic year determined in accordance with paragraph (a)(3)(i) of...

Evaluating the Effect of Learning Style and Student Background on Self-Assessment Accuracy

ERIC Educational Resources Information Center

Alaoutinen, Satu

2012-01-01

This study evaluates a new taxonomy-based self-assessment scale and examines factors that affect assessment accuracy and course performance. The scale is based on Bloom's Revised Taxonomy and is evaluated by comparing students' self-assessment results with course performance in a programming course. Correlation has been used to reveal possible…

The California Teaching Performance Assessment Task for Assessing Student Learning: What Do Teacher Education Candidates Really Learn?

ERIC Educational Resources Information Center

Verdi, Michael P.; Riggs, Matt L.; Riggs, Iris M.

2012-01-01

A group of 87 teacher certification candidates in a program at a large university in Southern California took the California Teaching Performance Assessment task for assessing learners in 2004-2005. These candidates' tests were analyzed with qualitative research methods and their scores calculated with quantitative methods. Subsequently, three…

Assessment of Proficiency and Competency in Laboratory Animal Biomethodologies

PubMed Central

Clifford, Paula; Melfi, Natasha; Bogdanske, John; Johnson, Elizabeth J; Kehler, James; Baran, Szczepan W

2013-01-01

Personnel working with laboratory animals are required by laws and guidelines to be trained and qualified to perform biomethodologic procedures. The assessment of competency and proficiency is a vital component of a laboratory animal training program, because this process confirms that the trainees have met the learning objectives for a particular procedure. The approach toward qualification assessment differs between organizations because laws and guidelines do not outline how the assessment should be performed or which methods and tools should be used. Assessment of clinical and surgical medicine has received considerable attention over the last few decades and has progressed from simple subjective methods to well-defined and objective methods of assessing competency. Although biomethodology competency and proficiency assessment is discussed in the literature, a standard and objective assessment method has not yet been developed. The development and implementation of an objective and standardized biomethodologic assessment program can serve as a tool to improve standards, ensure consistent training, and decrease research variables yet ensure animal welfare. Here we review the definition and goals of training and assessment, review assessment methods, and propose a method to develop a standard and objective assessment program for the laboratory animal science field, particularly training departments and IACUC. PMID:24351758

Telemedicine spirometry training and quality assurance program in primary care centers of a public health system.

PubMed

Marina Malanda, Nuria; López de Santa María, Elena; Gutiérrez, Asunción; Bayón, Juan Carlos; Garcia, Larraitz; Gáldiz, Juan B

2014-04-01

Forced spirometry is essential for diagnosing respiratory diseases and is widely used across levels of care. However, several studies have shown that spirometry quality in primary care is not ideal, with risks of misdiagnosis. Our objective was to assess the feasibility and performance of a telemedicine-based training and quality assurance program for forced spirometry in primary care. The two phases included (1) a 9-month pilot study involving 15 centers, in which spirometry tests were assessed by the Basque Office for Health Technology Assessment, and (2) the introduction of the program to all centers in the Public Basque Health Service. Technicians first received 4 h of training, and, subsequently, they sent all tests to the reference laboratory using the program. Quality assessment was performed in accordance with clinical guidelines (A and B, good; C-F, poor). In the first phase, 1,894 spirometry tests were assessed, showing an improvement in quality: acceptable quality tests increased from 57% at the beginning to 78% after 6 months and 83% after 9 months (p<0.001). In the second phase, 7,200 spirometry tests were assessed after the inclusion of 36 additional centers, maintaining the positive trend (61%, 87%, and 84% at the same time points; p<0.001). (1) The quality of spirometry tests improved in all centers. (2) The program provides a tool for transferring data that allows monitoring of its quality and training of technicians who perform the tests. (3) This approach is useful for improving spirometry quality in the routine practice of a public health system.

The role of the case manager in a disease management program.

PubMed

Huston, Carol J

2002-01-01

Disease management programs provide new opportunities and roles for case managers to provide population-based healthcare to the chronically ill. This article identifies common components of disease management programs and examines roles assumed by case managers in disease management programs such as baseline assessment, performing economic analyses of diseases and their respective associated resource utilization, developing and/or implementing care guidelines or algorithms, educational interventions, disease management program implementation, and outcomes assessment. Areas of expertise needed to be an effective case manager in a disease management program are also identified.

The role of the case manager in a disease management program.

PubMed

Huston, C J

2001-01-01

Disease management programs provide new opportunities and roles for case managers to provide population-based healthcare to the chronically ill. This article identifies common components of disease management programs and examines roles assumed by case managers in disease management programs such as baseline assessment, performing economic analyses of diseases and their respective associated resource utilization, developing and/or implementing care guidelines or algorithms, educational interventions, disease management program implementation, and outcomes assessment. Areas of expertise needed to be an effective case manager in a disease management program are also identified.

Learning clinical communication skills: outcomes of a program for professional practitioners.

PubMed

Carvalho, Irene P; Pais, Vanessa G; Almeida, Susana S; Ribeiro-Silva, Raquel; Figueiredo-Braga, Margarida; Teles, Ana; Castro-Vale, Ivone; Mota-Cardoso, Rui

2011-07-01

To assess the effects of a communication skills program on professional practitioners' performance and self-confidence in clinical interviewing. Twenty-five health professionals took 3 months of basic communication skills followed by 3 months of advanced communication skills. An additional quarter dealt with self-awareness and communication in special situations. Participants' performances were evaluated in clinical interviews with standardized patients before, during and after the program by external observers and standardized patients, using standardized instruments. Participants assessed their own confidence in their communication skills before and after the program. Data were analysed using GLM repeated-measures procedures in SPSS. Basic communication skills and self-confidence improved throughout the 6 months; competencies declined but self-confidence continued to increase 4 months later. Compared with taking no course, differences were statistically significant after the 6 months (external observers only) and 4 months later (external observers and participants). The program effectively improved communication skills, although significantly only when assessed by external observers. Four months later, effects were significant in communication skills (external observers), despite the decline and in self-confidence. While periodical enrollment in programs for the practice of communication skills may help maintain performance, more knowledge on communication and self-awareness may enhance self-confidence. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Lack of grading agreement among international hemostasis external quality assessment programs

PubMed Central

Olson, John D.; Jennings, Ian; Meijer, Piet; Bon, Chantal; Bonar, Roslyn; Favaloro, Emmanuel J.; Higgins, Russell A.; Keeney, Michael; Mammen, Joy; Marlar, Richard A.; Meley, Roland; Nair, Sukesh C.; Nichols, William L.; Raby, Anne; Reverter, Joan C.; Srivastava, Alok; Walker, Isobel

2018-01-01

Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of ‘pass’ or ‘fail’ is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance. PMID:29232255

45 CFR 305.60 - Types and scope of Federal audits.

Code of Federal Regulations, 2011 CFR

2011-10-01

... self-assessments, or that those deficiencies are determined to seriously impact the performance of the... (CHILD SUPPORT ENFORCEMENT PROGRAM), ADMINISTRATION FOR CHILDREN AND FAMILIES, DEPARTMENT OF HEALTH AND... assessments of: (1) Whether funds to carry out the State program are being appropriately expended, and are...

45 CFR 305.60 - Types and scope of Federal audits.

Code of Federal Regulations, 2014 CFR

2014-10-01

... self-assessments, or that those deficiencies are determined to seriously impact the performance of the... (CHILD SUPPORT ENFORCEMENT PROGRAM), ADMINISTRATION FOR CHILDREN AND FAMILIES, DEPARTMENT OF HEALTH AND... assessments of: (1) Whether funds to carry out the State program are being appropriately expended, and are...

45 CFR 305.60 - Types and scope of Federal audits.

Code of Federal Regulations, 2013 CFR

2013-10-01

... self-assessments, or that those deficiencies are determined to seriously impact the performance of the... (CHILD SUPPORT ENFORCEMENT PROGRAM), ADMINISTRATION FOR CHILDREN AND FAMILIES, DEPARTMENT OF HEALTH AND... assessments of: (1) Whether funds to carry out the State program are being appropriately expended, and are...

76 FR 39394 - Notice of Proposed Information Collection Requests

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-06

... within the U.S. Department of Education (ED) has contracted with Decision Information Resources, Inc. and Mathematica Policy Research, Inc. to assess the procedures for collecting and reporting program performance and evaluation data for eleven ED grant programs. These audits and assessments will provide ED with...

Comprehensive Monitoring Program: Air Quality Data Assessment Report for FY90. Volume 2. Version 3.1

DTIC Science & Technology

1991-09-01

91311R01 If VERSION 3.10) VOLUME II Comm 2ND COPY COMPREHENSIVE MONITORING PROGRAM Contract Number DAAAI5-87-0095 AIR QUALITY DATA ASSESSMENT REPORT...MONITORING PROGRAM. FINAL AIR QUALITY DATA ASSESSMENT REPORT FOR FY90, VERSION 3.1 NONE 6. AUTHOR(S) 7. PERFORMING ORGANIZATION NAME(S) AND ADDRES.S(S) 8...RELEASE; DISTRIBUTION IS UNLIMITED 13. ABSTRACT (Maximum 200 words) THE OBJECTIVE OF THIS CMP IS TO: VERIFY AND EVALUATE POTENTIAL AIR QUALITY HEALTH

77 FR 15737 - Proposed Information Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-16

... ensure that requested data can be provided in the desired format, reporting burden (time and financial... concerning its National Performance Measurement Assessment through a proposed survey and follow up interview..., implement and report program performance using pilot measures developed for programs receiving AmeriCorps...

National Water Program End of the Year Performance Reports and Best Practices

EPA Pesticide Factsheets

Each year, EPA's Office of Water conducts an assessment of the end of the year results for all performance measures of the National Water Program to determine progress in meeting the goals outlined in the Agency's Strategic Plan and NWPG.

75 FR 6187 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-08

.... Title: Mathematics and Science Partnerships Grant Programs Annual Performance Report. Frequency... Mathematics and Science Partnerships Grant program. Submission of the annual performance report (APR) via the... assessments of mathematics or science; (3) the percentage of students in classrooms of MSP teachers who score...

Evaluation of the Military Functional Assessment Program: Preliminary Assessment of the Construct Validity Using an Archived Database of Clinical Data.

PubMed

Kelley, Amanda M; Ranes, Bethany M; Estrada, Art; Grandizio, Catherine M

2015-01-01

Several important factors must be considered when deciding to return a soldier to duty after a traumatic brain injury (TBI). Premature return increases risk for not only second-impact syndrome during the acute phase but also permanent changes from repetitive concussions. Thus, there is a critical need for return-to-duty (RTD) assessment criteria that encompass the spectrum of injury and disease experienced by US soldiers, particularly TBI. To provide evidence-based standards to eventually serve as criteria for operational competence and performance of a soldier after injury. Specifically, the relationships between clinical assessments and novel military-specific tasks were evaluated. Exploratory analyses (including nonparametric tests and Spearman rank correlations) of an archived database. A total of 79 patients with TBI who participated in an RTD assessment program at a US Army rehabilitation and recovery center. Military Functional Assessment Program (to determine a soldier's operational competence and performance after TBI) tasks; Dizziness Handicap Inventory; Dynamic Visual Acuity (vestibular function); Sensory Organization Test (postural control); Repeatable Battery for the Assessment of Neuropsychological Status (neuropsychological screening test); Beck Depression Inventory-II; Beck Anxiety Inventory; Comprehensive Trail Making Test (visual search and sequencing); posttraumatic stress disorder checklist military version; Alcohol Use Disorders Identification Test; Epworth Sleepiness Scale; Patient Health Questionnaire; and Military Acute Concussion Evaluation. Selected military operational assessment tasks correlated significantly with clinical measures of vestibular function, psychological well-being, and cognitive function. Differences on occupational therapy assessments, a concussion screening tool, and a self-report health questionnaire were seen between those who passed and those who failed the RTD assessment. Specifically, those who passed the RTD assessment scored more favorably on these clinical assessments. This study demonstrated convergent validity between Military Functional Assessment Program tasks and clinical assessment scores. The Military Functional Assessment Program shows promise for augmenting decision making related to RTD and soldier skills. Additional research is needed to determine the effectiveness of this program in predicting RTD success.

Estimating the cost of major ongoing cost plus hardware development programs

NASA Technical Reports Server (NTRS)

Bush, J. C.

1990-01-01

Approaches are developed for forecasting the cost of major hardware development programs while these programs are in the design and development C/D phase. Three approaches are developed: a schedule assessment technique for bottom-line summary cost estimation, a detailed cost estimation approach, and an intermediate cost element analysis procedure. The schedule assessment technique was developed using historical cost/schedule performance data.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barbose, Galen; Wiser, Ryan; Bolinger, Mark

Increasing levels of financial support for customer-sited photovoltaic (PV) systems, provided through publicly-funded incentive programs, has heightened concerns about the long-term performance of these systems. Given the barriers that customers face to ensuring that their PV systems perform well, and the responsibility that PV incentive programs bear to ensure that public funds are prudently spent, these programs should, and often do, play a critical role in ensuring that PV systems receiving incentives perform well. To provide a point of reference for assessing the current state of the art, and to inform program design efforts going forward, we examine the approachesmore » to encouraging PV system performance used by 32 prominent PV incentive programs in the U.S. We identify eight general strategies or groups of related strategies that these programs have used to address performance issues, and highlight important differences in the implementation of these strategies among programs.« less

NASA Educational Product Development and Post-Secondary Program Assessment Planning

NASA Technical Reports Server (NTRS)

Salmons, Phyllis A.

1999-01-01

Producing "value-added students" involves proactively addressing how successfully students develop their skills, knowledge, and personal, social, and ethical growth due to their association with a program. NASA programs for higher education can certainly be responsive in aiding the academic community strive for quality in terms of "valueadded" students. By identifying essential characteristics of exemplary assessment practices, the standards developed by accrediting agencies serve as guides for developing quality practices and policies. Such a process is an effective tool for communicating the expectations of the educational components of a program to all concerned with the program and its expected results. When standards are connected to student performance, they provide a very compelling argument for refocusing the definition of quality in higher education. By linking standards and performance, student learning and development becomes the starting point for examining program quality. If the multiple stakeholders - faculty, peers, the professional community, addressed assessment issues, then accreditation can be a link among various constituencies, the parties can better understand the needs of each other and develop the necessary trust needed for understanding and support.

The Comparison of School-Age Children's Performance on Two Motor Assessments: The Test of Gross Motor Development and the Movement Assessment Battery for Children

ERIC Educational Resources Information Center

Logan, Samuel W.; Robinson, Leah E.; Rudisill, Mary E.; Wadsworth, Danielle D.; Morera, Maria

2014-01-01

Background: Competence in the motor domain is associated with positive, health-related outcomes. Physical education teachers often administer assessments into their programs to measure motor competence for a variety of reasons. Recently, researchers have questioned the relatedness of performance on different assessments. Purpose: The purpose of…

20 CFR 641.230 - Must the individual assessment conducted by the SCSEP grantee and the assessment performed by the...

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 3 2010-04-01 2010-04-01 false Must the individual assessment conducted by the SCSEP grantee and the assessment performed by the One-Stop Delivery System be accepted for use by either entity to determine the individual's need for services in the SCSEP and adult programs under title...

Assessing resident performance and training of colonoscopy in a general surgery training program.

PubMed

Hope, William W; Hooks, W Borden; Kilbourne, S Nicole; Adams, Ashley; Kotwall, Cyrus A; Clancy, Thomas V

2013-05-01

Recently, the adequacy of endoscopy training in general surgery residency programs has been questioned. Efforts to improve resident endoscopic training and to judge competency are ongoing but not well studied. We assessed resident performance using two assessment tools in colonoscopy in a general surgery residency program. Prospectively collected data were reviewed from consecutive colonoscopies by a single surgeon: September 2008 to June 2011. Colonoscopies performed without residents were excluded. Data included patient demographics, procedural data, and outcomes. Following the colonoscopy, residents were graded by the attending surgeon using up two different assessment tools. Descriptive statistics were calculated and outcomes were compared. Colonoscopies were performed by residents in 100 patients. Average age was 52 (range, 22-79) years. Females made up 66 % of patients, and 63 % were Caucasian. Postgraduate level (PG-Y) 3 level residents performed 72 % of colonoscopies. The average resident participation was 73 % of the procedure. Biopsies were performed in 35 %; adenomatous polyps were found in 17 % and invasive cancer in 1 %. Bowel preparation was deemed good in 76 % of patients. Colonoscopy was completed in 90 % of patients. Reasons for incomplete exam were technical (7 patients), inability to pass a stricture (2 patients), and poor prep (1 patient). For completed full colonoscopies, the average time to reach the cecum was 22 min, and withdrawal time was 13 min. Resident assessments were made in 89 of the colonoscopies using 2 separate assessment tools. There were no mortalities; the morbidity rate was 3 %. Morbidities included a perforation related to a biopsy requiring surgery and partial colectomy, a postpolypectomy bleed requiring repeat colonoscopy with clipping of the bleeding vessel, and a patient with transient bradycardia requiring atropine during the procedure. Using objective assessment tools, overall resident skill and knowledge in performing colonoscopy appears to improve based on increasing PG-Y level, although this was not evident with all categories measured. Methods to assess competency continue to evolve and should be the focus of future research.

Six Case-Studies of Performance Assessment.

ERIC Educational Resources Information Center

Mitchell, Ruth; Stempel, Amy

Six cases are studied to give some idea of the range of performance assessments in use in the United States. Contrast and comparison are made possible through the study of the following: (1) the South Brunswick (New Jersey) Public Schools Observational Portfolio for kindergarten through grade 12; (2) the Arizona Student Assessment Program (not yet…

How Do Physicians Assess Their Family Physician Colleagues' Performance? Creating a Rubric to Inform Assessment and Feedback

ERIC Educational Resources Information Center

Sargeant, Joan; MacLeod, Tanya; Sinclair, Douglas; Power, Mary

2011-01-01

Introduction: The Colleges of Physicians and Surgeons of Alberta and Nova Scotia (CPSNS) use a standardized multisource feedback program, the Physician Achievement Review (PAR/NSPAR), to provide physicians with performance assessment data via questionnaires from medical colleagues, coworkers, and patients on 5 practice domains: consultation…

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

Assessment of physician performance in Alberta: the Physician Achievement Review

PubMed Central

Hall, W; Violato, C; Lewkonia, R; Lockyer, J; Fidler, H; Toews, J; Jennett, P; Donoff, M; Moores, D

1999-01-01

The College of Physicians and Surgeons of Alberta, in collaboration with the Universities of Calgary and Alberta, has developed a program to routinely assess the performance of physicians, intended primarily for quality improvement in medical practice. The Physician Achievement Review (PAR) provides a multidimensional view of performance through structured feedback to physicians. The program will also provide a new mechanism for identifying physicians for whom more detailed assessment of practice performance or medical competence may be needed. Questionnaires were created to assess an array of performance attributes, and then appropriate assessors were designated--the physician himself or herself (self-evaluation), patients, medical peers, consultants and referring physicians, and non-physician coworkers. A pilot study with 308 physician volunteers was used to evaluate the psychometric and statistical properties of the questionnaires and to develop operating policies. The pilot surveys showed good statistical validity and technical reliability of the PAR questionnaires. For only 28 (9.1%) of the physicians were the PAR results more than one standard deviation from the peer group means for 3 or more of the 5 major domains of assessment (self, patients, peers, consultants and coworkers). In post-survey feedback, two-thirds of the physicians indicated that they were considering or had implemented changes to their medical practice on the basis of their PAR data. The estimated operating cost of the PAR program is approximately $200 per physician. In February 1999, on the basis of the operating experience and the results of the pilot survey, the College of Physicians and Surgeons of Alberta implemented this innovative program, in which all Alberta physicians will be required to participate every 5 years. PMID:10420867

Organizational learning and continuous quality improvement: examining the impact on nursing home performance.

PubMed

Rondeau, Kent V; Wagar, Terry H

2002-01-01

Interest is growing in learning more about the ability of total quality management and continuous quality improvement (TQM/CQI) initiatives to contribute to the performance of healthcare organizations. A major factor in the successful implementation of TQM/CQI is the seminal contribution of an organization's culture. Many implementation efforts have not succeeded because of a corporate culture that failed to stress broader organizational learning. This may help to explain why some TQM/CQI programs have been unsuccessful in improving healthcare organization performance. Organizational performance variables and organizational learning orientation were assessed in a sample of 181 Canadian long-term care organizations that had implemented a formal TQM/CQI program. Categorical regression analysis shows that, in the absence of a strong corporAte culture that stresses organizational learning and employee development, few performance enhancements are reported. The results of the assessment suggest that a TQM/CQI program without the backing of a strong organizational learning culture may be insufficient to achieve augmented organizational performance.

Advances in public health accreditation readiness and quality improvement: evaluation findings from the National Public Health Improvement Initiative.

PubMed

McLees, Anita W; Thomas, Craig W; Nawaz, Saira; Young, Andrea C; Rider, Nikki; Davis, Mary

2014-01-01

Continuous quality improvement is a central tenet of the Public Health Accreditation Board's (PHAB) national voluntary public health accreditation program. Similarly, the Centers for Disease Control and Prevention launched the National Public Health Improvement Initiative (NPHII) in 2010 with the goal of advancing accreditation readiness, performance management, and quality improvement (QI). Evaluate the extent to which NPHII awardees have achieved program goals. NPHII awardees responded to an annual assessment and program monitoring data requests. Analysis included simple descriptive statistics. Seventy-four state, tribal, local, and territorial public health agencies receiving NPHII funds. NPHII performance improvement managers or principal investigators. Development of accreditation prerequisites, completion of an organizational self-assessment against the PHAB Standards and Measures, Version 1.0, establishment of a performance management system, and implementation of QI initiatives to increase efficiency and effectiveness. Of the 73 responding NPHII awardees, 42.5% had a current health assessment, 26% had a current health improvement plan, and 48% had a current strategic plan in place at the end of the second program year. Approximately 26% of awardees had completed an organizational PHAB self-assessment, 72% had established at least 1 of the 4 components of a performance management system, and 90% had conducted QI activities focused on increasing efficiencies and/or effectiveness. NPHII appears to be supporting awardees' initial achievement of program outcomes. As NPHII enters its third year, there will be additional opportunities to advance the work of NPHII, compile and disseminate results, and inform a vision of high-quality public health necessary to improve the health of the population.

46 CFR 10.407 - Approval of training programs.

Code of Federal Regulations, 2014 CFR

2014-10-01

... programs designed to substitute for or fulfill any or all of the following: (1) A portion of sea service.... Performance objectives are statements, which identify the specific knowledge, skill, or ability the student... made up of three elements: Expected student performance, condition, and criterion. (4) Assessment...

42 CFR 482.96 - Condition of participation: Quality assessment and performance improvement (QAPI).

Code of Federal Regulations, 2013 CFR

2013-10-01

... practices, patient education, patient satisfaction, and patient rights. The transplant center must take... or arrangement. (a) Standard: Components of a QAPI program. The transplant center's QAPI program must use objective measures to evaluate the center's performance with regard to transplantation activities...

42 CFR 482.96 - Condition of participation: Quality assessment and performance improvement (QAPI).

Code of Federal Regulations, 2012 CFR

2012-10-01

... practices, patient education, patient satisfaction, and patient rights. The transplant center must take... or arrangement. (a) Standard: Components of a QAPI program. The transplant center's QAPI program must use objective measures to evaluate the center's performance with regard to transplantation activities...

42 CFR 482.96 - Condition of participation: Quality assessment and performance improvement (QAPI).

Code of Federal Regulations, 2014 CFR

2014-10-01

... practices, patient education, patient satisfaction, and patient rights. The transplant center must take... or arrangement. (a) Standard: Components of a QAPI program. The transplant center's QAPI program must use objective measures to evaluate the center's performance with regard to transplantation activities...

Evaluation of audit-based performance measures for dental care plans.

PubMed

Bader, J D; Shugars, D A; White, B A; Rindal, D B

1999-01-01

Although a set of clinical performance measures, i.e., a report card for dental plans, has been designed for use with administrative data, most plans do not have administrative data systems containing the data needed to calculate the measures. Therefore, we evaluated the use of a set of proxy clinical performance measures calculated from data obtained through chart audits. Chart audits were conducted in seven dental programs--three public health clinics, two dental health maintenance organizations (DHMO), and two preferred provider organizations (PPO). In all instances audits were completed by clinical staff who had been trained using telephone consultation and a self-instructional audit manual. The performance measures were calculated for the seven programs, audit reliability was assessed in four programs, and for one program the audit-based proxy measures were compared to the measures calculated using administrative data. The audit-based measures were sensitive to known differences in program performance. The chart audit procedures yielded reasonably reliable data. However, missing data in patient charts rendered the calculation of some measures problematic--namely, caries and periodontal disease assessment and experience. Agreement between administrative and audit-based measures was good for most, but not all, measures in one program. The audit-based proxy measures represent a complex but feasible approach to the calculation of performance measures for those programs lacking robust administrative data systems. However, until charts contain more complete diagnostic information (i.e., periodontal charting and diagnostic codes or reason-for-treatment codes), accurate determination of these aspects of clinical performance will be difficult.

Fifteen-Year-Old Pupils' Variable Handling Performance in the Context of Scientific Investigations.

ERIC Educational Resources Information Center

Donnelly, J. F.

1987-01-01

Reports findings on variable-handling aspects of pupil performance in investigatory tasks, using data from the British Assessment of Performance Unit (APU) national survey program. Discusses the significance of these findings for assessment methodology and for understanding of 15-year-olds' approaches to the variable-based logic of investigation.…

Barriers to Evaluation

ERIC Educational Resources Information Center

Charley, Lois

2007-01-01

According to the Department of Health and Human Services, "good program evaluations assess programs performance, measure impacts on families and communities, and document program successes." With this information, programs are able to direct limited resources to where they are most needed and most effective in their communities. This article is…

Making the Grade in a Portfolio-Based System: Student Performance and the Student Perspective

PubMed Central

Nowacki, Amy S.

2013-01-01

Assessment is such an integral part of the educational system that we rarely reflect on its value and impact. Portfolios have gained in popularity, but much attention has emphasized the end-user and portfolio assessment. Here we focus on the portfolio creator (the student) and examine whether their educational needs are met with such an assessment method. This study aims to investigate how assessment practices influence classroom performance and the learning experience of the student in a graduate education setting. Studied were 33 medical students at the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, a program utilizing a portfolio-based system. The students may elect to simultaneously enroll in a Masters program; however, these programs employ traditional letter grades. Thus creating a unique opportunity to assess 25 portfolio only (P) students and 8 portfolio and grade (PG) students concurrently taking a course that counts for both programs. Classroom performance was measured via a comprehensive evaluation where the PG students scored modestly better (median total scores, 72% P vs. 76% PG). Additionally, a survey was conducted to gain insight into student’s perspective on how assessment method impacts the learning experience. The students in the PG group (those receiving a grade) reported increased stress but greater affirmation and self-assurance regarding their knowledge and skill mastery. Incorporation of such affirmation remains a challenge for portfolio-based systems and an area for investigation and improvement. PMID:23565103

Making the grade in a portfolio-based system: student performance and the student perspective.

PubMed

Nowacki, Amy S

2013-01-01

Assessment is such an integral part of the educational system that we rarely reflect on its value and impact. Portfolios have gained in popularity, but much attention has emphasized the end-user and portfolio assessment. Here we focus on the portfolio creator (the student) and examine whether their educational needs are met with such an assessment method. This study aims to investigate how assessment practices influence classroom performance and the learning experience of the student in a graduate education setting. Studied were 33 medical students at the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, a program utilizing a portfolio-based system. The students may elect to simultaneously enroll in a Masters program; however, these programs employ traditional letter grades. Thus creating a unique opportunity to assess 25 portfolio only (P) students and 8 portfolio and grade (PG) students concurrently taking a course that counts for both programs. Classroom performance was measured via a comprehensive evaluation where the PG students scored modestly better (median total scores, 72% P vs. 76% PG). Additionally, a survey was conducted to gain insight into student's perspective on how assessment method impacts the learning experience. The students in the PG group (those receiving a grade) reported increased stress but greater affirmation and self-assurance regarding their knowledge and skill mastery. Incorporation of such affirmation remains a challenge for portfolio-based systems and an area for investigation and improvement.

Intensive training program for ultrasound diagnosis of adnexal masses: protocol and preliminary results.

PubMed

Alcázar, J L; Díaz, L; Flórez, P; Guerriero, S; Jurado, M

2013-08-01

To assess the feasibility of a specific training program for ultrasound diagnosis of adnexal masses. A 2-month intensive training program was developed. The program protocol consisted of a 1-day intensive theoretical course focused on clinical and sonographic issues related to adnexal masses and ovarian cancer, followed by a 4-week real-time ultrasound training program in a tertiary center (25-30 adnexal masses evaluated per month) and a final 4-week period for offline assessment of three-dimensional (3D) volumes from adnexal masses. In this final period, each trainee evaluated five sets of 100 3D volumes. 3D volumes contained gray-scale and power Doppler information, and the trainee was provided with clinical data for each case (patient age, menopausal status and reported symptoms). 3D volumes were obtained from surgically removed masses that had undergone histological diagnosis or from masses that had been followed up until resolution. After assessment of each set, the trainee's diagnostic performance was calculated (sensitivity and specificity) and each incorrectly classified mass was evaluated with the trainer. The objective was to achieve a sensitivity of > 95% and a specificity of > 90%. Learning curve cumulative summation (LC-CUSUM) graphs were plotted to assess the learning curve for the trainees. One trainer and two trainees with little experience in gynecological ultrasound (one gynecologist and one radiologist) participated in this study. LC-CUSUM graphs showed that competence was achieved after 170 or 185 examinations. The objectives for diagnostic performance were achieved after assessment of the second set of 3D volumes (200 cases) for each trainee. The proposed training program appears to be feasible. High diagnostic performance can be achieved after analysis of 200 cases and maintained thereafter. Copyright © 2013 ISUOG. Published by John Wiley & Sons Ltd.

Restor(y)ing Teacher Education: A Critical Bifocal Case Study of the Impact of the Teacher Performance Assessment (EDTPA) in New York State on a Teacher Preparation Program in English Education

ERIC Educational Resources Information Center

McKibbin, Kerry Marie

2016-01-01

In this critical bifocal case study, the author examines how the Obama administration's Race to the Top education reform agenda was enacted into policy that gave rise to the Teacher Performance Assessment (edTPA), which was in turn embodied by a single MA English education teacher preparation program in New York State. Drawing on Weis and Fine's…

High Endoatmospheric Defense Interceptor (HEDI) Technology Testing Program Environmental Assessment

DTIC Science & Technology

1989-05-31

FICATION I DOWNGRADING SCHEDULE UNLIMITED 4. PERFORMING ORGANIZATION REPORT NUMBER( S ) S . MONITORING ORGANIZATION REPORT NUMBER( S ) 6a. NAME OF...Technology Testing Program Environmental Asessment (U’. 12. PERSONAL AUTHOR( S ) HEDI Environmental Assessment Team, Mr. Dru Barrineau, Chairman. 13a...was the application of assessment criteria to identify test activities deemed to present no S -1 potential for significant environmental consequences

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barbose, Galen; Wiser, Ryan; Bolinger, Mark

In the U.S., the increasing financial support for customer-sited photovoltaic (PV) systems provided through publicly-funded incentive programs has heightened concerns about the long-term performance of these systems. Given the barriers that customers face to ensuring that their PV systems perform well, and the responsibility that PV incentive programs bear to ensure that public funds are prudently spent, these programs should, and often do, play a critical role in addressing PV system performance. To provide a point of reference for assessing the current state of the art, and to inform program design efforts going forward, we examine the approaches to encouragingmore » PV system performance used by 32 prominent PV incentive programs in the U.S. We identify eight general strategies or groups of related strategies that these programs have used to address factors that affect performance, and describe key implementation details. Based on this review, we then offer recommendations for how PV incentive programs can be effectively designed to mitigate potential performance issues.« less

When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program.

PubMed

Fortington, Lauren V; Donaldson, Alex; Lathlean, Tim; Young, Warren B; Gabbe, Belinda J; Lloyd, David; Finch, Caroline F

2015-05-01

To obtain benefits from sports injury prevention programs, players are instructed to perform the exercises as prescribed. We developed an observational checklist to measure the quality of exercise performance by players participating in FootyFirst, a coach-led, exercise-based, lower-limb injury prevention program in community Australian Football (AF). Observational. The essential performance criteria for each FootyFirst exercise were described in terms of the technique, volume and intensity required to perform each exercise. An observational checklist was developed to evaluate each criterion through direct visual observation of players at training. The checklist was trialled by two independent raters who observed the same 70 players completing the exercises at eight clubs. Agreement between observers was assessed by Kappa-statistics. Exercise fidelity was defined as the proportion of observed players who performed all aspects of their exercises correctly. The raters agreed on 61/70 observations (87%) (Kappa=0.72, 95% CI: 0.55; 0.89). Of the observations with agreed ratings, 41 (67%) players were judged as performing the exercises as prescribed. The observational checklist demonstrated high inter-rater reliability. Many players observed did not perform the exercises as prescribed, raising concern as to whether they would be receiving anticipated program benefits. Where quality of exercise performance is important, evaluation and reporting of program fidelity should include direct observations of participants. Copyright © 2014 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

76 FR 25345 - Annual Assessment of the Status of Competition in the Market for the Delivery of Video Programming

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-04

... as of June 30 of the relevant year to monitor trends on an annual basis. To continue our time-series... video programming? 24. MVPD Performance. We seek comment on the information and time- series data we... Television Performance. We seek information and time- series data for the analysis of various performance...

Evaluation as a critical factor of success in local public health accreditation programs.

PubMed

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Preliminary performance estimates of a highly maneuverable remotely piloted vehicle. [computerized synthesis program to assess effects of vehicle and mission parameters

NASA Technical Reports Server (NTRS)

Nelms, W. P., Jr.; Axelson, J. A.

1974-01-01

A computerized synthesis program has been used to assess the effects of various vehicle and mission parameters on the performance of a highly maneuverable remotely piloted vehicle (RPV) for the air-to-air combat role. The configuration used in the study is a trapezoidal-wing and body concept, with forward-mounted stabilizing and control surfaces. The study mission consists of an outbound cruise, an acceleration phase, a series of subsonic and supersonic turns, and a return cruise. Performance is evaluated in terms of both the required vehicle weight to accomplish this mission and combat effectiveness as measured by turning and acceleration capability. The report describes the synthesis program, the mission, the vehicle, and the results of sensitivity and trade studies.

Metrication report to the Congress

NASA Technical Reports Server (NTRS)

1991-01-01

NASA's principal metrication accomplishments for FY 1990 were establishment of metrication policy for major programs, development of an implementing instruction for overall metric policy and initiation of metrication planning for the major program offices. In FY 1991, development of an overall NASA plan and individual program office plans will be completed, requirement assessments will be performed for all support areas, and detailed assessment and transition planning will be undertaken at the institutional level. Metric feasibility decisions on a number of major programs are expected over the next 18 months.

PEER Transportation Research Program | PEER Transportation Research Program

Science.gov Websites

methodologies, integrating fundamental knowledge, enabling technologies, and systems. We further expect that the Bayesian Framework for Performance Assessment and Risk Management of Transportation Systems subject to Earthquakes Directivity Modeling for NGA West2 Ground Motion Studies for Transportation Systems Performance

COORDINATING, COMMUNICATING AND PERFORMING COMPLEX RESEARCH THAT IDENTIFIES VULNERABLE STREAM ECOSYSTEM IN THE MID-ATLANTIC REGION

EPA Science Inventory

The USEPA's Regional Vulnerability Assessment (ReVA) program was created to advance the scientific basis for protecting vulnerable ecosystems at a regional scale. As a first step, the ReVa program will coordinate, communicate and perform complex research that will identify vulner...

42 CFR 482.21 - Condition of participation: Quality assessment and performance improvement program.

Code of Federal Regulations, 2010 CFR

2010-10-01

... projects, develop and implement an information technology system explicitly designed to improve patient... program that shows measurable improvement in indicators for which there is evidence that it will improve... learning throughout the hospital. (3) The hospital must take actions aimed at performance improvement and...

Performance Assessment of Refractory Concrete Used on the Space Shuttle's Launch Pad

NASA Technical Reports Server (NTRS)

Trejo, David; Calle, Luz Marina; Halman, Ceki

2005-01-01

The John F. Kennedy Space Center (KSC) maintains several facilities for launching space vehicles. During recent launches it has been observed that the refractory concrete materials that protect the steel-framed flame duct are breaking away from this base structure and are being projected at high velocities. There is significant concern that these projected pieces can strike the launch complex or space vehicle during the launch, jeopardizing the safety of the mission. A qualification program is in place to evaluate the performance of different refractory concretes and data from these tests have been used to assess the performance of the refractory concretes. However, there is significant variation in the test results, possibly making the existing qualification test program unreliable. This paper will evaluate data from past qualification tests, identify potential key performance indicators for the launch complex, and will recommend a new qualification test program that can be used to better qualify refractory concrete.

Space station common module power system network topology and hardware development

NASA Technical Reports Server (NTRS)

Landis, D. M.

1985-01-01

Candidate power system newtork topologies for the space station common module are defined and developed and the necessary hardware for test and evaluation is provided. Martin Marietta's approach to performing the proposed program is presented. Performance of the tasks described will assure systematic development and evaluation of program results, and will provide the necessary management tools, visibility, and control techniques for performance assessment. The plan is submitted in accordance with the data requirements given and includes a comprehensive task logic flow diagram, time phased manpower requirements, a program milestone schedule, and detailed descriptions of each program task.

The Relationship between Studying Music and Mathematics Performance on the New Jersey High School Proficiency Assessment

ERIC Educational Resources Information Center

Prokop, Kristie L.

2011-01-01

On assessments such as Trends in International Mathematics and Science Study (TIMSS) (Stigler & Hiebert, 1999) and Program for International Assessment (PISA) ("PISA 2006 Science Competencies for Tomorrow's World", 2007) students in the United States have not been performing as well in mathematics as students in other countries. In…

Performance Assessments in Science: Hands-On Tasks and Scoring Guides.

ERIC Educational Resources Information Center

Stecher, Brian M.; Klein, Stephen P.

In 1992, RAND received a grant from the National Science Foundation to study the technical quality of performance assessments in science and to evaluate their feasibility for use in large-scale testing programs. The specific goals of the project were to assess the reliability and validity of hands-on science testing and to investigate the cost and…

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

Administration and Research of Competency-/Performance-Based Teacher Education Programs.

ERIC Educational Resources Information Center

Trzasko, Joseph A.

This paper describes the proposed Assessment Center at Mercy College in Dobbs Ferry, New York. The center is intended to provide statistical and technical support for the Mercy College elementary education, special education, and speech and hearing departments in the areas of student assessment, student guidance, and program evaluation. Evaluation…

Missouri Assessment Program (MAP), Spring 2000: Elementary Health/Physical Education, Released Items, Grade 5.

ERIC Educational Resources Information Center

Missouri State Dept. of Elementary and Secondary Education, Jefferson City.

This document presents 10 released items from the Health/Physical Education Missouri Assessment Program (MAP) test given in the spring of 2000 to fifth graders. Items from the test sessions include: selected-response (multiple choice), constructed-response, and a performance event. The selected-response items consist of individual questions…

Vehicle misalignment prediction and vehicle/experiment pointing compatibility assessment. [as used in Skylab Program

NASA Technical Reports Server (NTRS)

Hoverkamp, J. D.

1974-01-01

A technique for predicting vehicle misalignment, the relationship of vehicle misalignment to the total vehicle/experiment integration effort, and the methodology used in performing a vehicle/experiment pointing compatibility assessment, are presented. The technique is demonstrated in detail by describing how it was used on the Skylab Program.

Statement of the Independent Review Panel of the National Assessment of Chapter 1.

ERIC Educational Resources Information Center

Department of Education, Washington, DC.

The Independent Review Panel of the National Assessment of Chapter 1 recommends fundamental changes to the program, while endorsing its continuing vital role in meeting the special educational needs of poor and disadvantaged students. The program's focus on low-level basic skills, funding systems that discourage highest-level performance, money…

Feedback data sources that inform physician self-assessment.

PubMed

Lockyer, Jocelyn; Armson, Heather; Chesluk, Benjamin; Dornan, Timothy; Holmboe, Eric; Loney, Elaine; Mann, Karen; Sargeant, Joan

2011-01-01

Self-assessment is a process of interpreting data about one's performance and comparing it to explicit or implicit standards. To examine the external data sources physicians used to monitor themselves. Focus groups were conducted with physicians who participated in three practice improvement activities: a multisource feedback program; a program providing patient and chart audit data; and practice-based learning groups. We used grounded theory strategies to understand the external sources that stimulated self-assessment and how they worked. Data from seven focus groups (49 physicians) were analyzed. Physicians used information from structured programs, other educational activities, professional colleagues, and patients. Data were of varying quality, often from non-formal sources with implicit (not explicit) standards. Mandatory programs elicited variable responses, whereas data and activities the physicians selected themselves were more likely to be accepted. Physicians used the information to create a reference point against which they could weigh their performance using it variably depending on their personal interpretation of its accuracy, application, and utility. Physicians use and interpret data and standards of varying quality to inform self-assessment. Physicians may benefit from regular and routine feedback and guidance on how to seek out data for self-assessment.

Stakeholders' perceptions on competency and assessment program of entry-level pharmacists in developing countries.

PubMed

Asante, Isaac; Andoh, Irene; Muijtjens, Arno M M; Donkers, Jeroen

2017-05-01

To assess the stakeholders' perceptions on the competency of entry-level pharmacists and the use of written licensure examination as the primary assessment for licensure decisions on entry-level pharmacists who have completed the Pharmacy Internship Program 1 (PIP) in developing countries. A cross-sectional survey was conducted among stakeholders in which they completed a web-based 21-item pre-tested questionnaire to determine their views regarding the competency outcomes and assessment program for entry-level pharmacist. The stakeholders rated the entry-level pharmacists to possess all competencies except research skills. Stakeholders suggested improvement of the program by defining the competency framework and training preceptors. However, stakeholders disagree on using written examination as the primary assessment for licensure decision and suggested the incorporation of other performance-based assessments like preceptor's assessment reports. Stakeholders are uncertain on entry-level pharmacists in developing countries possessing adequate research competencies and think their assessment program for licensure need more than written examination to assess all required competencies. Copyright © 2017 Elsevier Inc. All rights reserved.

Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners (Second Edition)

NASA Technical Reports Server (NTRS)

Stamatelatos,Michael; Dezfuli, Homayoon; Apostolakis, George; Everline, Chester; Guarro, Sergio; Mathias, Donovan; Mosleh, Ali; Paulos, Todd; Riha, David; Smith, Curtis;

A concept for performance management for Federal science programs

USGS Publications Warehouse

Whalen, Kevin G.

2017-11-06

The demonstration of clear linkages between planning, funding, outcomes, and performance management has created unique challenges for U.S. Federal science programs. An approach is presented here that characterizes science program strategic objectives by one of five “activity types”: (1) knowledge discovery, (2) knowledge development and delivery, (3) science support, (4) inventory and monitoring, and (5) knowledge synthesis and assessment. The activity types relate to performance measurement tools for tracking outcomes of research funded under the objective. The result is a multi-time scale, integrated performance measure that tracks individual performance metrics synthetically while also measuring progress toward long-term outcomes. Tracking performance on individual metrics provides explicit linkages to root causes of potentially suboptimal performance and captures both internal and external program drivers, such as customer relations and science support for managers. Functionally connecting strategic planning objectives with performance measurement tools is a practical approach for publicly funded science agencies that links planning, outcomes, and performance management—an enterprise that has created unique challenges for public-sector research and development programs.

15 CFR 285.7 - Assessment.

Code of Federal Regulations, 2010 CFR

2010-01-01

... STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL VOLUNTARY... privacy, such as salary, medical information, or performance reviews outside the scope of the...

Validating the Use of pPerformance Risk Indices for System-Level Risk and Maturity Assessments

NASA Astrophysics Data System (ADS)

Holloman, Sherrica S.

With pressure on the U.S. Defense Acquisition System (DAS) to reduce cost overruns and schedule delays, system engineers' performance is only as good as their tools. Recent literature details a need for 1) objective, analytical risk quantification methodologies over traditional subjective qualitative methods -- such as, expert judgment, and 2) mathematically rigorous system-level maturity assessments. The Mahafza, Componation, and Tippett (2005) Technology Performance Risk Index (TPRI) ties the assessment of technical performance to the quantification of risk of unmet performance; however, it is structured for component- level data as input. This study's aim is to establish a modified TPRI with systems-level data as model input, and then validate the modified index with actual system-level data from the Department of Defense's (DoD) Major Defense Acquisition Programs (MDAPs). This work's contribution is the establishment and validation of the System-level Performance Risk Index (SPRI). With the introduction of the SPRI, system-level metrics are better aligned, allowing for better assessment, tradeoff and balance of time, performance and cost constraints. This will allow system engineers and program managers to ultimately make better-informed system-level technical decisions throughout the development phase.

A three-year reflective writing program as part of introductory pharmacy practice experiences.

PubMed

Nuffer, Wesley; Vaughn, Jessica; Kerr, Kevin; Zielenski, Christopher; Toppel, Brianna; Johnson, Lauren; McCauley, Patrina; Turner, Christopher J

2013-06-12

To implement and evaluate a 3-year reflective writing program incorporated into introductory pharmacy practice experiences (IPPEs) in the first- through third-year of a doctor of pharmacy (PharmD) program. Reflective writing was integrated into 6 IPPE courses to develop students' lifelong learning skills. In their writing, students were required to self-assess their performance in patient care activities, identify and describe how they would incorporate learning opportunities, and then evaluate their progress. Practitioners, faculty members, and fourth-year PharmD students served as writing preceptors. The success of the writing program was assessed by reviewing class performance and surveying writing preceptor's opinions regarding the student's achievement of program objectives. Class pass rates averaged greater than 99% over the 8 years of the program and the large majority of the writing preceptors reported that student learning objectives were met. A support pool of 99 writing preceptors was created. A 3-year reflective writing program improved pharmacy students' reflection and reflective writing skills.

Assessing the role of mini-applications in predicting key performance characteristics of scientific and engineering applications

DOE PAGES

Barrett, R. F.; Crozier, P. S.; Doerfler, D. W.; ...

2014-09-28

Computational science and engineering application programs are typically large, complex, and dynamic, and are often constrained by distribution limitations. As a means of making tractable rapid explorations of scientific and engineering application programs in the context of new, emerging, and future computing architectures, a suite of miniapps has been created to serve as proxies for full scale applications. Each miniapp is designed to represent a key performance characteristic that does or is expected to significantly impact the runtime performance of an application program. In this paper we introduce a methodology for assessing the ability of these miniapps to effectively representmore » these performance issues. We applied this methodology to four miniapps, examining the linkage between them and an application they are intended to represent. Herein we evaluate the fidelity of that linkage. This work represents the initial steps required to begin to answer the question, ''Under what conditions does a miniapp represent a key performance characteristic in a full app?''« less

Alabama Industrial Technician Education Cooperative Demonstration Program (I-TEC). Final Performance Report.

ERIC Educational Resources Information Center

John M. Patterson State Technical Coll., Montgomery, AL.

A cooperative demonstration program between industry (General Electric) and education (John Patterson State Technical College, Alabama) designed and conducted a training program and competency assessment for individuals entering high technology positions related to industrial production in Alabama. The program was designed to develop employees as…

A framework for improving the cost-effectiveness of DSM program evaluations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sonnenblick, R.; Eto, J.

The prudence of utility demand-side management (DSM) investments hinges on their performance, yet evaluating performance is complicated because the energy saved by DSM programs can never be observed directly but only inferred. This study frames and begins to answer the following questions: (1) how well do current evaluation methods perform in improving confidence in the measurement of energy savings produced by DSM programs; (2) in view of this performance, how can limited evaluation resources be best allocated to maximize the value of the information they provide? The authors review three major classes of methods for estimating annual energy savings: trackingmore » database (sometimes called engineering estimates), end-use metering, and billing analysis and examine them in light of the uncertainties in current estimates of DSM program measure lifetimes. The authors assess the accuracy and precision of each method and construct trade-off curves to examine the costs of increases in accuracy or precision. Several approaches for improving evaluations for the purpose of assessing program cost effectiveness are demonstrated. The methods can be easily generalized to other evaluation objectives, such as shared savings incentive payments.« less

Individualized Educational Programming for the Mentally Retarded.

ERIC Educational Resources Information Center

Singh, Nirbhay N.; Ahrens, Michael G.

1980-01-01

The minimal components of a model which utilizes a computer for summarizing individual performance records for teaching educational skills to the mentally retarded are described. The most important components are assessment, individual and group programing, continuous data collection, and program evaluation. (Author)

Exercise program for nursing home residents with Alzheimer's disease: a 1-year randomized, controlled trial.

PubMed

Rolland, Yves; Pillard, Fabien; Klapouszczak, Adrian; Reynish, Emma; Thomas, David; Andrieu, Sandrine; Rivière, Daniel; Vellas, Bruno

2007-02-01

To investigate the effectiveness of an exercise program in improving ability to perform activities of daily living (ADLs), physical performance, and nutritional status and decreasing behavioral disturbance and depression in patients with Alzheimer's disease (AD). Randomized, controlled trial. Five nursing homes. One hundred thirty-four ambulatory patients with mild to severe AD. Collective exercise program (1 hour, twice weekly of walk, strength, balance, and flexibility training) or routine medical care for 12 months. ADLs were assessed using the Katz Index of ADLs. Physical performance was evaluated using 6-meter walking speed, the get-up-and-go test, and the one-leg-balance test. Behavioral disturbance, depression, and nutritional status were evaluated using the Neuropsychiatric Inventory, the Montgomery and Asberg Depression Rating Scale, and the Mini-Nutritional Assessment. For each outcome measure, the mean change from baseline to 12 months was calculated using intention-to-treat analysis. ADL mean change from baseline score for exercise program patients showed a slower decline than in patients receiving routine medical care (12-month mean treatment differences: ADL=0.39, P=.02). A significant difference between the groups in favor of the exercise program was observed for 6-meter walking speed at 12 months. No effect was observed for behavioral disturbance, depression, or nutritional assessment scores. In the intervention group, adherence to the program sessions in exploratory analysis predicted change in ability to perform ADLs. No adverse effects of exercise occurred. A simple exercise program, 1 hour twice a week, led to significantly slower decline in ADL score in patients with AD living in a nursing home than routine medical care.

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

Strengthening immunization in a West African country: Mali.

PubMed

Milstien, J B; Tapia, M; Sow, S O; Keita, L; Kotloff, K

2007-11-01

OBJECTIVES AND CONTEXT: This paper describes the preliminary outcomes of a collaborative capacity-building initiative performed in Mali to strengthen the immunization program. We conducted baseline assessments, training and post-training assessments in four programmatic areas: vaccine management, immunization safety, surveillance, and vaccine coverage, using adapted World Health Organization (WHO) tools. Impact assessment was done by evaluation of trainee performance, programmatic impact and sustainability. Qualitative and quantitative improvement of trainee performance was seen after the training interventions: some knowledge improvement, greater compliance with vaccine management practices and improved vaccine coverage. Deficiencies in information transfer to the periphery were identified. The program involves shared responsibility for planning, implementation and financing with national stakeholders while emphasizing the training of leaders and managers to ensure sustainability. Although short-term gains were measured, our initial assessments indicate that sustained impact will require improvements in staffing, financing and guidelines to ensure delivery of information and skills to the periphery.

Chronic effects of strength training vs. Hydro aerobics on functional and cardiorespiratory ability in postmenopausal women.

PubMed

Novaes, Giovanni S; Novaes, Jefferson S; Vilaça-Alves, José; Silva, Gabriel Costa E; Garrido, Nuno D; Furtado, Hélio; Reis, Victor M

2014-09-29

The current study aimed to compare the effects of two exercise programs (Strength Training and Hydro Gymnastics) on the functional and cardiorespiratory abilities of Portuguese postmenopausal women. The study population consisted of 38 volunteers (age: 66.9 ± 6.1 years, body mass: 73.70 ± 10.38 kg, and body height: 1.55 ± 0.10 m). Subjects were randomly divided into two experimental groups and one control group: one group performed 24 weeks of strength training (GST; n = 14), another performed 24 weeks of hydro gymnastics (GH; n = 17) and a control group (CG; n = 7), where the subjects continued with their regular daily activities without involvement in any physical exercise program. Three assessments were performed: before the beginning of the program, 12 weeks after the start of the training program and 24 weeks after the start of the program. To assess the functional ability of the participants, several tests proposed by Jones and Rikli (2002) were performed. To evaluate the cardiorespiratory ability of the participants, a modified treadmill Bruce test was applied. Significant differences (p<0.05) were found between the two training methods in the tests, which primarily demanded muscular strength. Body mass and the body mass index showed significant differences during the three stages of assessment in the GST group (p<0.05). With respect to the values that represent the variables of cardiorespiratory ability, positive and significant changes were observed in the two experimental groups. It was concluded that both exercise programs promoted improvements in some indicators of the functional and cardiorespiratory abilities of Portuguese postmenopausal women.

Quantitative assessments of municipal waste management systems: using different indicators to compare and rank programs in New York State.

PubMed

Greene, Krista L; Tonjes, David J

2014-04-01

The primary objective of waste management technologies and policies in the United States is to reduce the harmful environmental impacts of waste, particularly those relating to energy consumption and climate change. Performance indicators are frequently used to evaluate the environmental quality of municipal waste systems, as well as to compare and rank programs relative to each other in terms of environmental performance. However, there currently is no consensus on the best indicator for performing these environmental evaluations. The purpose of this study is to examine the common performance indicators used to assess the environmental benefits of municipal waste systems to determine if there is agreement between them regarding which system performs best environmentally. Focus is placed on how indicator selection influences comparisons between municipal waste management programs and subsequent system rankings. The waste systems of ten municipalities in the state of New York, USA, were evaluated using each common performance indicator and Spearman correlations were calculated to see if there was a significant association between system rank orderings. Analyses showed that rank orders of waste systems differ substantially when different indicators are used. Therefore, comparative system assessments based on indicators should be considered carefully, especially those intended to gauge environmental quality. Insight was also gained into specific factors which may lead to one system achieving higher rankings than another. However, despite the insufficiencies of indicators for comparative quality assessments, they do provide important information for waste managers and they can assist in evaluating internal programmatic performance and progress. To enhance these types of assessments, a framework for scoring indicators based on criteria that evaluate their utility and value for system evaluations was developed. This framework was used to construct an improved model for waste system performance assessments. Copyright © 2014 Elsevier Ltd. All rights reserved.

Connecting Teacher Preparation to Teacher Induction: Outcomes for Beginning Teachers in a University-Based Support Program in Low-Performing Schools

ERIC Educational Resources Information Center

Bastian, Kevin C.; Marks, Julie T.

2017-01-01

Given concerns with the performance and attrition of novice teachers, North Carolina allocated $7.7 million from Race to the Top to create the New Teacher Support Program (NTSP), an induction model developed and implemented by the state's public university system and targeted at low-performing schools. In this study, we assess the associations…

Web-based application on employee performance assessment using exponential comparison method

NASA Astrophysics Data System (ADS)

Maryana, S.; Kurnia, E.; Ruyani, A.

2017-02-01

Employee performance assessment is also called a performance review, performance evaluation, or assessment of employees, is an effort to assess the achievements of staffing performance with the aim to increase productivity of employees and companies. This application helps in the assessment of employee performance using five criteria: Presence, Quality of Work, Quantity of Work, Discipline, and Teamwork. The system uses the Exponential Comparative Method and Weighting Eckenrode. Calculation results using graphs were provided to see the assessment of each employee. Programming language used in this system is written in Notepad++ and MySQL database. The testing result on the system can be concluded that this application is correspond with the design and running properly. The test conducted is structural test, functional test, and validation, sensitivity analysis, and SUMI testing.

Personality and Graduate Academic Performance among Counselor Education and School Psychology Students

ERIC Educational Resources Information Center

Ding, Yi; Laux, John; Salyers, Kathleen; Kozelka, Susan

2017-01-01

General personality was assessed of 104 graduate students in school counseling, mental health counseling, and school psychology programs in the United States using the Big Five model of personality domains. The students in three programs reported similarities and differences in their preference and performance in domain knowledge, with more…

Model Performance Evaluation and Scenario Analysis (MPESA)

EPA Pesticide Factsheets

Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

PubMed

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

In situ pediatric trauma simulation: assessing the impact and feasibility of an interdisciplinary pediatric in situ trauma care quality improvement simulation program.

PubMed

Auerbach, Marc; Roney, Linda; Aysseh, April; Gawel, Marcie; Koziel, Jeannette; Barre, Kimberly; Caty, Michael G; Santucci, Karen

2014-12-01

This study aimed to evaluate the feasibility and measure the impact of an in situ interdisciplinary pediatric trauma quality improvement simulation program. Twenty-two monthly simulations were conducted in a tertiary care pediatric emergency department with the aim of improving the quality of pediatric trauma (February 2010 to November 2012). Each session included 20 minutes of simulated patient care, followed by 30 minutes of debriefing that focused on teamwork, communication, and the identification of gaps in care. A single rater scored the performance of the team in real time using a validated assessment instrument for 6 subcomponents of care (teamwork, airway, intubation, breathing, circulation, and disability). Participants completed a survey and written feedback forms. A trend analysis of the 22 simulations found statistically significant positive trends for overall performance, teamwork, and intubation subcomponents; the strength of the upward trend was the strongest for the teamwork (τ = 0.512), followed by overall performance (τ = 0.488) and intubation (τ = 0.433). Two hundred fifty-one of 398 participants completed the participant feedback form (response rate, 63%), reporting that debriefing was the most valuable aspect of the simulation. An in situ interdisciplinary pediatric trauma simulation quality improvement program resulted in improved validated trauma simulation assessment scores for overall performance, teamwork, and intubation. Participants reported high levels of satisfaction with the program, and debriefing was reported as the most valuable component of the program.

Industrial Assessment Center Helps Boost Efficiency for Small and Medium Manufacturers

ScienceCinema

Johnson, Mark; Friedman, David

2018-06-12

The Industrial Assessment Center program helps small and medium manufacturers boost efficiency and save energy. It pairs companies with universities as students perform energy assessments and provide recommendations to improve their facilities.

Industrial Assessment Center Helps Boost Efficiency for Small and Medium Manufacturers

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnson, Mark; Friedman, David

The Industrial Assessment Center program helps small and medium manufacturers boost efficiency and save energy. It pairs companies with universities as students perform energy assessments and provide recommendations to improve their facilities.

Data Management for Effective Condition Assessment of Collection Systems

EPA Science Inventory

Condition assessment provides critical information for assessment of an asset’s physical condition, remaining useful service life, and long-term performance. This paper will describe data management issues integral to a successful condition assessment program. Key points will b...

Performance of HIV Prevention of Mother-To-Child Transmission Programs in Sub-Saharan Africa: Longitudinal Assessment of 64 Nevirapine-Based Programs Implemented in 25 Countries, 2000-2011

PubMed Central

Ladner, Joël; Besson, Marie-Hélène; Rodrigues, Mariana; Saba, Joseph; Audureau, Etienne

2015-01-01

Background To evaluate the performance and to identify predictive factors of performance in prevention of mother-to-child HIV transmission programs (PMTCT) in sub-Saharan African countries. Methods From 2000 to 2011, PMTCT programs included in the Viramune Donation Programme (VDP) were prospectively followed. Each institution included in the VDP provided data on program implementation, type of management institution, number of PMTCT sites, key programs outputs (HIV counseling and testing, NVP regimens received by mothers and newborns). Nevirapine Coverage Ratio (NCR), defined as the number of women who should have received nevirapine (observed HIV prevalence x number of women in antenatal care), was used to measure performance. Included programs were followed every six months through progress reports. Results A total of 64 programs in 25 sub-Saharan African countries were included. The mean program follow-up was 48.0 months (SD = 24.5); 20,084,490 women attended in antenatal clinics were included. The overall mean NCR was 0.52 (SD = 0.25), with an increase from 0.37 to 0.57 between the first and last progress reports (p<.0001); NCR increased by 3.26% per year-program. Between the first and the last report, the number of women counseled and tested increased from 64.3% to 86.0% (p<.0001), the number of women post-counseled from 87.5% to 91.3% (p = 0.08). After mixed linear regression analysis, type of responsible institution, number of women attended in ANC, and program initiation in 2005-2006 were significant predictive factors associated with the NCR. The effect of the time period increased from earlier to later periods. Conclusion A longitudinal assessment of large PMTCT programs shows that scaling-up of programs was increased in sub-Saharan African countries. The PMTCT coverage increased throughout the study period, especially after 2006. Performance may be better for programs with a small or medium number of women attended in ANC. Identification of factors that predict PMTCT program performance may help in the development and expansion of additional large PMTCT services in sub-Saharan Africa. PMID:26098311

Longitudinal analysis of student performance in a dental hygiene distance education program.

PubMed

Olmsted, Jodi L

2002-09-01

The purpose of the study was to determine if learners who receive face-to-face instruction in an educational program performed statistically better on established benchmark assessments (GPA, course averages, and NBDHE) than learners at a distance from the didactic course instructor. A comparative, quasi-experimental, ex-post facto study was conducted. The treatment variable was program type: face-to-face vs. distance. The performance of five consecutive classes was analyzed, from 1997 to 2001. These five classes consisted of 221 learners, 105 of them at the host site and 115 using distance learning. The experimental groups were divided based upon location--host or cooperating college (distance) site learners. Study results identified no significant difference between host and distance learner performance for the entire educational program. The use of interactive television (ITV) for delivery of an educational program using distance education technology provided acceptable results in learner didactic performance. Learners at both the host and cooperating college (distance) sites performed equally well. The results were used to document program outcomes.

Data Center Energy Practitioner (DCEP) Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Traber, Kim; Salim, Munther; Sartor, Dale A.

2016-02-02

The main objective for the DCEP program is to raise the standards of those involved in energy assessments of data centers to accelerate energy savings. The program is driven by the fact that significant knowledge, training, and skills are required to perform accurate energy assessments. The program will raise the confidence level in energy assessments in data centers. For those who pass the exam, the program will recognize them as Data Center Energy Practitioners (DCEPs) by issuing a certificate. Hardware req.: PC, MAC; Software Req.: Windows; Related/Auxiliary software--MS Office; Type of files: executable modules, user guide; Documentation: e-user manual; Documentation:more » http://www.1.eere.energy.gov/industry/datacenters/ 12/10/15-New Documentation URL: https://datacenters.lbl.gov/dcep« less

An Empirical Study of a District Wide K-2 Performance Assessment Program: Teacher Practices, Information Gained, and Use of Assessment Results.

ERIC Educational Resources Information Center

Lanting, Ashley

This study used a qualitative research methodology to examine how four primary teachers used a district literacy performance assessment. Data were collected through observations, interviews, and documents. Grounded theory and NUD*IST software were used for text analysis and theory building. Findings show that a theory-grounded teacher-empowered…

A Progressive, Collaborative Process to Improve a Curriculum and Define an Assessment Program.

PubMed

Letassy, Nancy A; Medina, Melissa S; Britton, Mark L; Dennis, Vince; Draugalis, JoLaine R

2015-05-25

To revise the University of Oklahoma College of Pharmacy's professional program outcomes and create an assessment map using results from previous peer review and mapping of all professional courses and curricular streams of knowledge, skills, and attitudes (KSAs). After consolidating 15 original program outcomes into 11 more precise outcome statements, defining KSAs for each, and getting faculty approval of them, the committee detailed measurable program expectations upon graduation for each outcome and created an assessment map identifying where KSAs were taught, how they were to be assessed, and the expected ability level (novice, competent, proficient) for each across the curriculum. The committee's work identified deficits, inconsistencies, and disproportionalities in professional program assessment. It recommended assessments to capture student achievement of each outcome, identified performance levels and criteria to measure outcomes progressively in each professional year, and outlined a process to provide students periodic reports on their progress in achieving each outcome. This work establishes a firm foundation for ongoing efforts to measure effectiveness of the professional program, especially in light of Accreditation Council for Pharmacy Education's (ACPE) revised accreditation standards.

The objective assessment of experts' and novices' suturing skills using an image analysis program.

PubMed

Frischknecht, Adam C; Kasten, Steven J; Hamstra, Stanley J; Perkins, Noel C; Gillespie, R Brent; Armstrong, Thomas J; Minter, Rebecca M

2013-02-01

To objectively assess suturing performance using an image analysis program and to provide validity evidence for this assessment method by comparing experts' and novices' performance. In 2009, the authors used an image analysis program to extract objective variables from digital images of suturing end products obtained during a previous study involving third-year medical students (novices) and surgical faculty and residents (experts). Variables included number of stitches, stitch length, total bite size, travel, stitch orientation, total bite-size-to-travel ratio, and symmetry across the incision ratio. The authors compared all variables between groups to detect significant differences and two variables (total bite-size-to-travel ratio and symmetry across the incision ratio) to ideal values. Five experts and 15 novices participated. Experts' and novices' performances differed significantly (P < .05) with large effect sizes attributable to experience (Cohen d > 0.8) for total bite size (P = .009, d = 1.5), travel (P = .045, d = 1.1), total bite-size-to-travel ratio (P < .0001, d = 2.6), stitch orientation (P = .014,d = 1.4), and symmetry across the incision ratio (P = .022, d = 1.3). The authors found that a simple computer algorithm can extract variables from digital images of a running suture and rapidly provide quantitative summative assessment feedback. The significant differences found between groups confirm that this system can discriminate between skill levels. This image analysis program represents a viable training tool for objectively assessing trainees' suturing, a foundational skill for many medical specialties.

Study Protocol for a Randomized Controlled Trial Evaluating the Efficacy of an Evidence-Based iPad-App for Cognitive Rehabilitation in Patients with Primary Brain Tumors.

PubMed

van der Linden, Sophie Dorothee; Sitskoorn, Margriet Maria; Rutten, Geert-Jan Maria; Gehring, Karin

2018-06-16

Many patients with primary brain tumors suffer from cognitive deficits, which negatively impact their quality of life. However, cognitive rehabilitation programs for these patients are scarce. We developed an iPad-based cognitive rehabilitation program for brain tumor patients, which was based on our effective face-to-face cognitive rehabilitation program. After successful completion of a feasibility study, a randomized controlled trial has been started. To evaluate the immediate and long-term effects of the iPad-based program on cognitive performance and patient-reported outcome measures (PROMs) in patients with primary brain tumors in an early stage of the disease. Prior to surgery, patients with presumed low-grade glioma and meningioma are included. Before surgery and 3 mo after surgery, neuropsychological assessments are conducted. After the second neuropsychological assessment, patients are assigned to the intervention group or waiting-list control group. The intervention consists of psychoeducation, compensation training, and retraining. Patients are advised to spend 3 h per week on the program for 10 wk. Immediately after completion of the program and a half-year thereafter, postintervention assessments take place. Patients in the control group are offered the opportunity to follow the program after all study assessments. We expect that early cognitive rehabilitation has beneficial effects on cognitive performance and PROMs in brain tumor patients. The iPad-based program allows brain tumor patients to follow a cognitive rehabilitation program from their homes. Forthcoming results may contribute to further improvement of supportive care for brain tumor patients.

Assess/Mitigate Risk through the Use of Computer-Aided Software Engineering (CASE) Tools

NASA Technical Reports Server (NTRS)

Aguilar, Michael L.

2013-01-01

The NASA Engineering and Safety Center (NESC) was requested to perform an independent assessment of the mitigation of the Constellation Program (CxP) Risk 4421 through the use of computer-aided software engineering (CASE) tools. With the cancellation of the CxP, the assessment goals were modified to capture lessons learned and best practices in the use of CASE tools. The assessment goal was to prepare the next program for the use of these CASE tools. The outcome of the assessment is contained in this document.

Development and evaluation of an educational intervention program for pre-professional adolescent ballet dancers: nutrition for optimal performance.

PubMed

Doyle-Lucas, Ashley F; Davy, Brenda M

2011-06-01

The purpose of this investigation was to develop, implement, and evaluate a theoretically based nutritional education intervention through a DVD lecture series (three 30-minute classes) in summer intensive programs for pre-professional, adolescent ballet dancers. Objectives of this intervention program were to increase knowledge of basic sports nutrition principles and the Female Athlete Triad and promote self-efficacy for adopting healthier dietary habits. Dancers ranging from 13 to 18 years old who were attending summer intensive programs affiliated with professional ballet companies were recruited. Group One (n = 231) participated in the nutrition education program, while Group Two the control participants (n = 90) did not. Assessments of the participants' dietary status consisted of a demographic questionnaire, a Sports Nutrition Knowledge and Behavior Questionnaire, and a Food Frequency Questionnaire. The intervention group was assessed at baseline, immediately post-program, and at six weeks post-program. The control group was assessed at baseline and at six weeks post-baseline. The intervention program was effective at increasing nutrition knowledge, perceived susceptibility to the Female Athlete Triad, and self-efficacy constructs. Improvements in dietary intake were also observed among intervention group participants. To improve overall health and performance nutrition education should be incorporated into the training regimens of adolescent dancers. This potentially replicable DVD-based program may be an effective, low-cost mechanism for doing that.

Building a Performance-Based Assessment System To Diagnose Strengths and Weaknesses in Reading Achievement.

ERIC Educational Resources Information Center

Hennings, Sara S.; Hughes, Kay E.

This paper provides a brief description of the development of the Diagnostic Assessments of Reading with Trial Teaching Strategies (DARTTS) program by F. G. Roswell and J. S. Chall. It also describes the editorial and statistical procedures that were used to validate the program for determining students' strengths and weaknesses in important areas…

A Case Study of Student Assessment Programs in a College of Business Administration at a Southern HBCU

ERIC Educational Resources Information Center

Bell Haynes, Janel Elizabeth

2013-01-01

The purpose of this mixed method sequential explanatory case study was to describe the relationship of a student outcomes assessment program, as measured by the Peregrine Academic Leveling Course, (ALC), to the academic performance, determined by scores on the Peregrine Common Professional Component (CPC) examination, of students enrolled during…

49 CFR 192.913 - When may an operator deviate its program from certain requirements of this subpart?

Code of Federal Regulations, 2014 CFR

2014-10-01

... comprehensive data integration process; (iv) A procedure for applying lessons learned from assessment of covered... performance matrix that demonstrates the program has been effective in ensuring the integrity of the covered... requirements in § 192.933, and incorporate the results and lessons learned from the more recent assessment into...

49 CFR 192.913 - When may an operator deviate its program from certain requirements of this subpart?

Code of Federal Regulations, 2013 CFR

2013-10-01

... comprehensive data integration process; (iv) A procedure for applying lessons learned from assessment of covered... performance matrix that demonstrates the program has been effective in ensuring the integrity of the covered... requirements in § 192.933, and incorporate the results and lessons learned from the more recent assessment into...

49 CFR 192.913 - When may an operator deviate its program from certain requirements of this subpart?

Code of Federal Regulations, 2012 CFR

2012-10-01

... comprehensive data integration process; (iv) A procedure for applying lessons learned from assessment of covered... performance matrix that demonstrates the program has been effective in ensuring the integrity of the covered... requirements in § 192.933, and incorporate the results and lessons learned from the more recent assessment into...

Missouri Assessment Program (MAP), Spring 2000: High School Health/Physical Education, Released Items, Grade 9.

ERIC Educational Resources Information Center

Missouri State Dept. of Elementary and Secondary Education, Jefferson City.

This document presents 10 released items from the Health/Physical Education Missouri Assessment Program (MAP) test given in the spring of 2000 to ninth graders. Items from the test sessions include: selected-response (multiple choice), constructed-response, and a performance event. The selected-response items consist of individual questions…

Calibration Study of POWER Performance Levels to the CASAS Scale. Research Brief No. 5

ERIC Educational Resources Information Center

Posey, Virginia

2005-01-01

The Adult Education and Family Literacy Act, as part of the Workforce Investment Act of 1998, requires programs to use standardized assessments to report learning gains for students in adult education programs. In addition, local and state agencies need an accountability tool for students who are difficult to assess adequately with a…

Evaluating Educational Programs. ETS R&D Scientific and Policy Contributions Series. ETS SPC-11-01. ETS Research Report No. RR-11-15

ERIC Educational Resources Information Center

Ball, Samuel

2011-01-01

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

76 FR 59069 - Revision to the Section 8 Management Assessment Program Lease-Up Indicator

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-23

...-AC76 Revision to the Section 8 Management Assessment Program Lease-Up Indicator AGENCY: Office of the... process by which HUD measures and verifies performance under the SEMAP lease-up indicator. Specifically... (PHA) leasing indicator will be based on a calendar year cycle, rather than a fiscal year cycle, which...

Critical features of peer assessment of clinical performance to enhance adherence to a low back pain guideline for physical therapists: a mixed methods design.

PubMed

Maas, Marjo J M; van Dulmen, Simone A; Sagasser, Margaretha H; Heerkens, Yvonne F; van der Vleuten, Cees P M; Nijhuis-van der Sanden, Maria W G; van der Wees, Philip J

2015-11-12

Clinical practice guidelines are intended to improve the process and outcomes of patient care. However, their implementation remains a challenge. We designed an implementation strategy, based on peer assessment (PA) focusing on barriers to change in physical therapy care. A previously published randomized controlled trial showed that PA was more effective than the usual strategy "case discussion" in improving adherence to a low back pain guideline. Peer assessment aims to enhance knowledge, communication, and hands-on clinical skills consistent with guideline recommendations. Participants observed and evaluated clinical performance on the spot in a role-play simulating clinical practice. Participants performed three roles: physical therapist, assessor, and patient. This study explored the critical features of the PA program that contributed to improved guideline adherence in the perception of participants. Dutch physical therapists working in primary care (n = 49) organized in communities of practice (n = 6) participated in the PA program. By unpacking the program we identified three main tasks and eleven subtasks. After the program was finished, a questionnaire was administered in which participants were asked to rank the program tasks from high to low learning value and to describe their impact on performance improvement. Overall ranking results were calculated. Additional semi-structured interviews were conducted to elaborate on the questionnaires results and were transcribed verbatim. Questionnaires comments and interview transcripts were analyzed using template analysis. Program tasks related to performance in the therapist role were perceived to have the highest impact on learning, although task perceptions varied from challenging to threatening. Perceptions were affected by the role-play format and the time schedule. Learning outcomes were awareness of performance, improved attitudes towards the guideline, and increased self-efficacy beliefs in managing patients with low back pain. Learning was facilitated by psychological safety and the quality of feedback. The effectiveness of PA can be attributed to the structured and performance-based design of the program. Participants showed a strong cognitive and emotional commitment to performing the physical therapist role. That might have contributed to an increased awareness of strength and weakness in clinical performance and a motivation to change routine practice.

Informatics in radiology: evaluation of an e-learning platform for teaching medical students competency in ordering radiologic examinations.

PubMed

Marshall, Nina L; Spooner, Muirne; Galvin, P Leo; Ti, Joanna P; McElvaney, N Gerald; Lee, Michael J

2011-01-01

A preliminary audit of orders for computed tomography was performed to evaluate the typical performance of interns ordering radiologic examinations. According to the audit, the interns showed only minimal improvement after 8 months of work experience. The online radiology ordering module (ROM) program included baseline assessment of student performance (part I), online learning with the ROM (part II), and follow-up assessment of performance with simulated ordering with the ROM (part III). A curriculum blueprint determined the content of the ROM program, with an emphasis on practical issues, including provision of logistic information, clinical details, and safety-related information. Appropriate standards were developed by a committee of experts, and detailed scoring systems were devised for assessment. The ROM program was successful in addressing practical issues in a simulated setting. In the part I assessment, the mean score for noting contraindications for contrast media was 24%; this score increased to 59% in the part III assessment (P = .004). Similarly, notification of methicillin-resistant Staphylococcus aureus status and pregnancy status and provision of referring physician contact information improved significantly. The quality of the clinical notes was stable, with good initial scores. Part III testing showed overall improvement, with the mean score increasing from 61% to 76% (P < .0001). In general, medical students lack the core knowledge that is needed for good-quality ordering of radiology services, and the experience typically afforded to interns does not address this lack of knowledge. The ROM program was a successful intervention that resulted in statistically significant improvements in the quality of radiologic examination orders, particularly with regard to logistic and radiation safety issues.

National Assessment Program--Science Literacy Year 6 Technical Report, 2006

ERIC Educational Resources Information Center

Wu, Margaret; Donovan, Jenny; Hutton, Penny; Lennon, Melissa

2008-01-01

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

Mathematics Skills and NAEP Results over a Generation

ERIC Educational Resources Information Center

Rutledge, Zachary; Kloosterman, Peter; Kenney, Patricia Anne

2009-01-01

This article describes the performance of seventeen-year-olds on the Long-Term Trend program of the National Assessment of Educational Progress. The analysis focuses on a selection of questions from the assessment on which performance has changed significantly between 1982 and 2004. (Contains 2 tables and 5 figures.)

National Assessment Program--Science Literacy Year 6 School Release Materials, 2006

ERIC Educational Resources Information Center

Donovan, Jenny; Hutton, Penny; Lennon, Melissa; O'Connor, Gayl; Morrissey, Noni

2008-01-01

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…

Mississippi Curriculum Framework for Horticulture (Program CIP: 01.0601--Horticulture Serv. Op. & Mgmt., Gen.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for horticulture I and II. Presented first are a program description and…

Mississippi Curriculum Framework for Welding (Program CIP: 48.0508--Welder/Welding Technologist). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for welding I and II. Presented first are a program description and course…

Mississippi Curriculum Framework for Agriscience (Program CIP: 02.0101--Agriculture Science). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriscience I and II. Presented first are a program description and…

Formative Evaluation of the Canada Student Loans Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2004

2004-01-01

The "Formative Evaluation of the Canada Student Loans Program" was undertaken to assess issues of program relevance, design and delivery and for the purposes of examining the early impacts of changes made to the program since 1998. The evaluation also reviewed the Performance Measurement Strategy contained in the July 2002 Results-Based…

Mississippi Curriculum Framework for Automotive Mechanics (Program CIP: 47.0604--Auto/Automotive Mechanic/Tech). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for automotive mechanics I and II. Presented first are a program description…

Mississippi Curriculum Framework for Allied Health (Program CIP: 51.1699--Nursing, Other). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for allied health I and II. Presented first are a program description and…

Mississippi Curriculum Framework for Introduction to Agriscience (Program CIP: 02.9990--Introduction to Agriculture Science). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for the introduction to agriscience program. Presented first are a program…

Advanced On-the-Job Training System: Master Test Plan

DTIC Science & Technology

1990-05-01

synonymous with program evaluation and consists of a plan to evaluate AOTS with regard to assessment of the four crit’cal issues of system compliance...acceptance, performance and suitability. Within the MTP, these critical issues are assessed at subcomponent, component, and subsystem levels. 14. SUBJECT...Master Test Plan is synonymous with program evaluation and consists of a plan to evaluate AOTS with regard to assessment of the four critical issues

Georgia's Teacher Performance Assessment

ERIC Educational Resources Information Center

Fenton, Anne Marie; Wetherington, Pamela

2016-01-01

Like most states, Georgia until recently depended on an assessment of content knowledge to award teaching licenses, along with a licensure recommendation from candidates' educator preparation programs. While the content assessment reflected candidates' grasp of subject matter, licensure decisions did not hinge on direct, statewide assessment of…

Benefits assessment of advanced public transportation systems (APTS)

DOT National Transportation Integrated Search

1996-07-01

This report documents work performed under FTA's Advance Public Transportation Systems (APTS) Program, a program structured to undertake research and development of innovative applications of advanced navigation, information, and communication techno...

The effectiveness of incorporating a real-time oculometer system in a commercial flight training program

NASA Technical Reports Server (NTRS)

Jones, D. H.; Coates, G. D.; Kirby, R. H.

1982-01-01

The effectiveness on pilot and trainee performance and scanning behavior of incorporating a real time oculometer system in a commerical flight training program was assessed. Trainees received simulator training in pairs requiring the trainees to alternate the order of training within a session. The 'third day phenomenon' of performance decrement was investigated, including the role of order of training on performance.

Evaluation of a home-based exercise program in the treatment of Alzheimer's disease: the Maximizing Independence in Dementia (MIND) study.

PubMed

Steinberg, Martin; Leoutsakos, Jeannie-Marie Sheppard; Podewils, Laura Jean; Lyketsos, C G

2009-07-01

To determine the feasibility and efficacy of a home-based exercise intervention program to improve the functional performance of patients with Alzheimer's Disease (AD). Twenty-seven home-dwelling patients with AD were randomized to either an exercise intervention program delivered by their caregivers or a home safety assessment control. Measures of functional performance (primary), cognition, neuropsychiatric symptoms, quality of life and caregiver burden (secondary) were obtained at baseline and at 6 and 12 weeks following randomization. For each outcome measure, intent-to-treat analyses using linear random effects models were performed. Feasibility and adverse events were also assessed. Adherence to the exercise program was good. On the primary outcomes (functional performance) patients in the exercise group demonstrated a trend for improved performance on measures of hand function and lower extremity strength. On secondary outcome measures, trends toward worse depression and lower quality of life ratings were noted. The physical exercise intervention developed for the study, delivered by caregivers to home-dwelling patients with AD, was feasible and was associated with a trend for improved functional performance in this group of frail patients. Given the limited efficacy to date of pharmacotherapies for AD, further study of exercise intervention, in a variety of care setting, is warranted.

Multicenter External Quality Assessment Program for PCR Detection of Mycobacterium ulcerans in Clinical and Environmental Specimens

PubMed Central

Eddyani, Miriam; Lavender, Caroline; de Rijk, Willem Bram; Bomans, Pieter; Fyfe, Janet; de Jong, Bouke; Portaels, Françoise

2014-01-01

Background Mycobacterium ulcerans is the causative agent of Buruli ulcer (BU), a necrotizing disease of the skin, soft tissue and bone. PCR is increasingly used in the diagnosis of BU and in research on the mode of transmission and environmental reservoir of M. ulcerans. Methodology/Principal Findings The aim of this study was to evaluate the performance of laboratories in detecting M. ulcerans using molecular tests in clinical and environmental samples by implementing sequential multicenter external quality assessment (EQA) programs. The second round of the clinical EQA program revealed somewhat improved performance. Conclusions/Significance Ongoing EQA programs remain essential and continued participation in future EQA programs by laboratories involved in the molecular testing of clinical and environmental samples for M. ulcerans for diagnostic and research purposes is strongly encouraged. Broad participation in such EQA programs also benefits the harmonization of quality in the BU research community and enhances the credibility of advances made in solving the transmission enigma of M. ulcerans. PMID:24586755

A Virtual Patient Software Program to Improve Pharmacy Student Learning in a Comprehensive Disease Management Course

PubMed Central

Casale, Jillian P.; Skirvin, J. Andrew; DiVall, Margarita V.

2013-01-01

Objective. To implement and assess the impact of a virtual patient pilot program on pharmacy students’ clinical competence skills. Design. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessment. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students’ posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Conclusion. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes. PMID:24159213

Examining Accuracy of Self-Assessment of In-Training Examination Performance in a Context of Guided Self-Assessment.

PubMed

Babenko, Oksana; Campbell-Scherer, Denise; Schipper, Shirley; Chmelicek, John; Barber, Tanya; Duerksen, Kimberley; Ross, Shelley

2017-06-01

In our family medicine residency program, we have established a culture of guided self-assessment through a systematic approach of direct observation of residents and documentation of formative feedback. We have observed that our residents have become more accurate in self-assessing their clinical performance. The objective of this study was to examine whether this improved accuracy extended to residents' self-assessment of their medical knowledge and clinical reasoning on the In-Training Examination (ITE). In November each year, residents in their first (PGY1) and second (PGY2) years of residency take the ITE (240 multiple-choice questions). Immediately before and right after taking the ITE, residents complete a questionnaire, self-assessing their knowledge and predicting their performances, overall and in eight high-level domains. Consented data from residents who took the ITE in 2009-2015 (n=380, 60% participation rate) were used in the Generalized Estimating Equations analyses. PGY2 residents outperformed PGY1 residents; Canadian medical graduates consistently outperformed international medical graduates; urban and rural residents performed similarly overall. Residents' pre-post self-assessments were in line with residents' actual performance on the overall examination and in the domains of Adult Medicine and Care of Surgical Patients. The underperforming residents in this study accurately predicted both pre- and post-ITE that they would perform poorly. Our findings suggest that the ITE operates well in our program. There was a tendency among residents in this study to appropriately adjust their self-assessment of their overall performance after completing the ITE. Irrespective of the residency year, resident self-assessment was less accurate on individual domains.

Benefits assessment of advanced public transportation system technologies, update 2000

DOT National Transportation Integrated Search

This report was performed under the Federal Transit Administration's (FTA) Advanced Public Transportation Systems (APTS) Program. This program focuses on the development and demonstration of innovative advanced navigation, information and communicati...

Effects of an endurance and resistance exercise program on persistent cancer-related fatigue after treatment.

PubMed

Dimeo, F; Schwartz, S; Wesel, N; Voigt, A; Thiel, E

2008-08-01

Fatigue is a relevant problem of cancer patients during and after treatment. Several studies have shown that exercise can improve quality of life and functional status of cancer patients undergoing chemo- or radiotherapy. However, there is a lack of information about the effects of this intervention on persistent cancer-related fatigue. Therefore, we assessed the effects of an exercise program on cancer-related fatigue after treatment. A consecutive series of 32 cancer patients with mild to severe persistent fatigue [scores on the Brief Fatigue Inventory (BFI) > 25] participated in a 3-week exercise program consisting of endurance (30 min walking on a treadmill) and resistance/coordination exercises for the major muscle groups. Fatigue, mood, and anxiety were assessed with questionnaires and physical performance with a stress test before and after the program. At the end of the program, we observed a significant increase of physical performance (workload at the anaerobic threshold pre 61 +/- 26 W, post 78 +/- 31 W, P < 0.0001) and reduction of global fatigue (Functional Assessment of Cancer Therapy: pre 45.7 +/- 13.4, post 52.6 +/- 12.4, P < 0.0001; BFI: pre 37.9 +/- 18.3, post 31.2 +/-17.1, P < 0.001). However, no significant improvement of cognitive fatigue or reduction of anxiety was observed. A 3-week exercise program leads to a substantial improvement of physical performance and reduction of mental and physical fatigue in cancer patients after treatment. However, this intervention does not affect depression, anxiety, or cognitive fatigue.

Maryland School Performance Assessment Program, 1992. Social Studies List of Outcomes and Indicators.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

The Maryland School Performance Program for 1992 puts forward social studies outcomes and indicators for grades K-3, grades 4-5, and grades 6-8. Specific indicators for each grade grouping further delineate the following seven individual outcomes: (1) political systems--students will demonstrate an understanding of the historical development and…

Predictors of Numeracy Performance in National Testing Programs: Insights from the Longitudinal Study of Australian Children

ERIC Educational Resources Information Center

Carmichael, Colin; MacDonald, Amy; McFarland-Piazza, Laura

2014-01-01

This article is based on an exploratory study that examines factors which predict children's performance on the numeracy component of the Australian National Assessment Program--Literacy and Numeracy (NAPLAN). Utilizing an ecological theoretical model, this study examines child, home and school variables which may enable or constrain NAPLAN…

Complex Burn Region Module (CBRM) update

NASA Technical Reports Server (NTRS)

Adams, Carl L.; Jenkins, Billy

1991-01-01

Presented here is a Complex Burn Region Module (CBRM) update for the Solid Rocket Internal Ballistics Module (SRIBM) Program for the Advanced Solid Rocket Motor (ASRM) design/performance assessments. The goal was to develop an improved version of the solid rocket internal ballistics module program that contains a diversified complex region model for motor grain design, performance prediction, and evaluation.

Third Grade English Language Arts: Underperformance on Statewide Assessments

ERIC Educational Resources Information Center

Ramnarain, Taramattie

2013-01-01

The intent of this investigation was to examine the Kaplan K-12 program in an intervention process and identify the determinants that contributed to the void in performance in English language arts in Grade 3. As such, the researcher selected the Kaplan K-12 intervention program to shrink the void in performance in the English language arts within…

It's All about Student Learning: Assessing Teacher Candidates' Ability to Impact P-12 Students

ERIC Educational Resources Information Center

Wise, A. E., Ed.; Ehrenberg, P., Ed.; Leibbrand, J., Ed.

2010-01-01

"It's All About Student Learning Assessing Teacher Candidates' Ability to Impact P-12 Students", provides practical assistance for institutions designing or revising assessment systems or individual assessments for use by units or programs. The publication includes performance assessments currently used by teacher preparation institutions and…

Impact of a weekly reading program on orthopedic surgery residents' in-training examination.

PubMed

Weglein, Daniel G; Gugala, Zbigniew; Simpson, Suzanne; Lindsey, Ronald W

2015-05-01

In response to a decline in individual residents' performance and overall program performance on the Orthopaedic In-Training Examination (OITE), the authors' department initiated a daily literature reading program coupled with weekly tests on the assigned material. The goal of this study was to assess the effect of the reading program on individual residents' scores and the training program's OITE scores. The reading program consisted of daily review articles from the Journal of the American Academy of Orthopaedic Surgeons, followed by a weekly written examination consisting of multiple-choice or fill-in-the-blank questions. All articles were selected and all questions were written by the departmental chair. A questionnaire was given to assess residents' perceptions of the weekly tests. As a result of implementing the reading program for a 10-month period, residents' subsequent performance on the OITE significantly improved (mean score increase, 4, P<.0001; percentile score increase, 11, P=.0007). The difference in mean score was significant for residents in postgraduate years 3, 4, and 5. A statistically significant correlation was found between weekly test scores and performance on the OITE, with a significant correlation between weekly test scores and OITE percentile ranking. The study results also showed a positive correlation between reading test attendance and weekly test scores. Residents' anonymous questionnaire responses also demonstrated the reading program to be a valuable addition to the residency training curriculum. In conclusion, the study strongly supports the benefits of a weekly reading and examination program in enhancing the core knowledge of orthopedic surgery residents. Copyright 2015, SLACK Incorporated.

Measuring the effectiveness and impact of an open innovation platform.

PubMed

Carroll, Glenn P; Srivastava, Sanjay; Volini, Adam S; Piñeiro-Núñez, Marta M; Vetman, Tatiana

2017-05-01

Today, most pharmaceutical companies complement their traditional R&D models with some variation on the Open Innovation (OI) approach in an effort to better access global scientific talent, ideas and hypotheses. Traditional performance indicators that measure economic returns from R&D through commercialization are often not applicable to the practical assessment of these OI approaches, particularly within the context of early drug discovery. This leaves OI programs focused on early R&D without a standard assessment framework from which to evaluate overall performance. This paper proposes a practical dashboard for such assessment, encompassing quantitative and qualitative elements, to enable decision-making and improvement of future performance. The use of this dashboard is illustrated using real-time data from the Lilly Open Innovation Drug Discovery (OIDD) program. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

PubMed Central

KOJURI, JAVAD; AMINI, MITRA; KARIMIAN, ZAHRA; DEHGHANI, MOHAMMAD REZA; SABER, MAHBOOBEH; BAZRAFCAN, LEILA; EBRAHIMI, SEDIGHEH; REZAEE, RITA

2015-01-01

Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396). Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusions: Our faculty development program  have a significant positive effect on medical university teaching staff members’ competencies. Further research is needed to investigate whether the faculty development program actually results in improved teaching performance. PMID:25587548

Primary Care-Mental Health Integration in the Veterans Affairs Health System: Program Characteristics and Performance.

PubMed

Cornwell, Brittany L; Brockmann, Laurie M; Lasky, Elaine C; Mach, Jennifer; McCarthy, John F

2018-06-01

The Veterans Health Administration (VHA) has achieved substantial national implementation of primary care-mental health integration (PC-MHI) services. However, little is known regarding program characteristics, variation in characteristics across settings, or associations between program fidelity and performance. This study identified core elements of PC-MHI services and evaluated their associations with program characteristics and performance. A principal-components analysis (PCA) of reports from 349 sites identified factors associated with PC-MHI fidelity. Analyses assessed the correlation among factors and between each factor and facility type (medical center or community-based outpatient clinic), primary care population size, and performance indicators (receipt of PC-MHI services, same-day access to mental health and primary care services, and extended duration of services). PCA identified seven factors: core implementation, care management (CM) assessments and supervision, CM supervision receipt, colocated collaborative care (CCC) by prescribing providers, CCC by behavioral health providers, participation in patient aligned care teams (PACTs) for special populations, and treatment of complex mental health conditions. Sites serving larger populations had greater core implementation scores. Medical centers and sites serving larger populations had greater scores for CCC by prescribing providers, CM assessments and supervision, and participation in PACTs. Greater core implementation scores were associated with greater same-day access. Sites with greater scores for CM assessments and supervision had lower scores for treatment of complex conditions. Outpatient clinics and sites serving smaller populations experienced challenges in integrated care implementation. To enhance same-day access, VHA should continue to prioritize PC-MHI implementation. Providing brief, problem-focused care may enhance CM implementation.

Comparison of Home Retrofit Programs in Wisconsin

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cunningham, Kerrie; Hannigan, Eileen

2013-03-01

To explore ways to reduce customer barriers and increase home retrofit completions, several different existing home retrofit models have been implemented in the state of Wisconsin. This study compared these programs' performance in terms of savings per home and program cost per home to assess the relative cost-effectiveness of each program design. However, given the many variations in these different programs, it is difficult to establish a fair comparison based on only a small number of metrics. Therefore, the overall purpose of the study is to document these programs' performance in a case study approach to look at general patternsmore » of these metrics and other variables within the context of each program. This information can be used by energy efficiency program administrators and implementers to inform home retrofit program design. Six different program designs offered in Wisconsin for single-family energy efficiency improvements were included in the study. For each program, the research team provided information about the programs' approach and goals, characteristics, achievements and performance. The program models were then compared with performance results-program cost and energy savings-to help understand the overall strengths and weaknesses or challenges of each model.« less

Comparison of Home Retrofit Programs in Wisconsin

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cunningham, K.; Hannigan, E.

2013-03-01

To explore ways to reduce customer barriers and increase home retrofit completions, several different existing home retrofit models have been implemented in the state of Wisconsin. This study compared these programs' performance in terms of savings per home and program cost per home to assess the relative cost-effectiveness of each program design. However, given the many variations in these different programs, it is difficult to establish a fair comparison based on only a small number of metrics. Therefore, the overall purpose of the study is to document these programs' performance in a case study approach to look at general patternsmore » of these metrics and other variables within the context of each program. This information can be used by energy efficiency program administrators and implementers to inform home retrofit program design. Six different program designs offered in Wisconsin for single-family energy efficiency improvements were included in the study. For each program, the research team provided information about the programs' approach and goals, characteristics, achievements and performance. The program models were then compared with performance results -- program cost and energy savings -- to help understand the overall strengths and weaknesses or challenges of each model.« less

A new method for the assessment of patient safety competencies during a medical school clerkship using an objective structured clinical examination

PubMed Central

Daud-Gallotti, Renata Mahfuz; Morinaga, Christian Valle; Arlindo-Rodrigues, Marcelo; Velasco, Irineu Tadeu; Arruda Martins, Milton; Tiberio, Iolanda Calvo

2011-01-01

INTRODUCTION: Patient safety is seldom assessed using objective evaluations during undergraduate medical education. OBJECTIVE: To evaluate the performance of fifth-year medical students using an objective structured clinical examination focused on patient safety after implementation of an interactive program based on adverse events recognition and disclosure. METHODS: In 2007, a patient safety program was implemented in the internal medicine clerkship of our hospital. The program focused on human error theory, epidemiology of incidents, adverse events, and disclosure. Upon completion of the program, students completed an objective structured clinical examination with five stations and standardized patients. One station focused on patient safety issues, including medical error recognition/disclosure, the patient-physician relationship and humanism issues. A standardized checklist was completed by each standardized patient to assess the performance of each student. The student's global performance at each station and performance in the domains of medical error, the patient-physician relationship and humanism were determined. The correlations between the student performances in these three domains were calculated. RESULTS: A total of 95 students participated in the objective structured clinical examination. The mean global score at the patient safety station was 87.59±1.24 points. Students' performance in the medical error domain was significantly lower than their performance on patient-physician relationship and humanistic issues. Less than 60% of students (n = 54) offered the simulated patient an apology after a medical error occurred. A significant correlation was found between scores obtained in the medical error domains and scores related to both the patient-physician relationship and humanistic domains. CONCLUSIONS: An objective structured clinical examination is a useful tool to evaluate patient safety competencies during the medical student clerkship. PMID:21876976

Quality of pancreatic transplant program assessment using a risk-adjusted cumulative sum chart: experience from a single, small center.

PubMed

Grochowiecki, T; Jakimowicz, T; Grabowska-Derlatka, L; Szmidt, J

2014-10-01

The high rate of complication after pancreas transplantation not only had an impact on recipient quality of life and survival but also had significant financial implications. Thus, monitoring transplant center performance was crucial to indentifying changes in clinical practice that result in quality deterioration. To evaluate retrospectively the quality of the single, small pancreatic transplant program and to establish prospective monitoring of the center using risk-adjusted cumulative sum (CUSUM). From 1988 to 2014, 119 simultaneous pancreas and the kidney transplantations (SPKTx) were performed. The program was divided into 3 eras, based on surgical technique and immunosuppression. Analyses of the 15 fatal outcomes due to complication from pancreatic graft were performed. The risk model was developed using multivariable logistic regression analysis based on retrospective data of 112 SPKTx recipients. The risk-adjusted 1-sided CUSUM chart was plotted for retrospective and prospective events. The upper control limit was set to 2. There were 2 main causes of death: multiorgan failure (73.3%; 11/15) and septic hemorrhage (26.7%; 4/15). Quality analysis using the CUSUM chart revealed that the process was not homogeneous; however, no significant signal of program deterioration was obtained and the performance of the whole program was within the settled control limit. For a single pancreatic transplant center. The risk-adjusted CUSUM chart was a useful tool for quality program assessment. It could support decision making during traditional surgical morbidity and mortality conferences. For small transplant centers, increasing the sensitivity of the CUSUM method by lowering the upper control limit should be considered. However, an individual assessment approach of the for particular centers is recommended.

Classification software technique assessment

NASA Technical Reports Server (NTRS)

Jayroe, R. R., Jr.; Atkinson, R.; Dasarathy, B. V.; Lybanon, M.; Ramapryian, H. K.

1976-01-01

A catalog of software options is presented for the use of local user communities to obtain software for analyzing remotely sensed multispectral imagery. The resources required to utilize a particular software program are described. Descriptions of how a particular program analyzes data and the performance of that program for an application and data set provided by the user are shown. An effort is made to establish a statistical performance base for various software programs with regard to different data sets and analysis applications, to determine the status of the state-of-the-art.

External bone marrow cytological examination quality assurance (EQAhem)--summary after 6 years in Poland.

PubMed

Lewandowski, Krzysztof; Kurpierz, Katarzyna; Sledzinska, Anna

2015-10-01

Bone marrow macroscopic examination remains one of the most difficult and subjective laboratory assessments in hematology. Only a few external quality assurance programs in the field are present worldwide. We have developed an external quality assurance program EQAhem that allows assessment of the whole process of bone marrow examination. The program participants assess blood and bone marrow smears from the patient, identify selected cells from photographs provided to them, and interpret the microscopic results. In this article, the results of the EQAhem program in Poland from 6 years are summarized. During this time, 62 labs were assessed in total, and positive results were achieved by 89.25 % labs, taking into account all tests. Correct responses with respect to the percentage of cell count were provided by ca. 77.5 % labs. Slightly worse results were obtained when megakaryocyte count and cell identification from photographs were tested. The worst results were obtained in case of dysplasia assessment and clinical interpretation of microscopic examination (54.1 and 58.6 % correct responses, respectively). EQAhem delivers precise information about the quality of bone marrow examinations performed in Poland and has a substantial educational value. We believe that after 6 years, EQAhem has significantly improved the quality of bone marrow microscopic examinations performed in Poland.

Effect of a multifactorial fall-and-fracture risk assessment and management program on gait and balance performances and disability in hospitalized older adults: a controlled study.

PubMed

Trombetti, A; Hars, M; Herrmann, F; Rizzoli, R; Ferrari, S

2013-03-01

This controlled intervention study in hospitalized oldest old adults showed that a multifactorial fall-and-fracture risk assessment and management program, applied in a dedicated geriatric hospital unit, was effective in improving fall-related physical and functional performances and the level of independence in activities of daily living in high-risk patients. Hospitalization affords a major opportunity for interdisciplinary cooperation to manage fall-and-fracture risk factors in older adults. This study aimed at assessing the effects on physical performances and the level of independence in activities of daily living (ADL) of a multifactorial fall-and-fracture risk assessment and management program applied in a geriatric hospital setting. A controlled intervention study was conducted among 122 geriatric inpatients (mean ± SD age, 84 ± 7 years) admitted with a fall-related diagnosis. Among them, 92 were admitted to a dedicated unit and enrolled into a multifactorial intervention program, including intensive targeted exercise. Thirty patients who received standard usual care in a general geriatric unit formed the control group. Primary outcomes included gait and balance performances and the level of independence in ADL measured 12 ± 6 days apart. Secondary outcomes included length of stay, incidence of in-hospital falls, hospital readmission, and mortality rates. Compared to the usual care group, the intervention group had significant improvements in Timed Up and Go (adjusted mean difference [AMD] = -3.7s; 95 % CI = -6.8 to -0.7; P = 0.017), Tinetti (AMD = -1.4; 95 % CI = -2.1 to -0.8; P < 0.001), and Functional Independence Measure (AMD = 6.5; 95 %CI = 0.7-12.3; P = 0.027) test performances, as well as in several gait parameters (P < 0.05). Furthermore, this program favorably impacted adverse outcomes including hospital readmission (hazard ratio = 0.3; 95 % CI = 0.1-0.9; P = 0.02). A multifactorial fall-and-fracture risk-based intervention program, applied in a dedicated geriatric hospital unit, was effective and more beneficial than usual care in improving physical parameters related to the risk of fall and disability among high-risk oldest old patients.

A randomized controlled trial of an activity specific exercise program for individuals with Alzheimer disease in long-term care settings.

PubMed

Roach, Kathryn E; Tappen, Ruth M; Kirk-Sanchez, Neva; Williams, Christine L; Loewenstein, David

2011-01-01

To determine whether an activity specific exercise program could improve ability to perform basic mobility activities in long-term care residents with Alzheimer disease (AD). Randomized, controlled, single-blinded clinical trial. Residents of 7 long-term care facilities. Eighty-two long-term care residents with mild to severe AD. An activity specific exercise program was compared to a walking program and to an attention control. Ability to perform bed mobility and transfers was assessed using the subscales of the Acute Care Index of Function; functional mobility was measured using the 6-Minute Walk test. Subjects receiving the activity specific exercise program improved in ability to perform transfers, whereas subjects in the other 2 groups declined.

Reducing errors benefits the field-based learning of a fundamental movement skill in children.

PubMed

Capio, C M; Poolton, J M; Sit, C H P; Holmstrom, M; Masters, R S W

2013-03-01

Proficient fundamental movement skills (FMS) are believed to form the basis of more complex movement patterns in sports. This study examined the development of the FMS of overhand throwing in children through either an error-reduced (ER) or error-strewn (ES) training program. Students (n = 216), aged 8-12 years (M = 9.16, SD = 0.96), practiced overhand throwing in either a program that reduced errors during practice (ER) or one that was ES. ER program reduced errors by incrementally raising the task difficulty, while the ES program had an incremental lowering of task difficulty. Process-oriented assessment of throwing movement form (Test of Gross Motor Development-2) and product-oriented assessment of throwing accuracy (absolute error) were performed. Changes in performance were examined among children in the upper and lower quartiles of the pretest throwing accuracy scores. ER training participants showed greater gains in movement form and accuracy, and performed throwing more effectively with a concurrent secondary cognitive task. Movement form improved among girls, while throwing accuracy improved among children with low ability. Reduced performance errors in FMS training resulted in greater learning than a program that did not restrict errors. Reduced cognitive processing costs (effective dual-task performance) associated with such approach suggest its potential benefits for children with developmental conditions. © 2011 John Wiley & Sons A/S.

PRACA Enhancement Pilot Study Report: Engineering for Complex Systems Program (formerly Design for Safety), DFS-IC-0006

NASA Technical Reports Server (NTRS)

Korsmeyer, David; Schreiner, John

2002-01-01

This technology evaluation report documents the findings and recommendations of the Engineering for Complex Systems Program (formerly Design for Safety) PRACA Enhancement Pilot Study of the Space Shuttle Program's (SSP's) Problem Reporting and Corrective Action (PRACA) System. A team at NASA Ames Research Center (ARC) performed this Study. This Study was initiated as a follow-on to the NASA chartered Shuttle Independent Assessment Team (SIAT) review (performed in the Fall of 1999) which identified deficiencies in the current PRACA implementation. The Pilot Study was launched with an initial qualitative assessment and technical review performed during January 2000 with the quantitative formal Study (the subject of this report) started in March 2000. The goal of the PRACA Enhancement Pilot Study is to evaluate and quantify the technical aspects of the SSP PRACA systems and recommend enhancements to address deficiencies and in preparation for future system upgrades.

The implementation and use of Ada on distributed systems with high reliability requirements

NASA Technical Reports Server (NTRS)

Knight, J. C.

1988-01-01

The use and implementation of Ada were investigated in distributed environments in which reliability is the primary concern. In particular, the focus was on the possibility that a distributed system may be programmed entirely in Ada so that the individual tasks of the system are unconcerned with which processors are being executed, and that failures may occur in the software and underlying hardware. A secondary interest is in the performance of Ada systems and how that performance can be gauged reliably. Primary activities included: analysis of the original approach to recovery in distributed Ada programs using the Advanced Transport Operating System (ATOPS) example; review and assessment of the original approach which was found to be capable of improvement; development of a refined approach to recovery that was applied to the ATOPS example; and design and development of a performance assessment scheme for Ada programs based on a flexible user-driven benchmarking system.

An Assessment of Fiscal Year 2013 Beyond Yellow Ribbon Programs

DTIC Science & Technology

2015-01-01

2013 Beyond Yellow Ribbon Programs 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR( S ) 5d. PROJECT NUMBER 5e. TASK NUMBER...5f. WORK UNIT NUMBER 7. PERFORMING ORGANIZATION NAME( S ) AND ADDRESS(ES) RAND Corporation,National Defense Research Institute,1776 Main Street, P.O...Box 2138,Santa Monica,CA,90407-2138 8. PERFORMING ORGANIZATION REPORT NUMBER 9. SPONSORING/MONITORING AGENCY NAME( S ) AND ADDRESS(ES) 10. SPONSOR

A training program for anthropometric measurements by a dedicated nutrition support team improves nutritional status assessment of the critically ill child.

PubMed

Valla, Frederic V; Ford-Chessel, Carole; Meyer, Rosan; Berthiller, Julien; Dupenloup, Christine; Follin-Arbelet, Nathalie; Hubert, Anna; Javouhey, Etienne; Peretti, Noel

2015-03-01

The cornerstone of an optimal nutrition approach in PICUs is to evaluate the nutritional status of any patient. Anthropometric measurements and nutritional indices calculation allow for nutritional status assessment, which is not often part of routine management, as it is considered difficult to perform in this setting. We designed a study to evaluate the impact of a training program by the PICU nutritional support team on the implementation of routine anthropometric measurements on our PICU. A prospective study was performed over a 2-year period, which included: a baseline evaluation of nutritional assessment, knowledge, anthropometric measurements (weight, height, and head and mid upper arm circumferences), and nutritional indices calculation in patient files. This was followed by a training program to implement the newly developed nutrition assessment guidelines, which included anthropometrical measurements and also the interpretation of these. The impact of this nutritional assessment program was reviewed annually for 2 years after the implementation. PICU--Lyon, France. PICU nursing and medical staff, and patients admitted in February 2011, 2012, and 2013. Training program. Ninety-nine percent of staff (n = 145) attended the individual teaching. We found significant progress in nutritional awareness and confidence about nutritional assessment following the teaching program. In addition, an improvement in staff knowledge about undernutrition and its consequences were found. We enrolled 41, 55, and 91 patients in 2011, 2012, and 2013, respectively. There was a significant increase in anthropometric measurements during this time: 32%, 65% (p = 0.002), and 96% in 2013 (p < 0.001). Nutritional indices were calculated in 20%, 74% (p < 0.001), and 96% (p < 0.001) of cases. This is the first study, showing that a targeted nutritional assessment teaching program that highlights both the importance and techniques of anthropometrical measurements has successfully been implemented in a PICU. It managed to improve staff knowledge and nutritional practice.

Highlights from PISA 2006: Performance of U.S. 15-Year-Old Students in Science and Mathematics Literacy in an International Context. NCES 2008-016

ERIC Educational Resources Information Center

Baldi, Stephane; Jin, Ying; Green, Patricia J.; Herget, Deborah

2007-01-01

The Program for International Student Assessment (PISA) is a system of international assessments administered by the Organization for Economic Cooperation and Development (OECD) that measures 15-year-olds' performance in reading literacy, mathematics literacy, and science literacy every 3 years. This report focuses on the performance of U.S.…

Control system software, simulation, and robotic applications

NASA Technical Reports Server (NTRS)

Frisch, Harold P.

1991-01-01

All essential existing capabilities needed to create a man-machine interaction dynamics and performance (MMIDAP) capability are reviewed. The multibody system dynamics software program Order N DISCOS will be used for machine and musculo-skeletal dynamics modeling. The program JACK will be used for estimating and animating whole body human response to given loading situations and motion constraints. The basic elements of performance (BEP) task decomposition methodologies associated with the Human Performance Institute database will be used for performance assessment. Techniques for resolving the statically indeterminant muscular load sharing problem will be used for a detailed understanding of potential musculotendon or ligamentous fatigue, pain, discomfort, and trauma. The envisioned capacity is to be used for mechanical system design, human performance assessment, extrapolation of man/machine interaction test data, biomedical engineering, and soft prototyping within a concurrent engineering (CE) system.

Using electronic clinical practice audits as needs assessment to produce effective continuing medical education programming.

PubMed

Klein, Doug; Staples, John; Pittman, Carmen; Stepanko, Cheryl

2012-01-01

The traditional needs assessment used in developing continuing medical education programs typically relies on surveying physicians and tends to only capture perceived learning needs. Instead, using tools available in electronic medical record systems to perform a clinical audit on a physician's practice highlights physician-specific practice patterns. The purpose of this study was to test the feasibility of implementing an electronic clinical audit needs assessment process for family physicians in Canada. A clinical audit of 10 preventative care interventions and 10 chronic disease interventions was performed on family physician practices in Alberta, Canada. The physicians used the results from the audit to produce personalized learning needs, which were then translated into educational programming. A total of 26 family practices and 4489 patient records were audited. Documented completion rates for interventions ranged from 13% for ensuring a patient's tetanus vaccine is current to 97% of pregnant patients receiving the recommended prenatal vitamins. Electronic medical record-based needs assessments may provide a better basis for developing continuing medical education than a more traditional survey-based needs assessment. This electronic needs assessment uses the physician's own patient outcome information to assist in determining learning objectives that reflect both perceived and unperceived needs.

Does practice make perfect? Prospectively comparing effects of 2 amounts of practice on tourniquet use performance.

PubMed

Baruch, Erez N; Benov, Avi; Shina, Avi; Berg, Amy L; Shlaifer, Amir; Glassberg, Elon; Aden, James K; Bader, Tarif; Kragh, John F; Yitzhak, Avraham

2016-12-01

Although a lifesaving skill, currently, there is no consensus for the required amount of practice in tourniquet use. We compared the effect of 2 amounts of practice on performance of tourniquet use by nonmedical personnel. Israeli military recruits without previous medical training underwent their standard tactical first aid course, and their initial performance in use of the Combat Application Tourniquet (CAT; Composite Resources, Rock Hill, SC) was assessed. The educational intervention was to allocate the participants into a monthly tourniquet practice program: either a single-application practice (SAP) group or a triple-application practice (TAP) group. Each group practiced according to its program. After 3 months, the participants' tourniquet use performance was reassessed. Assessments were conducted using the HapMed Leg Tourniquet Trainer (CHI Systems, Fort Washington, PA), a mannequin which measures time and pressure. A total of 151 participants dropped out, leaving 87 in the TAP group and 69 in the SAP group. On initial assessment, the TAP group and the SAP group performed similarly. Both groups improved their performance from the initial to the final assessment. The TAP group improved more than the SAP group in mean application time (faster by 18 vs 8 seconds, respectively; P = .023) and in reducing the proportion of participants who were unable to apply any pressure to the mannequin (less by 18% vs 8%, respectively; P = .009). Three applications per monthly practice session were superior to one. This is the first prospective validation of a tourniquet practice program based on objective measurements. Copyright © 2016 Elsevier Inc. All rights reserved.

[Software for performing a global phenotypic and genotypic nutritional assessment].

PubMed

García de Diego, L; Cuervo, M; Martínez, J A

2013-01-01

The nutritional assessment of a patient needs the simultaneous managing a extensive information and a great number of databases, as both aspects of the process of nutrition and the clinical situation of the patient are analyzed. The introduction of computers in the nutritional area constitutes an extraordinary advance in the administration of nutrition information, providing a complete assessment of nutritional aspects in a quick and easy way. To develop a computer program that can be used as a tool for assessing the nutritional status of the patient, the education of clinical staff, for epidemiological studies and for educational purposes. Based on a computer program which assists the health specialist to perform a full nutritional evaluation of the patient, through the registration and assessment of the phenotypic and genotypic features. The application provides nutritional prognosis based on anthropometric and biochemical parameters, images of states of malnutrition, questionnaires to characterize diseases, diagnostic criteria, identification of alleles associated with the development of specific metabolic illnesses and questionnaires of quality of life, for a custom actuation. The program includes, as part of the nutritional assessment of the patient, food intake analysis, design of diets and promotion of physical activity, introducing food frequency questionnaires, dietary recalls, healthy eating indexes, model diets, fitness tests, and recommendations, recalls and questionnaires of physical activity. A computer program performed under Java Swing, using SQLite database and some external libraries such as JfreeChart for plotting graphs. This brand new designed software is composed of five blocks categorized into ten modules named: Patients, Anthropometry, Clinical History, Biochemistry, Dietary History, Diagnostic (with genetic make up), Quality of life, Physical activity, Energy expenditure and Diets. Each module has a specific function which evaluates a different aspect of the nutritional status of the patient. UNyDIET is a global computer program, customized and upgradeable, easy to use and versatile, aimed to health specialists, medical staff, dietitians, nutritionists, scientists and educators. This tool can be used as a working instrument in programs promoting health, nutritional and clinical assessments as well as in the evaluation of health care quality, in epidemiological studies, in nutrition intervention programs and teaching. Copyright © AULA MEDICA EDICIONES 2013. Published by AULA MEDICA. All rights reserved.

The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

ERIC Educational Resources Information Center

Buttram, Joan L.; Covert, Robert W.

The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

Mississippi Curriculum Framework for Small Engine Repair (Program CIP: 47.0606--Small Engine Mechanic and Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for small engine repair I and II. Presented first are a program description…

Results from a Multi-Modal Program Evaluation of a Four Year Statewide Juvenile Sex Offender Treatment and Reentry Program

ERIC Educational Resources Information Center

Underwood, Lee A.; Dailey, Frances L. L.; Merino, Carrie; Crump, Yolanda

2015-01-01

The results of the Program Evaluation show the OJJ Statewide Sex Offender Treatment program is exceptionally productive in meeting over 90% of its established performance markers. These markers included successful screening and assessment of risk and psychosocial needs, completion of initial and master treatment plans, establishment of sex…

Mississippi Curriculum Framework for Forestry (Program CIP: 03.0401--Forest Harvesting and Production Technology). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for forestry I and II. Presented first are a program description and course…

Competency Based Training Program for Department Chairpersons and Other Resource Personnel.

ERIC Educational Resources Information Center

Bingen, Frances N.; And Others

The Competency Based Training Program is a three part, three phase package. It contains: (1) a research document; (2) a set of 18 programed units and; (3) cassettes to accompany two specific units. The program phases require that: (1) the participant and a training advisor jointly perform a needs assessment activity and select appropriate units…

Mission, Performance Indicators, and Assessment in U.S. Honors: A View from the Netherlands

ERIC Educational Resources Information Center

Bartelds, Vladimir; Drayer, Lyndsay; Wolfensberger, Marca V. C.

2012-01-01

A mission statement that identifies the goals and aims of an honors program is a key step in program development. The National Collegiate Honors Council's Basic Characteristics of a Fully Developed Honors Program states unequivocally that a successful honors program "has a clear mandate from the institution's administration in the form of a…

Examining Alignment between State Performance Assessment and Mathematics Classroom Activities

ERIC Educational Resources Information Center

Parke, Carol S.; Lane, Suzanne

2008-01-01

The authors describe research on the extent to which mathematics classroom activities in Maryland were aligned with Maryland learning outcomes and the Maryland School Performance Assessment Program (MSPAP; Maryland State Department of Education, 1995, 2000). The study was part of a larger research project (S. Lane, C. S. Parke, & C. A. Stone,…

Are Multiple Measures Meaningful?: Lessons from a Statewide Performance Assessment.

ERIC Educational Resources Information Center

Goldberg, Gail Lynn; Roswell, Barbara Sherr

2001-01-01

To determine the factors that contribute to or compromise the effectiveness of multiscored items, this study combined analysis of statewide score data from the 1996 Maryland School Performance Assessment Program tests with systematic analyses of 60 activities providing measures of writing, language usage, or both, and one or more content areas.…

77 FR 75173 - Comprehensive Assessment of the Process for the Review of Device Submissions; Request for Comments

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-19

... performing the technical analysis, management assessment, and program evaluation tasks required to address... premarket reviews that meet regulatory review standards. 2. Analysis of elements of the review process... process. This includes analysis of root causes for inefficiencies that may affect review performance and...

Massachusetts Educational Assessment Program. Science and Ecology 1976-1977.

ERIC Educational Resources Information Center

Massachusetts State Dept. of Education, Boston.

Biology, Chemistry, Earth Science, Physics, and Ecology assessment instruments were administered to approximately 1,800 nine year old and 1,800 seventeen year old Massachusetts students. The 9 year old students exceeded the performance of a national and international sampling of students. They equaled the performance of a sampling of students from…

Observation and Teacher Quality: Critical Analysis of Observational Instruments in Preservice Teacher Performance Assessment

ERIC Educational Resources Information Center

Caughlan, Samantha; Jiang, Heng

2014-01-01

Teacher preparation programs commonly use observational instruments to assess the progress and the exit performances of teacher candidates. However, while these instruments have been described and several have been studied for effectiveness, the field lacks a close examination of how they position participants: teacher candidates, K-12 pupils, and…

Assessment and Remediation for Physicians with Suspected Performance Problems: An International Survey

ERIC Educational Resources Information Center

Humphrey, Charlotte

2010-01-01

Introduction: Little is known about the overall appropriateness and value of the various programs available internationally for assessment and remediation for individual physicians whose performance in their clinical practice has been identified as giving cause for concern. Method: A questionnaire was e-mailed to members of the International…

Comparison of integrated and isolated training on performance measures and neuromuscular control.

PubMed

Distefano, Lindsay J; Distefano, Michael J; Frank, Barnett S; Clark, Micheal A; Padua, Darin A

2013-04-01

Traditional weight training programs use an exercise prescription strategy that emphasizes improving muscle strength through resistance exercises. Other factors, such as stability, endurance, movement quality, power, flexibility, speed, and agility are also essential elements to improving overall functional performance. Therefore, exercises that incorporate these additional elements may be beneficial additions to traditional resistance training programs. The purpose of the study was to compare the effects of an isolated resistance training program (ISO) and an integrated training program (INT) on movement quality, vertical jump height, agility, muscle strength and endurance, and flexibility. The ISO program consisted of primarily upper and lower extremity progressive resistance exercises. The INT program involved progressive resistance exercises, and core stability, power, and agility exercises. Thirty subjects were cluster randomized to either the ISO (n = 15) or INT (n = 15) training program. Each training group performed their respective programs 2 times per week for 8 weeks. The subjects were assessed before (pretest) and after (posttest) the intervention period using the following assessments: a jump-landing task graded using the Landing Error Scoring System (LESS), vertical jump height, T-test time, push-up and sit-up performance, and the sit-and-reach test. The INT group performed better on the LESS test (pretest: 3.90 ± 1.02, posttest: 3.03 ± 1.02; p = 0.02), faster on the T-test (pretest: 10.35 ± 1.20 seconds, posttest: 9.58 ± 1.02 seconds; p = 0.01), and completed more sit-ups (pretest: 40.20 ± 15.01, posttest: 46.73 ± 14.03; p = 0.045) and push-ups (pretest: 40.67 ± 13.85, posttest: 48.93 ± 15.17; p = 0.05) at posttest compared with pretest, and compared with the ISO group at posttest. Both groups performed more push-ups (p = 0.002), jumped higher (p < 0.001), and reached further (p = 0.008) at posttest compared with that at pretest. Performance enhancement programs should use an integrated approach to exercise selection to optimize performance and movement technique benefits.

Implementation and Use of the Pharmacy Curriculum Outcomes Assessment at US Schools of Pharmacy.

PubMed

Gortney, Justine Schuller; Bray, Brenda S; Salinitri, Francine D

2015-11-25

To describe how schools and colleges of pharmacy use the Pharmacy Curriculum Outcomes Assessment (PCOA) in relation to student assessment and curricular feedback. A survey was distributed to all programs that have implemented the PCOA. The survey was designed to assess 3 domains regarding the use of the PCOA: rationale for use, logistics of administration, and performance data review and distribution. A 79% response rate (41/52) was obtained. The mix of responses was 93% current PCOA users and 7% past users. The most common reasons for PCOA use were for programmatic assessment and benchmarking. The examination was most frequently administered during the P3 year, with minimal stakes attached to performance. Significant differences in responses based on public vs private institution were seen with respect to length of accreditation of current PCOA users, messaging to students regarding performance, inclusion of results in student advising, and distribution of results to stakeholders. Programs were using the PCOA primarily as an assessment in the P3 year for reasons related to programmatic and curricular assessment. Some differences existed between public and private institutional PCOA use and examination-related processes and results distribution.

Implementation and Use of the Pharmacy Curriculum Outcomes Assessment at US Schools of Pharmacy

PubMed Central

Bray, Brenda S.; Salinitri, Francine D.

2015-01-01

Objective. To describe how schools and colleges of pharmacy use the Pharmacy Curriculum Outcomes Assessment (PCOA) in relation to student assessment and curricular feedback. Methods. A survey was distributed to all programs that have implemented the PCOA. The survey was designed to assess 3 domains regarding the use of the PCOA: rationale for use, logistics of administration, and performance data review and distribution. Results. A 79% response rate (41/52) was obtained. The mix of responses was 93% current PCOA users and 7% past users. The most common reasons for PCOA use were for programmatic assessment and benchmarking. The examination was most frequently administered during the P3 year, with minimal stakes attached to performance. Significant differences in responses based on public vs private institution were seen with respect to length of accreditation of current PCOA users, messaging to students regarding performance, inclusion of results in student advising, and distribution of results to stakeholders. Conclusion. Programs were using the PCOA primarily as an assessment in the P3 year for reasons related to programmatic and curricular assessment. Some differences existed between public and private institutional PCOA use and examination-related processes and results distribution. PMID:26839427

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2013 CFR

2013-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2014 CFR

2014-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2012 CFR

2012-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2011 CFR

2011-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

Evaluating Market Orientation of an Executive MBA Program.

ERIC Educational Resources Information Center

Dubas, Khalid M.; Ghani, Waqar I.; Davis, Stanley; Strong, James T.

1998-01-01

A study assessed the market orientation of the executive Master's in Business Administration (MBA) program at Saint Joseph's University (Pennsylvania) in terms of 12 skills and knowledge areas that reflect effective managerial performance and the student-executives' perceptions of program strengths and weaknesses in delivering these skills.…

Manipulator system man-machine interface evaluation program. [technology assessment

NASA Technical Reports Server (NTRS)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Mississippi Curriculum Framework for Electrician (Program CIP: 46.0302--Electrician). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for secondary-level courses to prepare Mississippi vocational students for…

Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

ERIC Educational Resources Information Center

Bruhns, Arthur E.

Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

STORM AND COMBINED SEWER OVERFLOW: AN OVERVIEW OF EPA'S RESEARCH PROGRAM (EPA/600/8-89/054)

EPA Science Inventory

This report represents an overview of the EPA's Storm & Combined Sewer Pollution Control Research Program performed over a 20-year period beginning with the mid-1960s. It covers program involvements in the development of a diverse technology including pollution-problem assessment...

OLEM Performance Assessment Information

EPA Pesticide Factsheets

This asset includes a variety of data sets that measure the performance of Office of Land and Emergency Management (OLEM) programs in support of the Office of the Chief Financial Officer's Annual Commitment System (ACS) and Performance Evaluation Reporting System (PERS). Information is drawn from OLEM's ACRES, RCRAInfo, CERCLIS/SEMS, ICIS, and LUST4 systems, as well as input manually by authorized individuals in OLEM's program offices. Information is reviewed by OLEM program staff prior to being pushed to ACS and entered into PERS. This data asset also pulls in certain performance information input directly by Regional Office staff into ACS. Information is managed by the Performance Assessment Tool (PAT) and displayed in the PAT Dashboard.Information in this asset include:--Government Performance and Results Act (GPRA) of 1993: Measures reported for Innovations, Partnerships and Communications Office (IPCO), the Office of Brownfields and Land Revitalization (OBLR), the Office of Emergency Management (OEM), the Office of Resource Conservation and Recovery (ORCR), the Office of Superfund Remediation and Technology Innovation (OSRTI), and the Office of Underground Storage Tanks (OUST).-- Performance and Environmental Results System (PERS): Includes OLEM's information on performance results and baselines for the EPA Annual Plan and Budget.--Key Performance Indicators: OLEM has identified five KPIs that are tracked annually.--Integrated Cleanup Initiative: A pilot pe

Performance of U.S. 15-Year-Old Students in Mathematics, Science, and Reading Literacy in an International Context. First Look at PISA 2012. NCES 2014-024

ERIC Educational Resources Information Center

Kelly, Dana; Nord, Christine Winquist; Jenkins, Frank; Chan, Jessica Ying; Kastberg, David

2013-01-01

The Program for International Student Assessment (PISA) is a system of international assessments that allows countries to compare outcomes of learning as students near the end of compulsory schooling. PISA core assessments measure the performance of 15-year-old students in mathematics, science, and reading literacy every 3 years. Coordinated by…

Allergy education in otolaryngology residency: a survey of program directors and residents.

PubMed

Bailey, Sarah E; Franzese, Christine; Lin, Sandra Y

2014-02-01

The purpose of this study was to survey program directors of the accredited otolaryngology residency programs and resident attendees of the 2013 American Academy of Otolaryngic Allergy (AAOA) Basic/MOC Course regarding resident education and participation as well as assessment of competency in otolaryngic allergy and immunotherapy. A multiple-choice questionnaire was sent to all accredited otolaryngology residency training programs in the United States as part of resident attendance at the 2013 AAOA CORE Basic/MOC Course. Following this, a similar multiple-choice survey was sent to all resident attendees from the programs that responded positively. Program directors reported that 73% of their academic institutions offer allergy testing and immunotherapy. More PDs than residents indicated that residents participate in allergy practice and perform/interpret skin testing and in vitro testing, and more residents (85%) than program directors (63%) reported inadequate or no allergy training. Program directors and residents equally indicated that residents do not calculate immunotherapy vial formulations or administer immunotherapy injections. The majority of program directors indicated that resident competency in allergy was assessed through direct observation, whereas residents more commonly perceived that no assessment of competency was being performed for any portion of allergy practice. This survey demonstrates a discrepancy between program directors and residents regarding resident involvement and adequacy of training in the allergy practice. Although the majority of otolaryngology residencies report offering otolaryngic allergy services and education, the vast majority of residents report inadequate allergy training and less participation in an allergy practice compared to the majority of program directors. © 2013 ARS-AAOA, LLC.

Intern evaluation strategies in family medicine residency education: what is-and is not-being done.

PubMed

Yates, Jennifer E

2013-06-01

Family medicine interns often have deficiencies that are not initially appreciated. By recognizing those growth opportunities early, programs may be able to better meet their interns' training needs. This study provides a needs assessment to ascertain what evaluation tools are being utilized by residency programs to assess their incoming interns. A questionnaire was sent to all US family medicine residency program coordinators (439 programs) via Survey Monkey© inquiring about whether intern evaluation is performed and, if so, what strategies are used. A mixed mode methodology was used: mailing with incentive, email prompts, and telephone calls. Of 439 programs, 220 (50%) responded to the survey. Most respondents (145, 66%) think intern evaluation is needed. However, only 79 (36%) programs are actually doing intern evaluations-only 14 (6.4%) extensively. Most programs are performing simulations (81, 45%) and assessing knowledge/comfort levels (79, 36%); less than one third are considering personality/learning styles, and almost no programs are evaluating skills such as typing (three, 1.4%) and math (one, 0.5%). Many programs use evaluations to guide future planning, help with early identification of challenging learners, and to match training to the residents' needs. Several programs expressed concern about how they would use the information once obtained. The majority of respondents agreed that a baseline intern evaluation is useful; few are actually doing it. This area is not well-described in the literature; residency programs could benefit from information sharing. The next step is to encourage interest in and implementation of such strategies.

Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools?

PubMed

Foster, J D; Francis, N K

2015-01-01

Assessment can improve the effectiveness of surgical training and enable valid judgments of competence. Laparoscopic colon resection surgery is now taught within surgical residency programs, and assessment tools are increasingly used to stimulate formative feedback and enhance learning. Formal assessment of technical performance in laparoscopic colon resection has been successfully applied at the specialist level in the English "LAPCO" National Training Program. Objective assessment tools need to be developed for training and assessment in laparoscopic rectal cancer resection surgery. Simulation may have a future role in assessment and accreditation in laparoscopic colorectal surgery; however, existing virtual reality models are not ready to be used for assessment of this advanced surgery.

The Linear Programming to evaluate the performance of Oral Health in Primary Care.

PubMed

Colussi, Claudia Flemming; Calvo, Maria Cristina Marino; Freitas, Sergio Fernando Torres de

2013-01-01

To show the use of Linear Programming to evaluate the performance of Oral Health in Primary Care. This study used data from 19 municipalities of Santa Catarina city that participated of the state evaluation in 2009 and have more than 50,000 habitants. A total of 40 indicators were evaluated, calculated using the Microsoft Excel 2007, and converted to the interval [0, 1] in ascending order (one indicating the best situation and zero indicating the worst situation). Applying the Linear Programming technique municipalities were assessed and compared among them according to performance curve named "quality estimated frontier". Municipalities included in the frontier were classified as excellent. Indicators were gathered, and became synthetic indicators. The majority of municipalities not included in the quality frontier (values different of 1.0) had lower values than 0.5, indicating poor performance. The model applied to the municipalities of Santa Catarina city assessed municipal management and local priorities rather than the goals imposed by pre-defined parameters. In the final analysis three municipalities were included in the "perceived quality frontier". The Linear Programming technique allowed to identify gaps that must be addressed by city managers to enhance actions taken. It also enabled to observe each municipal performance and compare results among similar municipalities.

A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course.

PubMed

Douglass, Mark A; Casale, Jillian P; Skirvin, J Andrew; DiVall, Margarita V

2013-10-14

To implement and assess the impact of a virtual patient pilot program on pharmacy students' clinical competence skills. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students' posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes.

Personality Factors Associated With Resident Performance: Results From 12 Accreditation Council for Graduate Medical Education Accredited Orthopaedic Surgery Programs.

PubMed

Phillips, Donna; Egol, Kenneth A; Maculatis, Martine C; Roloff, Kathryn S; Friedman, Alan M; Levine, Brett; Garfin, Steven; Schwartz, Alexandra; Sterling, Robert; Kuivila, Thomas; Paragioudakis, Steve J; Zuckerman, Joseph D

To understand the personality factors associated with orthopedic surgery resident performance. A prospective, cross-sectional survey of orthopedic surgery faculty that assessed their perceptions of the personality traits most highly associated with resident performance. Residents also completed a survey to determine their specific personality characteristics. A subset of faculty members rated the performance of those residents within their respective program on 5 dimensions. Multiple regression models tested the relationship between the set of resident personality measures and each aspect of performance; relative weights analyses were then performed to quantify the contribution of the individual personality measures to the total variance explained in each performance domain. Independent samples t-tests were conducted to examine differences between the personality characteristics of residents and those faculty identified as relevant to successful resident performance. Data were collected from 12 orthopedic surgery residency programs 1 throughout the United States. The level of clinical care provided by participating institutions varied. Data from 175 faculty members and 266 residents across 12 programs were analyzed. The personality features of residents were related to faculty evaluations of resident performance (for all, p < 0.01); the full set of personality measures accounted for 4%-11% of the variance in ratings of resident performance. Particularly, the characteristics of agreeableness, neuroticism, and learning approach were found to be most important for explaining resident performance. Additionally, there were significant differences between the personality features that faculty members identified as important for resident performance and the personality features that residents possessed. Personality assessments can predict orthopedic surgery resident performance. However, results suggest the traits that faculty members value or reward among residents could be different from the traits associated with improved resident performance. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Relations between Student Perceptions of Assessment Authenticity, Study Approaches and Learning Outcome

ERIC Educational Resources Information Center

Gulikers, Judith T. M.; Bastiaens, Theo J.; Kirschner, Paul A.; Kester, Liesbeth

2006-01-01

This article examines the relationships between perceptions of authenticity and alignment on study approach and learning outcome. Senior students of a vocational training program performed an authentic assessment and filled in a questionnaire about the authenticity of various assessment characteristics and the alignment between the assessment and…

The APU and Assessment in the Middle Years.

ERIC Educational Resources Information Center

Marjoram, D. T. E.

1978-01-01

Because of student characteristics in the middle years, several types of assessment are needed. The national monitoring system being developed by the Assessment of Performance Unit (APU) may prove a useful assessment framework for individual schools, providing developmental data for program comparisons and student movement between schools. (SJL)

Bloomington Writing Assessment 1977; Student Exercise, Teacher Directions, Scoring.

ERIC Educational Resources Information Center

Bloomington Public Schools, MN.

This booklet contains the 14 exercises that are used in the Bloomington, Minnesota, school system's writing assessment program. Depending on their applicability, the exercises may be used to assess the writing performance of fourth-, eighth-, or eleventh-grade students. Thirteen of the exercises are from the National Assessment of Educational…

Road weather management program performance metrics : implementation and assessment.

DOT National Transportation Integrated Search

2009-08-31

Since the late 1990s, the U.S. Department of Transportation (USDOT), Federal Highway Administration (FHWA) has managed a program dedicated to improving the safety, mobility and productivity of the nations surface transportation modes by integra...

Implementing a statewide rideshare and vanpool program in Arizona

DOT National Transportation Integrated Search

2008-06-01

This research investigated the potential for a statewide ridesharing and vanpool program for Arizona By performing a literature review, surveying other state DOTs and conducting a needs assessment, the research investigated the need for, logistics of...

Examining quality improvement programs: the case of Minnesota hospitals.

PubMed

Olson, John R; Belohlav, James A; Cook, Lori S; Hays, Julie M

2008-10-01

To determine if there is a hierarchy of improvement program adoption by hospitals and outline that hierarchy. Primary data were collected in the spring of 2007 via e-survey from 210 individuals representing 109 Minnesota hospitals. Secondary data from 2006 were assembled from the Leapfrog database. As part of a larger survey, respondents were given a list of improvement programs and asked to identify those programs that are used in their hospital. DATA COLLECTION/DATA EXTRACTION: Rasch Model Analysis was used to assess whether a unidimensional construct exists that defines a hospital's ability to implement performance improvement programs. Linear regression analysis was used to assess the relationship of the Rasch ability scores with Leapfrog Safe Practices Scores to validate the research findings. Principal Findings. The results of the study show that hospitals have widely varying abilities in implementing improvement programs. In addition, improvement programs present differing levels of difficulty for hospitals trying to implement them. Our findings also indicate that the ability to adopt improvement programs is important to the overall performance of hospitals. There is a hierarchy of improvement programs in the health care context. A hospital's ability to successfully adopt improvement programs is a function of its existing capabilities. As a hospital's capability increases, the ability to successfully implement higher level programs also increases.

Exer-Genie(Registered Trademark) Exercise Device Hardware Evaluation

NASA Technical Reports Server (NTRS)

Schaffner, Grant; Sharp,Carwyn; Stroud, Leah

2008-01-01

An engineering evaluation was performed on the ExerGenie(r) exercise device to quantify its capabilities and limitations to address questions from the Constellation Program. Three subjects performed rowing and circuit training sessions to assess the suitability of the device for aerobic exercise. Three subjects performed a resistive exercise session to assess the suitability of the device for resistive exercise. Since 1 subject performed both aerobic and resistive exercise sessions, a total of 5 subjects participated.

Reserve Component Programs, Fiscal Year 1992: Annual Report of the Reserve Forces Policy Board

DTIC Science & Technology

1993-01-01

serve components. (q 66 Reserve IFrmes Polut , i(oard k’e’re (, 0inmpontt PJatwrnm.s I 9’)𔃼 Ot!!S Training and Mobilization Readiness9 "trained people...requested for use. Additionally, activities enforcing command compliance. Each program are now required to perform a self- audit on a is subject to...visits, Environmental Compliance Assessment and coordination and cooperation with other Management Program audits performed by the agencies, policy and

Flight performance measurement utilizing a figure of merit (FOM)

NASA Technical Reports Server (NTRS)

Mosier, Kathleen L.; Zacharias, Greg L.

1993-01-01

One of the goals of the NASA Strategic Behavior/Workload Management Program is to develop standardized procedures for constructing figures of merit (FOMs) that describe minimal criteria for flight task performance, as well as summarize overall performance quality. Such a measure could be utilized for evaluating flight crew performance, for assessing the effectiveness of new equipment or technological innovations, or for measuring performance at a particular airport. In this report, we describe the initial phases in the creation of a FOM to be employed in examining crew performance in NASA-Ames Air Ground Compatibility and Strategic Behavior/Workload Management programs.

Intensive care nurses' knowledge of pressure ulcers: development of an assessment tool and effect of an educational program.

PubMed

Tweed, Carol; Tweed, Mike

2008-07-01

Critically ill patients are at high risk for pressure ulcers. Successful prevention of pressure ulcers requires that caregivers have adequate knowledge of this complication. To assess intensive care nurses' knowledge of pressure ulcers and the impact of an educational program on knowledge levels. A knowledge assessment test was developed. A cohort of registered nurses in a tertiary referral hospital in New Zealand had knowledge assessed 3 times: before an educational program, within 2 weeks after the program, and 20 weeks later. Multivariate analysis was performed to determine if attributes such as length of time since qualifying or level of intensive care unit experience were associated with test scores. The content and results of the assessment test were evaluated. Completion of the educational program resulted in improved levels of knowledge. Mean scores on the assessment test were 84% at baseline and 89% following the educational program. The mean baseline score did not differ significantly from the mean 20-week follow-up score of 85%. No association was detected between demographic data and test scores. Content validity and standard setting were verified by using a variety of methods. Levels of knowledge to prevent and manage pressure ulcers were good initially and improved with an educational program, but soon returned to baseline.

Typical balance exercises or exergames for balance improvement?

PubMed

Gioftsidou, Asimenia; Vernadakis, Nikolaos; Malliou, Paraskevi; Batzios, Stavros; Sofokleous, Polina; Antoniou, Panagiotis; Kouli, Olga; Tsapralis, Kyriakos; Godolias, George

2013-01-01

Balance training is an effective intervention to improve static postural sway and balance. The purpose of the present study was to investigate the effectiveness of the Nintendo Wii Fit Plus exercises for improving balance ability in healthy collegiate students in comparison with a typical balance training program. Forty students were randomly divided into two groups, a traditional (T group) and a Nintendo Wii group (W group) performed an 8 week balance program. The "W group" used the interactive games as a training method, while the "T group" used an exercise program with mini trampoline and inflatable discs (BOSU). Pre and Post-training participants completed balance assessments. Two-way repeated measures analyses of variance (ANOVAs) were conducted to determine the effect of training program. Analysis of the data illustrated that both training program groups demonstrated an improvement in Total, Anterior-posterior and Medial Lateral Stability Index scores for both limbs. Only at the test performed in the balance board with anterior-posterior motion, the improvement in balance ability was greater in the "T group" than the "W group", when the assessment was performed post-training (p=0.023). Findings support the effectiveness of using the Nintendo Wii gaming console as a balance training intervention tool.

Veterans Justice Outreach Program: VA Could Improve Management by Establishing Performance Measures and Fully Assessing Risks

DTIC Science & Technology

2016-04-01

Assessing Risks Report to Congressional Requesters April 2016 GAO-16-393 United States Government Accountability Office United States...Government Accountability Office Highlights of GAO-16-393, a report to congressional requesters April 2016 VETERANS JUSTICE OUTREACH PROGRAM...quality, timeliness, efficiency, cost of service, and outcome. GAO, Tax Administration: IRS Needs to Further Refine Its Tax Filing Season

The Rise and Fall of a Standards Based Spelling Assessment: Did Spelling Improve or Is it Just Another Case of Teaching to the Test?

ERIC Educational Resources Information Center

Fenton, Ray; Stofflet, Fred; Straugh, Tom

This paper reports the creation, implementation, and discontinuation of a standards based spelling assessment program in Anchorage, Alaska. The program was initiated by the Anchorage school board as part of establishing district-wide performance goals for students in 1998-1999. Spelling was singled out for attention because of national discussions…

The Impact of Academic Vocabulary Instruction on Reading Performance of Sophomore Students on the Florida Comprehensive Assessment Test from 2008 and 2009

ERIC Educational Resources Information Center

McMillen, Margaret

2009-01-01

This study investigated the change in sophomore reading scores on the Florida Comprehensive Assessment Test after the implementation of an academic vocabulary program and the change in teacher knowledge and professional practice after a program of staff development in academic vocabulary. The purpose was to determine if the impact of the…

Army Enlisted Personnel Competency Assessment Program: Phase III Pilot Tests

DTIC Science & Technology

2007-03-01

Officer’s Representatives and Subject Matter POCs: Tonia Heffner and Peter Greenston Contract for Manpower, Personnel, Leader Development, and Training ...3926 March 2007 Army Project Number Personnel Performance 622785A790 and Training Technology Approved for public release; distribution is unlimited. 111...8217 ARMY ENLISTED PERSONNEL COMPETENCY ASSESSMENT PROGRAM: PHASE III PILOT TESTS EXECUTIVE SUMMARY Research Requirement: The Army Training and Leader

Assessment of Graduate Teaching Assistant (GTA) Training: A Case Study of a Training Program and Its Impact on GTAs

ERIC Educational Resources Information Center

Young, Stacy L.; Bippus, Amy M.

2008-01-01

Graduate teaching associates (GTAs) play a vital role as instructors at many universities but often are not confident in their ability to perform their job-related duties. Based on Bandura's (1997) theory of self-efficacy, this project examined a teacher-training program for GTAs and assessed its outcomes. Our results revealed that GTAs reported…

Commonly Unrecognized Error Variance in Statewide Assessment Programs: Sources of Error Variance and What Can Be Done to Reduce Them

ERIC Educational Resources Information Center

Brockmann, Frank

2011-01-01

State testing programs today are more extensive than ever, and their results are required to serve more purposes and high-stakes decisions than one might have imagined. Assessment results are used to hold schools, districts, and states accountable for student performance and to help guide a multitude of important decisions. This report describes…

[The effect of an exercise program to strengthen pelvic floor muscles in multiparous women].

PubMed

Assis, Thaís Rocha; Sá, Ana Claudia Antonio Maranhão; Amaral, Waldemar Naves do; Batista, Elicéia Marcia; Formiga, Cibelle Kayenne Martins Roberto; Conde, Délio Marques

2013-01-01

To investigate the effect of an individualized and supervised exercise program for the pelvic floor muscles (PFM) in the postpartum period of multiparous women, and to verify the correlation between two methods used to assess PFM strength. An open clinical trial was performed with puerperal, multiparous women aged 18 to 35 years. The sample consisted of 23 puerperal women divided into two groups: Intervention Group (IG, n=11) and Control Group (CG, n=12). The puerperal women in IG participated in an eight-week PFM exercise program, twice a week. The puerperal women in CG did not receive any recommendations regarding exercise. PFM strength was assessed using digital vaginal palpation and a perineometer. The statistical analysis was performed using the following tests: Fisher's exact, χ(2), Student's t, Kolmogorov-Smirnov for two samples, and Pearson's correlation coefficient. Significance was defined as p<0.05. The participants' mean age was 24 ± 4.5 years in IG and 25.3 ± 4 years in CG (p=0.4). After the exercise program, a significant difference was found between the groups in both modalities of muscle strength assessment (p<0.001). The two muscle strength assessment methods showed a significant correlation in both assessments (1(st) assessment: r=0.889, p<0.001; 2(nd) assessment: r=0.925, p<0.001). The exercise program promoted a significant improvement in PFM strength. Good correlation was observed between digital vaginal palpation and a perineometer, which indicates that vaginal palpation can be used in clinical practice, since it is an inexpensive method that demonstrated significant correlation with an objective method, i.e. the use of a perioneometer.

Assessment of aerodynamic performance of V/STOL and STOVL fighter aircraft

NASA Technical Reports Server (NTRS)

Nelms, W. P.

1984-01-01

The aerodynamic performance of V/STOL and STOVL fighter/attack aircraft was assessed. Aerodynamic and propulsion/airframe integration activities are described and small and large scale research programs are considered. Uncertainties affecting aerodynamic performance that are associated with special configuration features resulting from the V/STOL requirement are addressed. Example uncertainties relate to minimum drag, wave drag, high angle of attack characteristics, and power induced effects.

CCTV Data Management for Effective Condition Assessment of Wastewater Collection Systems

EPA Science Inventory

Condition assessment provides critical information for determining an asset’s physical condition, remaining useful service life, and long-term performance. Data management issues integral to a successful condition assessment program are described in this paper. Key points are i...

A content analysis of Health Technology Assessment programs in Latin America.

PubMed

Arellano, Luis E; Reza, Mercedes; Blasco, Juan Antonio; Andradas, Elena

2009-10-01

Health Technology Assessment (HTA) is a relatively new concept in Latin America (LA). The objectives of this exploratory study were to identify HTA programs in LA, review HTA documents produced by those programs, and assess the extent to which HTA aims are being achieved. An electronic search through two databases was performed to identify HTA programs in LA. A content analysis was performed on HTA documents (n = 236) produced by six programs between January 2000 and March 2007. Results were analyzed by comparing document content with the main goals of HTA. The number of HTA documents increased incrementally during the study period. The documents produced were mostly short HTA documents (82 percent) that assessed technologies such as drugs (31 percent), diagnostic and/or screening technologies (18 percent), or medical procedures (18 percent). Two-thirds (66 percent) of all HTA documents addressed issues related to clinical effectiveness and economic evaluations. Ethical, social, and/or legal issues were rarely addressed (<1 percent). The two groups most often targeted for dissemination of HTA information were third-party payers (55 percent) or government policy makers (41 percent). This study showed that while HTA programs in LA have attempted to address the main goals of HTA, they have done so through the production of short documents that focus on practical high-technology areas of importance to two specific target groups. Clinical and economic considerations still take precedence over ethical, social, and/or legal issues. Thus, an integrated conceptual framework in LA is wanting.

Comparison of national mental health quality assessment programs across the globe.

PubMed

Parameswaran, Sharat; Spaeth-Rublee, Brigitta; Huynh, Phuong Trang; Pincus, Harold Alan

2012-10-01

This study by the International Initiative for Mental Health Leadership Clinical Leaders Project sought to describe ongoing or soon-to-be-established national-level mental health quality measurement programs in 12 participating countries, in order to understand the nature and structure of these programs. A survey was distributed to representatives from the participating countries (Australia, Canada, England, Germany, Ireland, Japan, the Netherlands, New Zealand, Norway, Scotland, Taiwan, and the United States). Data included descriptions of qualifying programs and the organizations responsible for them, quality indicators used, entities assessed, sources and means of the programs' data collection, the level at which data are reported, and how the data are used. Participants were asked to identify which quality domains and subdomains were represented by indicators in each program. Results were analyzed with descriptive statistics. Thirty-eight programs were identified. Most programs were administered by governmental organizations, focused on hospital care, and used encounter or utilization databases as sources of information. Programs used different methods to identify indicators. Program data were used for various purposes. A wide range of domains of quality were represented in the programs reported, although most commonality was seen in domains associated with high-acuity care, with fewer programs assessing recovery-related domains. This study found wide variation among established quality assessment programs, which may reflect a focus on local priorities. The goal of this project is to work toward establishing an international framework for mental health quality assessment and thus a means to compare key measures of performance across countries.

Using distance technologies to facilitate a learning collaborative to implement stagewise treatment.

PubMed

Covell, Nancy H; Foster, Forrest P; Margolies, Paul J; Lopez, Luis O; Dixon, Lisa B

2015-06-01

This report describes experiences and outcomes of an online learning collaborative focused on implementation of stagewise treatment. Eleven participating programs convened online monthly for a year. Between meetings, program staff created an implementation plan and programs collected performance indicator data, including assessment of staff knowledge of integrated treatment for people with co-occurring disorders, whether a person's current stage of treatment was documented in his or her chart, and whether the treatments were appropriate for the stage of treatment. Descriptive statistics were used to characterize performance indicators and feedback. Wilcoxon matched-pairs signed-rank tests examined changes in performance indicators over time. Program staff generally demonstrated significant improvements in performance indicators over time and rated the distance learning collaborative favorably. Distance learning collaboratives can be structured to provide opportunities for program staff to interact and learn from one another and to implement and sustain changes.

Advanced Technology Composite Fuselage-Structural Performance

NASA Technical Reports Server (NTRS)

Walker, T. H.; Minguet, P. J.; Flynn, B. W.; Carbery, D. J.; Swanson, G. D.; Ilcewicz, L. B.

1997-01-01

Boeing is studying the technologies associated with the application of composite materials to commercial transport fuselage structure under the NASA-sponsored contracts for Advanced Technology Composite Aircraft Structures (ATCAS) and Materials Development Omnibus Contract (MDOC). This report addresses the program activities related to structural performance of the selected concepts, including both the design development and subsequent detailed evaluation. Design criteria were developed to ensure compliance with regulatory requirements and typical company objectives. Accurate analysis methods were selected and/or developed where practical, and conservative approaches were used where significant approximations were necessary. Design sizing activities supported subsequent development by providing representative design configurations for structural evaluation and by identifying the critical performance issues. Significant program efforts were directed towards assessing structural performance predictive capability. The structural database collected to perform this assessment was intimately linked to the manufacturing scale-up activities to ensure inclusion of manufacturing-induced performance traits. Mechanical tests were conducted to support the development and critical evaluation of analysis methods addressing internal loads, stability, ultimate strength, attachment and splice strength, and damage tolerance. Unresolved aspects of these performance issues were identified as part of the assessments, providing direction for future development.

Development of a home-based training program for post-ward geriatric rehabilitation patients with cognitive impairment: study protocol of a randomized-controlled trail.

PubMed

Bongartz, Martin; Kiss, Rainer; Ullrich, Phoebe; Eckert, Tobias; Bauer, Jürgen; Hauer, Klaus

2017-09-12

Geriatric patients with cognitive impairment (CI) show an increased risk for a negative rehabilitation outcome and reduced functional recovery following inpatient rehabilitation. Despite this obvious demand, evidence-based training programs at the transition from rehabilitation to the home environments are lacking. The aim of this study is to evaluate the efficacy of a feasible and cost-effective home-based training program to improve motor performance and to promote physical activity, specifically-tailored for post-ward geriatric patients with CI. A sample of 101 geriatric patients with mild to moderate stage CI following ward-based rehabilitation will be recruited for a blinded, randomized controlled trial with two arms. The intervention group will conduct a 12 week home-based training, consisting of (1) Exercises to improve strength/power, and postural control; (2) Individual walking trails to enhance physical activity; (3) Implementation of patient-specific motivational strategies to promote behavioral changes. The control group will conduct 12 weeks of unspecific flexibility exercise. Both groups will complete a baseline measurement before starting the program, at the end of the intervention, and after 24 weeks for follow-up. Sensor-based as well as questionnaire-based measures will be applied to comprehensively assess intervention effects. Primary outcomes document motor performance, assessed by the Short Physical Performance Battery, and level of physical activity (PA), as assessed by duration of active episodes (i.e., sum of standing and walking). Secondary outcomes include various medical, psycho-social, various PA and motor outcomes, including sensor-based assessment as well as cost effectiveness. Our study is among the first to provide home-based training in geriatric patients with CI at the transition from a rehabilitation unit to the home environment. The program offers several unique approaches, e.g., a comprehensive and innovative assessment strategy and the integration of individually-tailored motivational strategies. We expect the program to be safe and feasible in geriatric patients with CI with the potential to enhance the sustainability of geriatric rehabilitation programs in patients with CI. International Standard Randomized Controlled Trial (# ISRCTN82378327 ). Registered: August 10, 2015.

The relationship between faculty performance assessment and results on the in-training examination for residents in an emergency medicine training program.

PubMed

Ryan, James G; Barlas, David; Pollack, Simcha

2013-12-01

Medical knowledge (MK) in residents is commonly assessed by the in-training examination (ITE) and faculty evaluations of resident performance. We assessed the reliability of clinical evaluations of residents by faculty and the relationship between faculty assessments of resident performance and ITE scores. We conducted a cross-sectional, observational study at an academic emergency department with a postgraduate year (PGY)-1 to PGY-3 emergency medicine residency program, comparing summative, quarterly, faculty evaluation data for MK and overall clinical competency (OC) with annual ITE scores, accounting for PGY level. We also assessed the reliability of faculty evaluations using a random effects, intraclass correlation analysis. We analyzed data for 59 emergency medicine residents during a 6-year period. Faculty evaluations of MK and OC were highly reliable (κ  =  0.99) and remained reliable after stratification by year of training (mean κ  =  0.68-0.84). Assessments of resident performance (MK and OC) and the ITE increased with PGY level. The MK and OC results had high correlations with PGY level, and ITE scores correlated moderately with PGY. The OC and MK results had a moderate correlation with ITE score. When residents were grouped by PGY level, there was no significant correlation between MK as assessed by the faculty and the ITE score. Resident clinical performance and ITE scores both increase with resident PGY level, but ITE scores do not predict resident clinical performance compared with peers at their PGY level.

The Relationship Between Faculty Performance Assessment and Results on the In-Training Examination for Residents in an Emergency Medicine Training Program

PubMed Central

Ryan, James G.; Barlas, David; Pollack, Simcha

2013-01-01

Background Medical knowledge (MK) in residents is commonly assessed by the in-training examination (ITE) and faculty evaluations of resident performance. Objective We assessed the reliability of clinical evaluations of residents by faculty and the relationship between faculty assessments of resident performance and ITE scores. Methods We conducted a cross-sectional, observational study at an academic emergency department with a postgraduate year (PGY)-1 to PGY-3 emergency medicine residency program, comparing summative, quarterly, faculty evaluation data for MK and overall clinical competency (OC) with annual ITE scores, accounting for PGY level. We also assessed the reliability of faculty evaluations using a random effects, intraclass correlation analysis. Results We analyzed data for 59 emergency medicine residents during a 6-year period. Faculty evaluations of MK and OC were highly reliable (κ  =  0.99) and remained reliable after stratification by year of training (mean κ  =  0.68–0.84). Assessments of resident performance (MK and OC) and the ITE increased with PGY level. The MK and OC results had high correlations with PGY level, and ITE scores correlated moderately with PGY. The OC and MK results had a moderate correlation with ITE score. When residents were grouped by PGY level, there was no significant correlation between MK as assessed by the faculty and the ITE score. Conclusions Resident clinical performance and ITE scores both increase with resident PGY level, but ITE scores do not predict resident clinical performance compared with peers at their PGY level. PMID:24455005

Predicting academic performance in surgical training.

PubMed

Yost, Michael J; Gardner, Jeffery; Bell, Richard McMurtry; Fann, Stephen A; Lisk, John R; Cheadle, William G; Goldman, Mitchell H; Rawn, Susan; Weigelt, John A; Termuhlen, Paula M; Woods, Randy J; Endean, Erick D; Kimbrough, Joy; Hulme, Michael

2015-01-01

During surgical residency, trainees are expected to master all the 6 competencies specified by the ACGME. Surgical training programs are also evaluated, in part, by the residency review committee based on the percentage of graduates of the program who successfully complete the qualifying examination and the certification examination of the American Board of Surgery in the first attempt. Many program directors (PDs) use the American Board of Surgery In-Training Examination (ABSITE) as an indicator of future performance on the qualifying examination. Failure to meet an individual program's standard may result in remediation or a delay in promotion to the next level of training. Remediation is expensive in terms of not only dollars but also resources, faculty time, and potential program disruptions. We embarked on an exploratory study to determine if residents who might be at risk for substandard performance on the ABSITE could be identified based on the individual resident's behavior and motivational characteristics. If such were possible, then PDs would have the opportunity to be proactive in developing a curriculum tailored to an individual resident, providing a greater opportunity for success in meeting the program's standards. Overall, 7 surgical training programs agreed to participate in this initial study and residents were recruited to voluntarily participate. Each participant completed an online assessment that characterizes an individual's behavioral style, motivators, and Acumen Index. Residents completed the assessment using a code name assigned by each individual PD or their designee. Assessments and the residents' 2013 ABSITE scores were forwarded for analysis using only the code name, thus insuring anonymity. Residents were grouped into those who took the junior examination, senior examination, and pass/fail categories. A passing score of ≥70% correct was chosen a priori. Correlations were performed using logistic regression and data were also entered into a neural network (NN) to develop a model that would explain performance based on data obtained from the TriMetrix assessments. A total of 117 residents' TriMetrix and ABSITE scores were available for analysis. They were divided into 2 groups of 64 senior residents and 53 junior residents. For each group, the pass/fail criteria for the ABSITE were set at 70 and greater as passing and 69 and lower as failing. Multiple logistic regression analysis was complete for pass/fail vs the TriMetrix assessments. For the senior data group, it was found that the parameter Theoretical correlates with pass rate (p < 0.043, B = -0.513, exp(B) = 0.599), which means increasing theoretical scores yields a decreasing likelihood of passing in the examination. For the junior data, the parameter Internal Role Awareness correlated with pass/fail rate (p < 0.004, B = 0.66, exp(B) = 1.935), which means that an increasing Internal Role Awareness score increases the likelihood of a passing score. The NN was able to be trained to predict ABSITE performance with surprising accuracy for both junior and senior residents. Behavioral, motivational, and acumen characteristics can be useful to identify residents "at risk" for substandard performance on the ABSITE. Armed with this information, PDs have the opportunity to intervene proactively to offer these residents a greater chance for success. The NN was capable of developing a model that explained performance on the examination for both the junior and the senior examinations. Subsequent testing is needed to determine if the NN is a good predictive tool for performance on this examination. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Effect of Home Exercise Program Performance in Patients with Osteoarthritis of the Knee or the Spine on the Visual Analog Scale after Discharge from Physical Therapy

ERIC Educational Resources Information Center

Chen, Hamilton; Onishi, Kentaro

2012-01-01

The aim of our study was to assess the effect of the frequency of home exercise program (HEP) performance on pain [10-point visual analog scale (VAS)] in patients with osteoarthritis of the spine or knee after more than 6 months discharge from physical therapy (PT). We performed a retrospective chart review of 48 adult patients with a clinical…

A Needs Assessment of Brain Death Education in Pediatric Critical Care Medicine Fellowships.

PubMed

Ausmus, Andrew M; Simpson, Pippa M; Zhang, Liyun; Petersen, Tara L

2018-04-12

To assess the current training in brain death examination provided during pediatric critical care medicine fellowship. Internet-based survey. United States pediatric critical care medicine fellowship programs. Sixty-four pediatric critical care medicine fellowship program directors and 230 current pediatric critical care medicine fellows/recent graduates were invited to participate. Participants were asked demographic questions related to their fellowship programs, training currently provided at their fellowship programs, previous experience with brain death examinations (fellows/graduates), and perceptions regarding the adequacy of current training. Twenty-nine program directors (45%) and 91 current fellows/graduates (40%) responded. Third-year fellows reported having performed a median of five examinations (interquartile range, 3-6). On a five-point Likert scale, 93% of program directors responded they "agree" or "strongly agree" that their fellows receive enough instruction on performing brain death examinations compared with 67% of fellows and graduates (p = 0.007). The responses were similar when asked about opportunity to practice brain death examinations (90% vs 54%; p < 0.001). In a regression tree analysis, number of brain death examinations performed was the strongest predictor of trainee satisfaction. Both fellows and program directors preferred bedside demonstration or simulation as educational modalities to add to the fellowship curriculum. Pediatric critical care medicine fellows overall perform relatively few brain death examinations during their training. Pediatric critical care medicine fellows and program directors disagree in their perceptions of the current training in brain death examination, with fellows perceiving a need for increased training. Both program directors and fellows prefer additional training using bedside demonstration or simulation. Since clinical exposure to brain death examinations is variable, adding simulated brain death examinations to the pediatric critical care medicine fellowship curriculum could help standardize the experience.

Retrospective Analysis of an Ongoing Group-Based Modified Constraint-Induced Movement Therapy Program for Children with Acquired Brain Injury.

PubMed

Komar, Alyssa; Ashley, Kelsey; Hanna, Kelly; Lavallee, Julia; Woodhouse, Janet; Bernstein, Janet; Andres, Matthew; Reed, Nick

2016-01-01

A pretest-posttest retrospective design was used to evaluate the impact of a group-based modified constraint-induced movement therapy (mCIMT) program on upper extremity function and occupational performance. 20 children ages 3 to 18 years with hemiplegia following an acquired brain injury participated in a 2-week group mCIMT program. Upper extremity function was measured with the Assisting Hand Assessment (AHA) and subtests from the Quality of Upper Extremity Skills Test (QUEST). Occupational performance and satisfaction were assessed using the Canadian Occupational Performance Measure (COPM). Data were analyzed using a Wilcoxon signed-ranks test. Group-based analysis revealed upper extremity function and occupational performance attained statistically significant improvements from pre- to postintervention on all outcome measures (AHA: Z = -3.63, p = <.001; QUEST Grasps: Z = -3.10, p = .002; QUEST Dissociated Movement: Z = -2.51, p = .012; COPM Performance: Z = -3.64, p = <.001; COPM Satisfaction: Z = -3.64, p = <.001). Across individuals, clinically significant improvements were found in 65% of participants' AHA scores. 80% of COPM Performance scores and 70% of COPM Satisfaction scores demonstrated clinically significant improvements in at least one identified goal. This study is an initial step in evaluating and providing preliminary evidence supporting the effectiveness of a group-based mCIMT program for children with hemiplegia following an acquired brain injury.

Why They Stayed: Near-Perfect Retention in an Online Certification Program in Library Media

ERIC Educational Resources Information Center

Meyer, Katrina A.; Bruwelheide, Janis; Poulin, Russell

2009-01-01

This paper focuses on an assessment of an online certification program in K-12 library media which has a near-perfect record of retaining students. Students and graduates of the program were asked to identify reasons for enrolling (and staying enrolled) in the program as well as functions that faculty performed well. These reasons were drawn upon…

Audit Report. Bilingual/Migrant Education Program, et al. School Program Services, Department of Education, October 1, 1978 through September 30, 1983.

ERIC Educational Resources Information Center

Pinkelman, Franklin C.

Selected financial and program records of nine administrative units of Michigan's Bilingual/Migrant Education Program from October 1, 1978 through September 30, 1983 were examined in an audit to assess fairness of fund allocation, compliance with appropriate laws and regulations, adequacy of administrative performance, and priority of school…

Design choices made by target users for a pay-for-performance program in primary care: an action research approach.

PubMed

Kirschner, Kirsten; Braspenning, Jozé; Jacobs, J E Annelies; Grol, Richard

2012-03-27

International interest in pay-for-performance (P4P) initiatives to improve quality of health care is growing. Current programs vary in the methods of performance measurement, appraisal and reimbursement. One may assume that involvement of health care professionals in the goal setting and methods of quality measurement and subsequent payment schemes may enhance their commitment to and motivation for P4P programs and therefore the impact of these programs. We developed a P4P program in which the target users were involved in decisions about the P4P methods. For the development of the P4P program a framework was used which distinguished three main components: performance measurement, appraisal and reimbursement. Based on this framework design choices were discussed in two panels of target users using an adapted Delphi procedure. The target users were 65 general practices and two health insurance companies in the South of the Netherlands. Performance measurement was linked to the Dutch accreditation program based on three domains (clinical care, practice management and patient experience). The general practice was chosen as unit of assessment. Relative standards were set at the 25th percentile of group performance. The incentive for clinical care was set twice as high as the one for practice management and patient experience. Quality scores were to be calculated separately for all three domains, and for both the quality level and the improvement of performance. The incentive for quality level was set thrice as high as the one for the improvement of performance. For reimbursement, quality scores were divided into seven levels. A practice with a quality score in the lowest group was not supposed to receive a bonus. The additional payment grew proportionally for each extra group. The bonus aimed at was on average 5% to 10% of the practice income. Designing a P4P program for primary care with involvement of the target users gave us an insight into their motives, which can help others who need to discuss similar programs. The resulting program is in line with target users' views and assessments of relevance and applicability. This may enhance their commitment to the program as was indicated by the growing number of voluntary participants after a successfully performed field test during the procedure. The elements of our framework can be very helpful for others who are developing or evaluating a P4P program.

Correspondence between Video-Based Preference Assessment and Subsequent Community Job Performance

ERIC Educational Resources Information Center

Morgan, Robert L.; Horrocks, Erin L.

2011-01-01

Researchers identified high and low preference jobs using a video web-based assessment program with three young adults ages 18 to 19 with intellectual disabilities. Individual participants were then taught to perform high and low preference jobs in community locations. The order of 25-min high and low preference job sessions was randomized. A…

Performance-Based Assessment in an Online Course: Comparing Different Types of Information Literacy Instruction

ERIC Educational Resources Information Center

Mery, Yvonne; Newby, Jill; Peng, Ke

2012-01-01

This study investigates whether the type of instruction (a single face-to-face librarian-led instruction, instructor-led instruction, or an online IL course--the Online Research Lab) has an impact on student information literacy gains in a Freshman English Composition program. A performance-based assessment was carried out by analyzing…

Automated Pilot Performance Assessment in the T-37: A Feasibility Study. Final Report (May 1968-April 1971).

ERIC Educational Resources Information Center

Knoop, Patricia A.; Welde, William L.

Air Force investigators conducted a three year program to develop a capability for automated quantification and assessment of in-flight pilot performance. Such a capability enhances pilot training by making ratings more objective, valid, reliable and sensitive, and by freeing instructors from rating responsibilities, allowing them to concentrate…

An Exploration of Reasons for Shanghai's Success in the OECD Program for International Student Assessment (PISA) 2009

ERIC Educational Resources Information Center

Minxuan, Zhang; Lingshuai, Kong

2012-01-01

The outstanding performance of Shanghai students in the 4th Programme for International Student Assessment (PISA 2009) gained widespread attention at home and abroad. In this paper, the authors attribute this outstanding performance to three traditional factors and six modern factors. The traditional factors are high parental expectations, belief…

Development of a high-value care subscore on the internal medicine in-training examination.

PubMed

Ryskina, Kira L; Korenstein, Deborah; Weissman, Arlene; Masters, Philip; Alguire, Patrick; Smith, Cynthia D

2014-11-18

Although high-value care (HVC) that balances benefits of tests or treatments against potential harms and costs has been a recently emphasized competency for internal medicine (IM) residents, few tools to assess residents' knowledge of HVC are available. To describe the development and initial results of an HVC subscore of the Internal Medicine In-Training Examination (IM-ITE). The HVC concepts were introduced to IM-ITE authors during question development. Three physicians independently reviewed each examination question for selection in the HVC subscore according to 6 HVC principles. The final subscore was determined by consensus. Data from the IM-ITE administered in October 2012 were analyzed at the program level. U.S. IM residency programs. 362 U.S. IM residency programs with IM-ITE data for at least 10 residents. Program-level performance on the HVC subscore was compared with performance on the overall IM-ITE, the Dartmouth Atlas hospital care intensity (HCI) index of the program's primary training hospital, and residents' attitudes about HVC assessed with a voluntary survey. The HVC subscore comprised 38 questions, including 21 (55%) on managing conservatively when appropriate and 14 (37%) on identifying low-value care. Of the 362 U.S. IM programs in the sample, 41% were in a different quartile when ranked based on the HVC subscore compared with overall IM-ITE performance. Rankings by HVC subscore and HCI index were modestly inversely associated, with 30% of programs ranked in the same quartile based on both measures. Knowledge of HVC assessed from examination vignettes may not reflect practice of HVC. Although the HVC subscore has face validity and can contribute to evaluation of residents' HVC knowledge, additional tools are needed to accurately measure residents' proficiency in HVC. None.

Residency Programs' Evaluations of the Competencies: Data Provided to the ACGME About Types of Assessments Used by Programs

PubMed Central

Holt, Kathleen D.; Miller, Rebecca S.; Nasca, Thomas J.

2010-01-01

Background In 1999, the Accreditation Council for Graduate Medical Education (ACGME) Outcome Project began to focus on resident performance in the 6 competencies of patient care, medical knowledge, professionalism, practice-based learning and improvement, interpersonal communication skills, and professionalism. Beginning in 2007, the ACGME began collecting information on how programs assess these competencies. This report provides information on the nature and extent of those assessments. Methods Using data collected by the ACGME for site visits, we use descriptive statistics and percentages to describe the number and type of methods and assessors accredited programs (n  =  4417) report using to assess the competencies. Observed differences among specialties, methodologies, and assessors are tested with analysis of variance procedures. Results Almost all (>97%) of programs report assessing all of the competencies and using multiple methods and multiple assessors. Similar assessment methods and evaluator types were consistently used across the 6 competencies. However, there were some differences in the use of patient and family as assessors: Primary care and ambulatory specialties used these to a greater extent than other specialties. Conclusion Residency programs are emphasizing the competencies in their evaluation of residents. Understanding the scope of evaluation methodologies that programs use in resident assessment is important for both the profession and the public, so that together we may monitor continuing improvement in US graduate medical education. PMID:22132294

User manual and spreadsheet tool for implementing performance planning for rural planning organizations.

DOT National Transportation Integrated Search

2017-03-01

The performance-planning tool developed as part of this project is intended for use with the guidebook for establishing and using rural performance based transportation system assessment, monitoring, planning, and programming to support the rural pla...

Strategic Defense Initiative Organization adaptive structures program overview

NASA Astrophysics Data System (ADS)

Obal, Michael; Sater, Janet M.

In the currently envisioned architecture none of the Strategic Defense System (SDS) elements to be deployed will receive scheduled maintenance. Assessments of performance capability due to changes caused by the uncertain effects of environments will be difficult, at best. In addition, the system will have limited ability to adjust in order to maintain its required performance levels. The Materials and Structures Office of the Strategic Defense Initiative Organization (SDIO) has begun to address solutions to these potential difficulties via an adaptive structures technology program that combines health and environment monitoring with static and dynamic structural control. Conceivable system benefits include improved target tracking and hit-to-kill performance, on-orbit system health monitoring and reporting, and threat attack warning and assessment.

Roadside barrier effectiveness : noise measurement program

DOT National Transportation Integrated Search

1978-04-01

A field noise measurement program was conducted to assess the performance of a variable height highway noise barrier with and without an acoustic lining material. The barrier site on Interstate I-93 in Andover MA was located adjacent to an acoustical...

Effects of strength and neuromuscular training on functional performance in athletes after partial medial meniscectomy.

PubMed

Zhang, Xiaohui; Hu, Min; Lou, Zhen; Liao, Bagen

2017-02-01

The aims of this study were to determine an effective knee function rehabilitation program for athletes undergoing partial medial meniscectomy. Participants were randomly assigned to neuromuscular training (NT) or strength training (ST) group and subjected to functional assessments before surgery and again at 4, and 8 weeks post hoc . Functional knee assessment, such as Lysholm knee scoring, star excursion balance, and BTE PrimusRS isokinetic performance tests were evaluated in each group. All postoperational symptoms were significantly improved after 4 and 8 weeks of NT and ST. Both NT and ST programs showed effective knee function recovery seen as an increase in muscular strength and endurance. However, the NT program showed the most significant functional improvement of dynamic balance and coordination.

Mississippi Curriculum Framework for Metal Trades (Program CIP: 48.0590--Metal Trades). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for metal trades I, IIA (advanced welding), and IIB (advanced machine shop).…

2011 Report Card on the Effectiveness of Teacher Training Programs

ERIC Educational Resources Information Center

Tennessee State Board of Education, 2011

2011-01-01

The Tennessee General Assembly passed legislation in 2007 requiring that the State Board of Education produce an assessment on the effectiveness of teacher training programs. The law requires that the report includes data on the performance of each program's graduates in the following areas: placement and retention rates, Praxis II results, and…

Mississippi Curriculum Framework for Agriculture Production (Program CIP: 01.0301--Agricultural Prod. Workers & Mgrs.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriculture production I and II. Presented first are a program…

Mississippi Curriculum Framework for Building Trades (Program CIP: 46.0490--Building Trades, General). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in the building trades: building trades I and…

Mississippi Curriculum Framework for General Drafting (Program CIP: 48.0101--Drafting, General). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in drafting: drafting I and II. Presented…

Aviation and the environment : initial voluntary airport low emissions program projects reduce emissions, and FAA plans to assess the program's overall performance as participation increases.

DOT National Transportation Integrated Search

2008-11-01

In 2003, Congress established a program to reduce airport ground emissions at commercial service airports in areas failing to meet or maintain air quality standards. The Federal Aviation Administration (FAA) administers the Voluntary Airport Low Emis...

A Computer-Assisted Instruction Unit on Diffusion and Osmosis with a Conceptual Change Design.

ERIC Educational Resources Information Center

Jensen, Murray S.; And Others

1996-01-01

Describes the development, use, and evaluation of the "Osmosis Program" as a teaching tool to elicit and challenge college students' understanding about diffusion and osmosis. Results showed students using the program performed better on a diffusion and osmosis assessment test than students not using the program. (Author/MKR)

Mississippi Curriculum Framework for Electronics (Program CIP: 47.0190--Electronics (Secondary)). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in electronics: electronics I and II.…

Mississippi Curriculum Framework for Residential Carpentry (Program CIP: 46.0201--Carpenter). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in carpentry: carpentry I and II. Presented…

Practice Guidelines for Operative Performance Assessments.

PubMed

Williams, Reed G; Kim, Michael J; Dunnington, Gary L

2016-12-01

To provide recommended practice guidelines for assessing single operative performances and for combining results of operative performance assessments into estimates of overall operative performance ability. Operative performance is one defining characteristic of surgeons. Assessment of operative performance is needed to provide feedback with learning benefits to surgical residents in training and to assist in making progress decisions for residents. Operative performance assessment has been a focus of investigation over the past 20 years. This review is designed to integrate findings of this research into a set of recommended operative performance practices. Literature from surgery and from other pertinent research areas (psychology, education, business) was reviewed looking for evidence to inform practice guideline development. Guidelines were created along with a conceptual and scientific foundation for each guideline. Ten guidelines are provided for assessing individual operative performances and 10 are provided for combing data from individual operative performances into overall judgments of operative performance ability. The practice guidelines organize available information to be immediately useful to program directors, to support surgical training, and to provide a conceptual framework upon which to build as the base of pertinent knowledge expands through future research and development efforts.

SEAL Studies of Variant Blanket Concepts and Materials

NASA Astrophysics Data System (ADS)

Cook, I.; Taylor, N. P.; Forty, C. B. A.; Han, W. E.

1997-09-01

Within the European SEAL ( Safety and Environmental Assessment of fusion power, Long-term) program, safety and environmental assessments have been performed which extend the results of the earlier SEAFP (Safety and Environmental Assessment of Fusion Power) program to a wider range of blanket designs and material choices. The four blanket designs analysed were those which had been developed within the Blanket program of the European Fusion Programme. All four are based on martensitic steel as structural material, and otherwise may be summarized as: water-cooled lithium-lead; dual-cooled lithium-lead; helium-cooled lithium silicate (BOT geometry); helium-cooled lithium aluminate (or zirconate) (BIT geometry). The results reveal that all the blankets show the favorable S&E characteristics of fusion, though there are interesting and significant differences between them. The key results are described. Assessments have also been performed of a wider range of materials than was considered in SEAFP. These were: an alternative vanadium alloy, an alternative low-activation martensitic steel, titanium-aluminum intermetallic, and SiC composite. Assessed impurities were included in the compositions, and these had very important effects upon some of the results. Key results impacting upon accident characteristics, recycling, and waste management are described.

Residents-as-Teachers Publications: What Can Programs Learn From the Literature When Starting a New or Refining an Established Curriculum?

PubMed

Bree, Kelly K; Whicker, Shari A; Fromme, H Barrett; Paik, Steve; Greenberg, Larrie

2014-06-01

Teaching residents how to teach is a critical part of resident education because residents are often the major teachers of medical students. The importance of formal residents-as-teachers (RAT) curricula has been emphasized throughout the literature, yet not all residency programs have such a curriculum in place. The purpose of our study was to (1) review the medical education literature for established RAT curricula, (2) assess published curricula's reproducibility, (3) evaluate the type of outcomes achieved using the Kirkpatrick model of evaluation, and (4) identify curricula that training programs could feasibly adopt. We performed a literature review using PubMed, Medline, Scopus, PsycINFO, ERIC, and Embase. Key search words included residents, residents as teachers, teaching, internship and residency, and curriculum. In addition, a search of MedEdPORTAL was performed using the same key terms. Articles were evaluated based on the reproducibility of curricula and the assessment tools. Evaluation of educational outcomes was performed using the Kirkpatrick model. Thirty-nine articles were deemed appropriate for review. Interventions and evaluation techniques varied greatly. Only 1 article from the literature was deemed to have both curricula and assessments that would be fully reproducible by other programs. A literature review on RAT curricula found few articles that would be easily reproduced for residency programs that want to start or improve their own RAT curricula. It also demonstrated the difficulty and lack of rigorous outcome measurements for most curricula.

Implementation of a hospital-based quality assessment program for rectal cancer.

PubMed

Hendren, Samantha; McKeown, Ellen; Morris, Arden M; Wong, Sandra L; Oerline, Mary; Poe, Lyndia; Campbell, Darrell A; Birkmeyer, Nancy J

2014-05-01

Quality improvement programs in Europe have had a markedly beneficial effect on the processes and outcomes of rectal cancer care. The quality of rectal cancer care in the United States is not as well understood, and scalable quality improvement programs have not been developed. The purpose of this article is to describe the implementation of a hospital-based quality assessment program for rectal cancer, targeting both community and academic hospitals. We recruited 10 hospitals from a surgical quality improvement organization. Nurse reviewers were trained to abstract rectal cancer data from hospital medical records, and abstracts were assessed for accuracy. We conducted two surveys to assess the training program and limitations of the data abstraction. We validated data completeness and accuracy by comparing hospital medical record and tumor registry data. Nine of 10 hospitals successfully performed abstractions with ≥ 90% accuracy. Experienced nurse reviewers were challenged by the technical details in operative and pathology reports. Although most variables had less than 10% missing data, outpatient testing information was lacking from some hospitals' inpatient records. This implementation project yielded a final quality assessment program consisting of 20 medical records variables and 11 tumor registry variables. An innovative program linking tumor registry data to quality-improvement data for rectal cancer quality assessment was successfully implemented in 10 hospitals. This data platform and training program can serve as a template for other organizations that are interested in assessing and improving the quality of rectal cancer care. Copyright © 2014 by American Society of Clinical Oncology.

The Effects of the Compasslearning Odyssey Spiral-Up Program on Discovery Education Scores of Sixth-Grade Gifted and High-Performing Language Arts Students

ERIC Educational Resources Information Center

Kelsey, Carmen Freeman

2012-01-01

The purpose of this study was to examine the relationship between the implementation of the Response to Intervention (RTI) model CompassLearning Odyssey and the performance of middle school language arts students on the Discovery Education Test B and Tennessee Comprehensive Assessment Program (TCAP) along with examining teacher perceptions of high…

Berthing mechanism final test report and program assessment

NASA Technical Reports Server (NTRS)

1988-01-01

The purpose is to document the testing performed on both hardware and software developed under the Space Station Berthing Mechanisms Program. Testing of the mechanism occurred at three locations. Several system components, e.g., actuators and computer systems, were functionally tested before assembly. A series of post assembly tests were performed. The post assembly tests, as well as the dynamic testing of the mechanism, are presented.

Assessment program for Kentucky traffic records.

DOT National Transportation Integrated Search

2015-02-01

During 2013, the Kentucky Transportation Center identified 117 potential performance metrics for the ten databases in : the Kentucky Traffic Records System. This report summarizes the findings of three main tasks completed in 2014: (1) : assessment o...

Program risk analysis handbook

NASA Technical Reports Server (NTRS)

Batson, R. G.

1987-01-01

NASA regulations specify that formal risk analysis be performed on a program at each of several milestones. Program risk analysis is discussed as a systems analysis approach, an iterative process (identification, assessment, management), and a collection of techniques. These techniques, which range from extremely simple to complex network-based simulation, are described in this handbook in order to provide both analyst and manager with a guide for selection of the most appropriate technique. All program risk assessment techniques are shown to be based on elicitation and encoding of subjective probability estimates from the various area experts on a program. Techniques to encode the five most common distribution types are given. Then, a total of twelve distinct approaches to risk assessment are given. Steps involved, good and bad points, time involved, and degree of computer support needed are listed. Why risk analysis should be used by all NASA program managers is discussed. Tools available at NASA-MSFC are identified, along with commercially available software. Bibliography (150 entries) and a program risk analysis check-list are provided.

Reliability database development for use with an object-oriented fault tree evaluation program

NASA Technical Reports Server (NTRS)

Heger, A. Sharif; Harringtton, Robert J.; Koen, Billy V.; Patterson-Hine, F. Ann

1989-01-01

A description is given of the development of a fault-tree analysis method using object-oriented programming. In addition, the authors discuss the programs that have been developed or are under development to connect a fault-tree analysis routine to a reliability database. To assess the performance of the routines, a relational database simulating one of the nuclear power industry databases has been constructed. For a realistic assessment of the results of this project, the use of one of existing nuclear power reliability databases is planned.

Field modeling of heat transfer in atrium

NASA Astrophysics Data System (ADS)

Nedryshkin, Oleg; Gravit, Marina; Bushuev, Nikolay

2017-10-01

The results of calculating fire risk are an important element in the system of modern fire safety assessment. The article reviews the work on the mathematical modeling of fire in the room. A comparison of different calculation models in the programs of fire risk assessment and fire modeling was performed. The results of full-scale fire tests and fire modeling in the FDS program are presented. The analysis of empirical and theoretical data on fire modeling is made, a conclusion is made about the modeling accuracy in the FDS program.

Web-Based Portfolio Assessment: Validation of an Open Source Platform

ERIC Educational Resources Information Center

Collins, Regina; Elliot, Norbert; Klobucar, Andrew; Deek, Fadi P.

2013-01-01

Assessment of educational outcomes through purchased tests is commonplace in the evaluation of individual student ability and of educational programs. Focusing on the assessment of writing performance in a longitudinal study of first-time, full-time students (n = 598), this research describes the design, use, and assessment of an open-source…

The National Assessment of Educational Progress and the Longitudinal Studies Program: Together or Apart? Report of a Planning Conference (Washington, D.C., December 11, 1986).

ERIC Educational Resources Information Center

Brown, George H.; Faupel, Elizabeth M.

The National Assessment of Educational Progress (NAEP) and the Longitudinal Studies Program (LSP) are major survey projects on educational outcomes performed by the Center for Education Statistics. NAEP is a continuing cross-sectional survey of young Americans' skills, knowledge, and attitudes. The LSP studies follow a sample of students as they…

Command and General Staff College CrossFit Study 2010

DTIC Science & Technology

2010-05-30

program includes four primary components: functional fitness, performance nutrition , sports medicine and mental toughness. The perceived importance of...over the course of a week and athletes were given at least one day of recovery between assessments. Each assessment had prescribed weights to lift or... recovery for athletes during the week, especially in the first two weeks of the program. For this reason, the training plan specifically sought to avoid

Risk Scan: A Review of Risk Assessment Capability and Maturity within the Canadian Safety and Security Program

DTIC Science & Technology

2014-06-01

SCADA / ICS Cyber Test Lab initiated in 2013 Psychosocial – academic research exists,; opportunity for sharing and developing impact assessment...ecosystems and species at risk), accidents / system failure (rail; pipelines ; ferries CSSP strategy for the North Focus on regional l(and local) problem...Guidance; business planning; environmental scan; proposal evaluation; and performance measurement Program Risk Management – Guidelines for project

20 CFR 669.520 - What information is required in the NFJP grant plans?

Code of Federal Regulations, 2010 CFR

2010-04-01

..., DEPARTMENT OF LABOR NATIONAL FARMWORKER JOBS PROGRAM UNDER TITLE I OF THE WORKFORCE INVESTMENT ACT Performance Accountability, Planning and Waiver Provision § 669.520 What information is required in the NFJP... performance indicators and proposed levels of performance used to assess the performance of such entity...

Assessment of Current Inservice Inspection and Leak Monitoring Practices for Detecting Materials Degradation in Light Water Reactors

DOE Office of Scientific and Technical Information (OSTI.GOV)

Anderson, Michael T.; Simonen, Fredric A.; Muscara, Joseph

2016-09-01

An assessment was performed to determine the effectiveness of existing inservice inspection (ISI) and leak monitoring techniques, and recommend improvements, as necessary, to the programs as currently performed for light water reactor (LWR) components. Information from nuclear power plant (NPP) aging studies and from the U. S. Nuclear Regulatory Commission’s Generic Aging Lessons Learned (GALL) report (NUREG-1801) was used to identify components that have already experienced, or are expected to experience, degradation. This report provides a discussion of the key aspects and parameters that constitute an effective ISI program and a discussion of the basis and background against which themore » effectiveness of the ISI and leak monitoring programs for timely detection of degradation was evaluated. Tables based on the GALL components were used to systematically guide the process, and table columns were included that contained the ISI requirements and effectiveness assessment. The information in the tables was analyzed using histograms to reduce the data and help identify any trends. The analysis shows that the overall effectiveness of the ISI programs is very similar for both boiling water reactors (BWRs) and pressurized water reactors (PWRs). The evaluations conducted as part of this research showed that many ISI programs are not effective at detecting degradation before its extent reached 75% of the component wall thickness. This work should be considered as an assessment of NDE practices at this time; however, industry and regulatory activities are currently underway that will impact future effectiveness assessments. A number of actions have been identified to improve the current ISI programs so that degradation can be more reliably detected.« less

EPA/ECLSS consumables analyses for the Spacelab 1 flight

NASA Technical Reports Server (NTRS)

Steines, G. J.; Pipher, M. D.

1976-01-01

The results of electrical power system (EPS) and environmental control/life support system (ECLSS) consumables analyses of the Spacelab 1 mission are presented. The analyses were performed to assess the capability of the orbiter systems to support the proposed mission and to establish the various non propulsive consumables requirements. The EPS analysis was performed using the shuttle electrical power system (SEPS) analysis computer program. The ECLSS analysis was performed using the shuttle environmental consumables requirements evaluation tool (SECRET) program.

Utilizing a Meals on Wheels program to teach falls risk assessment to medical students.

PubMed

Demons, Jamehl L; Chenna, Swapna; Callahan, Kathryn E; Davis, Brooke L; Kearsley, Linda; Sink, Kaycee M; Watkins, Franklin S; Williamson, Jeff D; Atkinson, Hal H

2014-01-01

Falls are a critical public health issue for older adults, and falls risk assessment is an expected competency for medical students. The aim of this study was to design an innovative method to teach falls risk assessment using community-based resources and limited geriatrics faculty. The authors developed a Fall Prevention Program through a partnership with Meals-on-Wheels (MOW). A 3rd-year medical student accompanies a MOW client services associate to a client's home and performs a falls risk assessment including history of falls, fear of falling, medication review, visual acuity, a Get Up and Go test, a Mini-Cog, and a home safety evaluation, reviewed in a small group session with a faculty member. During the 2010 academic year, 110 students completed the in-home falls risk assessment, rating it highly. One year later, 63 students voluntarily completed a retrospective pre/postsurvey, and the proportion of students reporting moderate to very high confidence in performing falls risk assessments increased from 30.6% to 87.3% (p < .001). Students also reported using most of the skills learned in subsequent clerkships. A single educational intervention in the MOW program effectively addressed geriatrics competencies with minimal faculty effort and could be adopted by many medical schools.

Development and validation of an exercise performance support system for people with lower extremity impairment.

PubMed

Minor, M A; Reid, J C; Griffin, J Z; Pittman, C B; Patrick, T B; Cutts, J H

1998-02-01

To identify innovative strategies to support appropriate, self-directed exercise that increase physical activity levels of people with arthritis. This article reports on one interactive, multimedia exercise performance support system (PSS) for people with lower extremity impairments in strength or flexibility. An interdisciplinary team developed the PSS using self-report of lower extremity musculoskeletal impairments (flexibility and strength) to produce an individualized exercise program with video and print educational materials. Initial evaluation has investigated the validity and reliability of program assessments and recommendations. PSS self-report and professional assessments were similar, with more impairments indicated by self-report. PSS exercise recommendations were similar to those made by 3 expert physical therapists using the same exercise data base. Results of PSS impairment assessments were stable over a 1-week period. PSS exercise recommendations appear to be reliable and a valid reflection of current exercise knowledge in rheumatology. Furthermore, users were able to complete the computer-based program with minimal assistance and reported it to be enjoyable and informative.

Anthropometric Training Project. Final Report.

ERIC Educational Resources Information Center

San Diego State Coll., CA.

The Anthropometric Training Project was aimed at providing a training program for select students to develop research competency in an area relating body type, composition, anthropometric assessment, and physical performance measures. The program involves interdisciplinary cooperation in training through seminars, laboratory practice, and…

Health-related physical fitness assessment in a community-based cancer rehabilitation setting.

PubMed

Kirkham, Amy A; Neil-Sztramko, Sarah E; Morgan, Joanne; Hodson, Sara; Weller, Sarah; McRae, Tasha; Campbell, Kristin L

2015-09-01

Assessment of physical fitness is important in order to set goals, appropriately prescribe exercise, and monitor change over time. This study aimed to determine the utility of a standardized physical fitness assessment for use in cancer-specific, community-based exercise programs. Tests anticipated to be feasible and suitable for a community setting and a wide range of ages and physical function were chosen to measure body composition, aerobic fitness, strength, flexibility, and balance. Cancer Exercise Trainers/Specialists at cancer-specific, community-based exercise programs assessed new clients (n = 60) at enrollment, designed individualized exercise programs, and then performed a re-assessment 3-6 months later (n = 34). Resting heart rate, blood pressure, body mass index, waist circumference, handgrip strength, chair stands, sit-and-reach, back scratch, single-leg standing, and timed up-and-go tests were considered suitable and feasible tests/measures, as they were performed in most (≥88 %) participants. The ability to capture change was also noted for resting blood pressure (-7/-5 mmHg, p = 0.02), chair stands (+4, p < 0.01), handgrip strength (+2 kg, p < 0.01), and sit-and-reach (+3 cm, p = 0.03). While the submaximal treadmill test captured a meaningful improvement in aerobic fitness (+62 s, p = 0.17), it was not completed in 33 % of participants. Change in mobility, using the timed up-and-go was nominal and was not performed in 27 %. Submaximal treadmill testing, handgrip dynamometry, chair stands, and sit-and-reach tests were feasible, suitable, and provided meaningful physical fitness information in a cancer-specific, community-based, exercise program setting. However, a shorter treadmill protocol and more sensitive balance and upper body flexibility tests should be investigated.

Defense Acquisitions: Assessments of Selected Weapon Programs

DTIC Science & Technology

2008-03-01

system configuration changes could enable department officials to make more informed decisions in the early stages of a program and better match...accountability in the execution of each program would alleviate untimely decision making when programs do get into trouble. The current DOD leadership has...require that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions

Chapter 11: Monitoring and Assessment of Wetlands: Concepts, Case Studies, and Lessons Learned

EPA Science Inventory

Monitoring and assessment (M&A) have long been considered critical components of any resource management program where there is a need to evaluate progress and performance over time. Understanding the origins of current monitoring and assessment strategies and techniques for wetl...

Poor Performance Among Trainees in a Dutch Postgraduate GP Training Program.

PubMed

Vermeulen, Margit I; Kuyvenhoven, Marijke M; de Groot, Esther; Zuithoff, Nicolaas Pa; Pieters, Honore M; van der Graaf, Yolanda; Damoiseaux, Roger Amj

2016-06-01

Poor performance among trainees is an important issue, for patient safety and economic reasons. While early identification might enhance remediation measures, we explored the frequency, nature, and risk factors of poor performance in a Dutch postgraduate general practitioner (GP) training program. All trainees who started the GP training between 2005 and 2007 were included. Multivariate logistic regression analysis was applied to examine associations between individual characteristics; early assessments of competencies and knowledge, training process characteristics (eg, illness, maternal leave), and the outcome poor performance; sub-analyses were performed for each year. A total of 215 trainees started the 3-year GP program, and 49 (22.8%) exhibited poor performance (in one or more years). In the first and second years, problem areas among poor performers were equally distributed across the roles of "medical expert," "communicator," and "professional." In the third year, shortcomings in "professionalism" were the most common problem. Increasing age was a risk factor for poor performance as were insufficient scores in communication and knowledge. Poor performance in the previous year was a risk factor for poor performance in the second and third years; OR=4.20 (CI=1.31--13.47) and OR=5.40 (CI=1.58--18.47), respectively. Poor performance is prevalent but primarily occurring within a single training year. This finding suggests that trainees are capable of solving trainee problems. Increasing age, insufficient assessment scores early in the training, and poor performance in a previous year constitute risk factors for poor performance.

Annual Report for Los Alamos National Laboratory Technical Area 54, Area G Disposal Facility – Fiscal Year 2015

DOE Office of Scientific and Technical Information (OSTI.GOV)

French, Sean B.; Stauffer, Philip H.; Birdsell, Kay H.

As a condition to the disposal authorization statement issued to Los Alamos National Laboratory (LANL or the Laboratory) on March 17, 2010, a comprehensive performance assessment and composite analysis maintenance program must be implemented for the Technical Area 54, Area G disposal facility. Annual determinations of the adequacy of the performance assessment and composite analysis (PA/CA) are to be conducted under the maintenance program to ensure that the conclusions reached by those analyses continue to be valid. This report summarizes the results of the fiscal year (FY) 2015 annual review for Area G.

Life support technology investment strategies for flight programs: An application of decision analysis

NASA Technical Reports Server (NTRS)

Schlater, Nelson J.; Simonds, Charles H.; Ballin, Mark G.

1993-01-01

Applied research and technology development (R&TD) is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Given the increased awareness of limitations in resources, effective R&TD today needs a method for up-front assessment of competing technologies to help guide technology investment decisions. Such an assessment approach must account for uncertainties in system performance parameters, mission requirements and architectures, and internal and external events influencing a development program. The methodology known as decision analysis has the potential to address these issues. It was evaluated by performing a case study assessment of alternative carbon dioxide removal technologies for NASA"s proposed First Lunar Outpost program. An approach was developed that accounts for the uncertainties in each technology's cost and performance parameters as well as programmatic uncertainties such as mission architecture. Life cycle cost savings relative to a baseline, adjusted for the cost of money, was used as a figure of merit to evaluate each of the alternative carbon dioxide removal technology candidates. The methodology was found to provide a consistent decision-making strategy for the develpoment of new life support technology. The case study results provided insight that was not possible from more traditional analysis approaches.

Life support technology investment strategies for flight programs: An application of decision analysis

NASA Technical Reports Server (NTRS)

Schlater, Nelson J.; Simonds, Charles H.; Ballin, Mark G.

1993-01-01

Applied research and technology development (R&TD) is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Given the increased awareness of limitations in resources, effective R&TD today needs a method for up-front assessment of competing technologies to help guide technology investment decisions. Such an assessment approach must account for uncertainties in system performance parameters, mission requirements and architectures, and internal and external events influencing a development program. The methodology known as decision analysis has the potential to address these issues. It was evaluated by performing a case study assessment of alternative carbon dioxide removal technologies for NASA's proposed First Lunar Outpost program. An approach was developed that accounts for the uncertainties in each technology's cost and performance parameters as well as programmatic uncertainties such as mission architecture. Life cycle cost savings relative to a baseline, adjusted for the cost of money, was used as a figure of merit to evaluate each of the alternative carbon dioxide removal technology candidates. The methodology was found to provide a consistent decision-making strategy for development of new life support technology. The case study results provided insight that was not possible from more traditional analysis approaches.

Perception and Practice: The Impact of Teachers' Scoring Experience on Performance-Based Instruction and Classroom Assessment.

ERIC Educational Resources Information Center

Goldberg, Gail Lynn; Roswell, Barbara Sherr

Teachers' reactions to the administration and scoring of the Maryland School Performance Assessment Program tests (MSPAP) were studied, focusing on their direct and indirect exposure to tasks and evaluative criteria through the experience of scoring the MSPAP. Since its inception in 1991, the MSPAP has been scored in-state by certified teachers…

The First National Assessment of Musical Performance, Report 03-MU-01.

ERIC Educational Resources Information Center

Education Commission of the States, Denver, CO. National Assessment of Educational Progress.

The report summarizes results of a survey of musical performance abilities of Americans of various ages. During 1971 and 1972 a national assessment program was conducted to measure the musical abilities of nine-year-olds, 13-year-olds, 17-year-olds, and young adults from 26-35 years of age. Exercises were divided into five groups: singing familiar…

Validity, Reliability, and Equity Issues in an Observational Talent Assessment Process in the Performing Arts

ERIC Educational Resources Information Center

Oreck, Barry A.; Owen, Steven V.; Baum, Susan M.

2003-01-01

The lack of valid, research-based methods to identify potential artistic talent hampers the inclusion of the arts in programs for the gifted and talented. The Talent Assessment Process in Dance, Music, and Theater (D/M/T TAP) was designed to identify potential performing arts talent in diverse populations, including bilingual and special education…

Breaking Ground: Analysis of the Assessment System and Impact of Mexico's Teacher Incentive Program "Carrera Magisterial." Technical Report. Summary

ERIC Educational Resources Information Center

Santibariz, Lucrecia; Martinez, Jose Felipe; Datar, Ashlesha; McEwan, Patrick J.; Setodji, Claude Messan; Basurto-Davilao, Ricardo

2007-01-01

Mexico's Carrera Magisterial was instituted in 1992 and designed jointly by the federal education authorities, state authorities, and the teachers' union as a horizontal promotion system that rewards teachers with salary bonuses on the basis of their performance. Teacher performance is evaluated through a series of assessments, including teacher…

A Randomized Controlled Trial of an Activity Specific Exercise Program for Individuals With Alzheimer Disease in Long-term Care Settings

PubMed Central

Roach, Kathryn E.; Tappen, Ruth M.; Kirk-Sanchez, Neva; Williams, Christine L.; Loewenstein, David

2011-01-01

Objective To determine whether an activity specific exercise program could improve ability to perform basic mobility activities in long-term care residents with Alzheimer disease (AD). Design Randomized, controlled, single-blinded clinical trial. Setting Residents of 7 long-term care facilities. Participants Eighty-two long-term care residents with mild to severe AD. Intervention An activity specific exercise program was compared to a walking program and to an attention control. Measurements Ability to perform bed mobility and transfers were assessed using the subscales of the Acute Care Index of Function; functional mobility was measured using the 6-Minute Walk test. Results Subjects receiving the activity specific exercise program improved in ability to perform transfers, whereas subjects in the other 2 groups declined. PMID:21937893

Use of the Home Safety Self-Assessment Tool (HSSAT) within Community Health Education to Improve Home Safety.

PubMed

Horowitz, Beverly P; Almonte, Tiffany; Vasil, Andrea

2016-10-01

This exploratory research examined the benefits of a health education program utilizing the Home Safety Self-Assessment Tool (HSSAT) to increase perceived knowledge of home safety, recognition of unsafe activities, ability to safely perform activities, and develop home safety plans of 47 older adults. Focus groups in two senior centers explored social workers' perspectives on use of the HSSAT in community practice. Results for the health education program found significant differences between reported knowledge of home safety (p = .02), ability to recognize unsafe activities (p = .01), safely perform activities (p = .04), and develop a safety plan (p = .002). Social workers identified home safety as a major concern and the HSSAT a promising assessment tool. Research has implications for reducing environmental fall risks.

MHA admission criteria and program performance: do they predict career performance?

PubMed

Porter, J; Galfano, V J

1987-01-01

The purpose of this study was to determine to what extent admission criteria predict graduate school and career performance. The study also analyzed which objective and subjective criteria served as the best predictors. MHA graduates of the University of Minnesota from 1974 to 1977 were surveyed to assess career performance. Student files served as the data base on admission criteria and program performance. Career performance was measured by four variables: total compensation, satisfaction, fiscal responsibility, and level of authority. High levels of MHA program performance were associated with women who had high undergraduate GPAs from highly selective undergraduate colleges, were undergraduate business majors, and participated in extracurricular activities. High levels of compensation were associated with relatively low undergraduate GPAs, high levels of participation in undergraduate extracurricular activities, and being single at admission to graduate school. Admission to MHA programs should be based upon both objective and subjective criteria. Emphasis should be placed upon the selection process for MHA students since admission criteria are shown to explain 30 percent of the variability in graduate program performance, and as much as 65 percent of the variance in level of position authority.

Cost and Economics for Advanced Launch Vehicles

NASA Technical Reports Server (NTRS)

Whitfield, Jeff

1998-01-01

Market sensitivity and weight-based cost estimating relationships are key drivers in determining the financial viability of advanced space launch vehicle designs. Due to decreasing space transportation budgets and increasing foreign competition, it has become essential for financial assessments of prospective launch vehicles to be performed during the conceptual design phase. As part of this financial assessment, it is imperative to understand the relationship between market volatility, the uncertainty of weight estimates, and the economic viability of an advanced space launch vehicle program. This paper reports the results of a study that evaluated the economic risk inherent in market variability and the uncertainty of developing weight estimates for an advanced space launch vehicle program. The purpose of this study was to determine the sensitivity of a business case for advanced space flight design with respect to the changing nature of market conditions and the complexity of determining accurate weight estimations during the conceptual design phase. The expected uncertainty associated with these two factors drives the economic risk of the overall program. The study incorporates Monte Carlo simulation techniques to determine the probability of attaining specific levels of economic performance when the market and weight parameters are allowed to vary. This structured approach toward uncertainties allows for the assessment of risks associated with a launch vehicle program's economic performance. This results in the determination of the value of the additional risk placed on the project by these two factors.

Alfredson versus Silbernagel exercise therapy in chronic midportion Achilles tendinopathy: study protocol for a randomized controlled trial.

PubMed

Habets, Bas; van Cingel, Robert E H; Backx, Frank J G; Huisstede, Bionka M A

2017-07-11

Midportion Achilles tendinopathy (AT) is a common overuse injury, usually requiring several months of rehabilitation. Exercise therapy of the ankle plantar flexors (i.e. tendon loading) is considered crucial during conservative rehabilitation. Alfredson's isolated eccentric and Silbernagel's combined concentric-eccentric exercise programs have both shown beneficial results, but it is unknown whether any of these programs is superior for use in clinical practice. Therefore, the primary objective of this study is to compare the effectiveness of both programs on clinical symptoms. Secondary objectives are to compare the effectiveness of both programs on quality of life and functional outcome measures, to investigate the prognostic value of baseline characteristics, to investigate differences in cost-effectiveness. Eighty-six recreational athletes (21-60 years of age) with unilateral chronic midportion AT (i.e. ≥ 3 months) will be included in this multicenter assessor blinded randomized controlled trial. They will be randomly allocated to either a group performing the Alfredson isolated eccentric training program (n = 43), or a group performing the Silbernagel combined concentric-eccentric program (n = 43). In the Alfredson group, participants will perform eccentric heel-drops on their injured side, twice daily for 12 weeks, whereas in the Silbernagel group, participants perform various concentric-eccentric heel-raise exercises, once daily for 12 weeks. Primary outcome measure will be the Victorian Institute of Sport Assessment - Achilles (VISA-A) questionnaire. Secondary outcomes will be a visual analogue scale (VAS) for pain during daily activities and sports, duration of morning stiffness, global perceived effect, the 12-item Short Form Health Survey and the Euroqol instrument, and functional performance measured with the heel-raise test and the countermovement jump. Additionally, alongside the RCT, a cost-effectiveness analysis will be performed. Assessments will be performed at baseline and after 12, 26, and 52 weeks. This study is the first to directly compare the Alfredson and the Silbernagel exercise program in a randomized trial. The results can further enlarge the evidence base for choosing the most appropriate exercise program for patients with midportion AT. Dutch Trial register: NTR5638 . Date of registration: 7 January 2016.

FY 1987 current fiscal year work plan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This Current Year Work Plan presents a detailed description of the activities to be performed by the Joint Integration Office during FY87. It breaks down the activities into two major work areas: Program Management and Program Analysis. Program Management is performed by the JIO by providing technical planning and guidance for the development of advanced TRU waste management capabilities. This includes equipment/facility design, engineering, construction, and operations. These functions are integrated to allow transition from interim storage to final disposition. JIO tasks include program requirements identification, long-range technical planning, budget development, program planning document preparation, task guidance, task monitoring, informationmore » gathering and task reporting to DOE, interfacing with other agencies and DOE lead programs, integrating public involvement with program efforts, and preparation of program status reports for DOE. Program Analysis is performed by the JIO to support identification and assessment of alternatives, and development of long-term TRU waste program capabilities. This work plan includes: system analyses, requirements analyses, interim and procedure development, legislative and regulatory analyses, dispatch and traffic analyses, and data bases.« less

Mississippi Curriculum Framework for Automotive Body Repair (Program CIP: 47.0603--Auto/Automotive Body Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for automotive body repair I and II. Presented first are a program…

Mississippi Curriculum Framework for Business and Computer Technology (Program CIP: 52.0408--Gen. Office/Clerical & Typing Service). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for secondary-level courses in business and computer technology I-II.…

Mississippi Curriculum Framework for Marketing and Fashion Merchandising (Program CIP: 08.0705--General Retailing Operations). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for marketing I-II and fashion merchandising. Presented first are a program…

Mississippi Curriculum Framework for Agriculture Business and Management (Program CIP: 01.0101--Agriculture Business & Mgmt., Gen.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for agriculture business and management (ABM) I and II. Presented first are a…

Assessing the Performance of the "Counterfactual as Self-Estimated by Program Participants": Results from a Randomized Controlled Trial

ERIC Educational Resources Information Center

Mueller, Christoph Emanuel; Gaus, Hansjoerg

2015-01-01

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

Mississippi Curriculum Framework for Brick, Block, and Stonemasonry (Program CIP: 46.0101--Mason and Tile Setter). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for two secondary-level courses in brick, block, and stonemasonry: brick,…

Transactional, Transformational, or Laissez-Faire Leadership: An Assessment of College of Agriculture Academic Program Leaders' (Deans) Leadership Styles

ERIC Educational Resources Information Center

Jones, David; Rudd, Rick

2008-01-01

The purpose of this study was to determine if academic program leaders in colleges of agriculture at land-grant institutions use transactional, transformational, and/or laissez-faire leadership styles in performing their duties. Academic program leaders were defined as individuals listed by the National Association of State University and…

Experience of Presence in Virtual Environments

DTIC Science & Technology

2003-09-01

perceptual position (exocentric, egocentric) neurolinguistic programming (NLP) assessment. Performance measures: Selection of correct spear, accuracy...the future. Accordingly, the Institute for Defense Analyses (IDA) is undertaking an analysis program to determine whether current data are sufficient...Many groups are seeking a better understanding of presence. From its start, IDA’s program has included pulling together the results of these efforts to

Mississippi Curriculum Framework for Diesel Equipment Repair & Service (Program CIP: 47.0605--Diesel Engine Mechanic & Repairer). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for diesel engine mechanics I and II. Presented first are a program…

Mississippi Curriculum Framework for Machine Tool Operation/Machine Shop (Program CIP: 48.0503--Machine Shop Assistant). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for machine tool operation/machine shop I and II. Presented first are a…

Examining Quality Improvement Programs: The Case of Minnesota Hospitals

PubMed Central

Olson, John R; Belohlav, James A; Cook, Lori S; Hays, Julie M

2008-01-01

Objective To determine if there is a hierarchy of improvement program adoption by hospitals and outline that hierarchy. Data Sources Primary data were collected in the spring of 2007 via e-survey from 210 individuals representing 109 Minnesota hospitals. Secondary data from 2006 were assembled from the Leapfrog database. Study Design As part of a larger survey, respondents were given a list of improvement programs and asked to identify those programs that are used in their hospital. Data Collection/Data Extraction Rasch Model Analysis was used to assess whether a unidimensional construct exists that defines a hospital's ability to implement performance improvement programs. Linear regression analysis was used to assess the relationship of the Rasch ability scores with Leapfrog Safe Practices Scores to validate the research findings. Principal Findings The results of the study show that hospitals have widely varying abilities in implementing improvement programs. In addition, improvement programs present differing levels of difficulty for hospitals trying to implement them. Our findings also indicate that the ability to adopt improvement programs is important to the overall performance of hospitals. Conclusions There is a hierarchy of improvement programs in the health care context. A hospital's ability to successfully adopt improvement programs is a function of its existing capabilities. As a hospital's capability increases, the ability to successfully implement higher level programs also increases. PMID:18761677

Using Risk Assessment Methodologies to Meet Management Objectives

NASA Technical Reports Server (NTRS)

DeMott, D. L.

2015-01-01

Corporate and program objectives focus on desired performance and results. ?Management decisions that affect how to meet these objectives now involve a complex mix of: technology, safety issues, operations, process considerations, employee considerations, regulatory requirements, financial concerns and legal issues. ?Risk Assessments are a tool for decision makers to understand potential consequences and be in a position to reduce, mitigate or eliminate costly mistakes or catastrophic failures. Using a risk assessment methodology is only a starting point. ?A risk assessment program provides management with important input in the decision making process. ?A pro-active organization looks to the future to avoid problems, a reactive organization can be blindsided by risks that could have been avoided. ?You get out what you put in, how useful your program is will be up to the individual organization.

Proficiency program for real-time PCR diagnosis of Bordetella pertussis infections in French hospital laboratories and at the French National Reference Center for Whooping Cough and other Bordetelloses.

PubMed

Caro, Valérie; Guiso, Nicole; Alberti, Corinne; Liguori, Sandrine; Burucoa, Christophe; Couetdic, Gérard; Doucet-Populaire, Florence; Ferroni, Agnès; Papin-Gibaud, Sophie; Grattard, Florence; Réglier-Poupet, Hélène; Raymond, Josette; Soler, Catherine; Bouchet, Sylvie; Charreau, Sandrine; Couzon, Brigitte; Leymarie, Isabelle; Tavares, Nicole; Choux, Mathilde; Bingen, Edouard; Bonacorsi, Stéphane

2009-10-01

With the support of a ministerial program for innovative and expensive technologies, dedicated to the economic evaluation of laboratory diagnosis of pertussis by real-time PCR, external quality assessment for real-time IS481 PCR was carried out. Coordinated by the National Centre of Reference of Pertussis and other Bordetelloses (NCR), this study aimed to harmonize and to assess the performances of eight participating microbiology hospital laboratories throughout the French territory. Between January 2006 and February 2007, 10 proficiency panels were sent by the NCR (ascending proficiency program), representing a total of 49 samples and including eight panels to analyze and evaluate the global sensitivity and specificity of real-time PCR, one to assess the limit of detection, and one to evaluate nucleic acid extraction methods. As part of the descending proficiency program, extracted DNA from clinical samples was sent by the eight participating laboratories in different panels and analyzed by the NCR. In the ascending proficiency analysis, the sensitivity and specificity of the real-time PCR methods were 92.2% and 94.3%, respectively. The limit of detection of the different methods ranged between 0.1 and 1 fg/microl (0.2 to 2 CFU/microl). The nucleic acid extraction methods showed similar performances. During the descending proficiency analysis, performed with 126 samples, the result of the NCR for 15 samples (11.9%) was discordant with the result obtained by the source laboratory. Despite several initial differences, harmonization was easy and performances were homogeneous. However, the risk of false-positive results remains quite high, and we strongly recommend establishment of uniform quality control procedures performed regularly.

Computed Tomography Inspection and Analysis for Additive Manufacturing Components

NASA Technical Reports Server (NTRS)

Beshears, Ronald D.

2017-01-01

Computed tomography (CT) inspection was performed on test articles additively manufactured from metallic materials. Metallic AM and machined wrought alloy test articles with programmed flaws and geometric features were inspected using a 2-megavolt linear accelerator based CT system. Performance of CT inspection on identically configured wrought and AM components and programmed flaws was assessed to determine the impact of additive manufacturing on inspectability of objects with complex geometries.

Candidate Technologies for the Integrated Health Management Program

NASA Technical Reports Server (NTRS)

Johnson, Neal F., Jr.; Martin, Fred H.

1993-01-01

The purpose of this report is to assess Vehicle Health Management (VHM) technologies for implementation as a demonstration. Extensive studies have been performed to determine technologies which could be implemented on the Atlas and Centaur vehicles as part of a bridging program. This paper discusses areas today where VHM can be implemented for benefits in reliability, performance, and cost reduction. VHM Options are identified and one demonstration is recommended for execution.

Development and evaluation of a computer program to grade student performance on peripheral blood smears

NASA Astrophysics Data System (ADS)

Lehman, Donald Clifford

Today's medical laboratories are dealing with cost containment health care policies and unfilled laboratory positions. Because there may be fewer experienced clinical laboratory scientists, students graduating from clinical laboratory science (CLS) programs are expected by their employers to perform accurately in entry-level positions with minimal training. Information in the CLS field is increasing at a dramatic rate, and instructors are expected to teach more content in the same amount of time with the same resources. With this increase in teaching obligations, instructors could use a tool to facilitate grading. The research question was, "Can computer-assisted assessment evaluate students in an accurate and time efficient way?" A computer program was developed to assess CLS students' ability to evaluate peripheral blood smears. Automated grading permits students to get results quicker and allows the laboratory instructor to devote less time to grading. This computer program could improve instruction by providing more time to students and instructors for other activities. To be valuable, the program should provide the same quality of grading as the instructor. These benefits must outweigh potential problems such as the time necessary to develop and maintain the program, monitoring of student progress by the instructor, and the financial cost of the computer software and hardware. In this study, surveys of students and an interview with the laboratory instructor were performed to provide a formative evaluation of the computer program. In addition, the grading accuracy of the computer program was examined. These results will be used to improve the program for use in future courses.

TH-D-204-00: The Pursuit of Radiation Oncology Performance Excellence

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

The Malcolm Baldrige National Quality Improvement Act was signed into law in 1987 to advance U.S. business competitiveness and economic growth. Administered by the National Institute of Standards and Technology NIST, the Act created the Baldrige National Quality Program, now renamed the Baldrige Performance Excellence Program. The comprehensive analytical approaches referred to as the Baldrige Healthcare Criteria, are very well suited for the evaluation and sustainable improvement of radiation oncology management and operations. A multidisciplinary self-assessment approach is used for radiotherapy program evaluation and development in order to generate a fact based knowledge driven system for improving quality of care,more » increasing patient satisfaction, building employee engagement, and boosting organizational innovation. The methodology also provides a valuable framework for benchmarking an individual radiation oncology practice against guidelines defined by accreditation and professional organizations and regulatory agencies. Learning Objectives: To gain knowledge of the Baldrige Performance Excellence Program as it relates to Radiation Oncology. To appreciate the value of a multidisciplinary self-assessment approach in the pursuit of Radiation Oncology quality care, patient satisfaction, and workforce commitment. To acquire a set of useful measurement tools with which an individual Radiation Oncology practice can benchmark its performance against guidelines defined by accreditation and professional organizations and regulatory agencies.« less

TH-D-204-01: The Pursuit of Radiation Oncology Performance Excellence

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sternick, E.

The Malcolm Baldrige National Quality Improvement Act was signed into law in 1987 to advance U.S. business competitiveness and economic growth. Administered by the National Institute of Standards and Technology NIST, the Act created the Baldrige National Quality Program, now renamed the Baldrige Performance Excellence Program. The comprehensive analytical approaches referred to as the Baldrige Healthcare Criteria, are very well suited for the evaluation and sustainable improvement of radiation oncology management and operations. A multidisciplinary self-assessment approach is used for radiotherapy program evaluation and development in order to generate a fact based knowledge driven system for improving quality of care,more » increasing patient satisfaction, building employee engagement, and boosting organizational innovation. The methodology also provides a valuable framework for benchmarking an individual radiation oncology practice against guidelines defined by accreditation and professional organizations and regulatory agencies. Learning Objectives: To gain knowledge of the Baldrige Performance Excellence Program as it relates to Radiation Oncology. To appreciate the value of a multidisciplinary self-assessment approach in the pursuit of Radiation Oncology quality care, patient satisfaction, and workforce commitment. To acquire a set of useful measurement tools with which an individual Radiation Oncology practice can benchmark its performance against guidelines defined by accreditation and professional organizations and regulatory agencies.« less

Tiger Team Assessment of the Los Alamos National Laboratory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-11-01

The purpose of the safety and health assessment was to determine the effectiveness of representative safety and health programs at the Los Alamos National Laboratory (LANL). Within the safety and health programs at LANL, performance was assessed in the following technical areas: Organization and Administration, Quality Verification, Operations, Maintenance, Training and Certification, Auxiliary Systems, Emergency Preparedness, Technical Support, Packaging and Transportation, Nuclear Criticality Safety, Security/Safety Interface, Experimental Activities, Site/Facility Safety Review, Radiological Protection, Personnel Protection, Worker Safety and Health (OSHA) Compliance, Fire Protection, Aviation Safety, Explosives Safety, Natural Phenomena, and Medical Services.

Performance Funding in Tennessee: Stimulus for Program Improvement.

ERIC Educational Resources Information Center

Banta, Trudy W.; Moffett, Marian S.

1987-01-01

All postsecondary institutions in Tennessee have the opportunity to earn an annual budget supplement for instruction from the state if certain criteria, based on educational outcomes, are obtained. A comprehensive assessment program at the University of Tennessee at Knoxville is described. (MLW)

Quality Physical Education. NASPE Resource Brief

ERIC Educational Resources Information Center

National Association for Sport and Physical Education, 2013

2013-01-01

A quality physical education program provides learning opportunities, appropriate instruction, meaningful and challenging content, and student and program assessment. In addition, a quality physical education improves mental alertness, academic performance, and readiness and enthusiasm for learning in the nation's youth. This brief provides a list…

Assessment of Learning in Business Education: Standardized or Homegrown?

ERIC Educational Resources Information Center

Djoundourian, Salpie S.

2017-01-01

The author gives an overview of typical learning outcomes in business education and assessment instruments that help measure and test these outcomes. Using data from a recently accredited program the author investigated the determinants of performance on assessment exams to help identify and evaluate differences between homegrown and standardized…

Ten Things Every Professor Should Know about Assessment

ERIC Educational Resources Information Center

Wolf, Kenneth; Dunlap, Joanna; Stevens, Ellen

2012-01-01

This article describes ten key assessment practices for advancing student learning that all professors should be familiar with and strategically incorporate in their classrooms and programs. Each practice or concept is explained with examples and guidance for putting it into practice. The ten are: learning outcomes, performance assessments,…

Assessing Students' Communication Skills: Validation of a Global Rating

ERIC Educational Resources Information Center

Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

2008-01-01

Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to…

Multi-rater feedback with gap analysis: an innovative means to assess communication skill and self-insight.

PubMed

Calhoun, Aaron W; Rider, Elizabeth A; Peterson, Eleanor; Meyer, Elaine C

2010-09-01

Multi-rater assessment with gap analysis is a powerful method for assessing communication skills and self-insight, and enhancing self-reflection. We demonstrate the use of this methodology. The Program for the Approach to Complex Encounters (PACE) is an interdisciplinary simulation-based communication skills program. Encounters are assessed using an expanded Kalamazoo Consensus Statement Essential Elements Checklist adapted for multi-rater feedback and gap analysis. Data from a representative conversation were analyzed. Likert and forced-choice data with gap analysis are used to assess performance. Participants were strong in Demonstrating Empathy and Providing Closure, and needed to improve Relationship Building, Gathering Information, and understanding the Patient's/Family's Perspective. Participants under-appraised their abilities in Relationship Building, Providing Closure, and Demonstrating Empathy, as well as their overall performance. The conversion of these results into verbal feedback is discussed. We describe an evaluation methodology using multi-rater assessment with gap analysis to assess communication skills and self-insight. This methodology enables faculty to identify undervalued skills and perceptual blind spots, provide comprehensive, data driven, feedback, and encourage reflection. Implementation of graphical feedback forms coupled with one-on-one discussion using the above methodology has the potential to enhance trainee self-awareness and reflection, improving the impact of educational programs. Copyright (c) 2010 Elsevier Ireland Ltd. All rights reserved.

Introduction and Assessment of a Blended-Learning Model to Teach Patient Assessment in a Doctor of Pharmacy Program

PubMed Central

Woodruff, Ashley; Prescott, Gina M.; Albanese, Nicole; Bernhardi, Christian; Doloresco, Fred

2016-01-01

Objective. To integrate a blended-learning model into a two-course patient assessment sequence in a doctor of pharmacy (PharmD) program and to assess the academic performance and perceptions of enrolled students. Design. A blended-learning model consisting of a flipped classroom format was integrated into a patient assessment (PA) course sequence. Course grades of students in the blended-learning (intervention) and traditional-classroom (control) groups were compared. A survey was administered to assess student perceptions. Assessment. The mean numeric grades of students in the intervention group were higher than those of students in the traditional group (PA1 course: 92.2±3.1 vs 90.0±4.3; and PA2 course: 90.3±4.9 vs 85.8±4.2). Eighty-six percent of the students in the intervention group agreed that the instructional methodologies used in this course facilitated understanding of the material. Conclusion. The blended-learning model was associated with improved academic performance and was well-received by students. PMID:28179725

Introduction and Assessment of a Blended-Learning Model to Teach Patient Assessment in a Doctor of Pharmacy Program.

PubMed

Prescott, William Allan; Woodruff, Ashley; Prescott, Gina M; Albanese, Nicole; Bernhardi, Christian; Doloresco, Fred

2016-12-25

Objective. To integrate a blended-learning model into a two-course patient assessment sequence in a doctor of pharmacy (PharmD) program and to assess the academic performance and perceptions of enrolled students. Design. A blended-learning model consisting of a flipped classroom format was integrated into a patient assessment (PA) course sequence. Course grades of students in the blended-learning (intervention) and traditional-classroom (control) groups were compared. A survey was administered to assess student perceptions. Assessment. The mean numeric grades of students in the intervention group were higher than those of students in the traditional group (PA1 course: 92.2±3.1 vs 90.0±4.3; and PA2 course: 90.3±4.9 vs 85.8±4.2). Eighty-six percent of the students in the intervention group agreed that the instructional methodologies used in this course facilitated understanding of the material. Conclusion. The blended-learning model was associated with improved academic performance and was well-received by students.

A single issue program in an isolated area: mammography screening in Darwin, NT.

PubMed

McLean, M J; Condon, J R

1999-08-01

A process evaluation of the Northern Territory (NT) mammography program, NT Breast Screen (NTBS), during its initial 18 months of operation. The study was undertaken in Darwin, NT, from December 1994 to May 1996. Clinical outcomes were obtained by reviewing computerised and manual program records to determine waiting times for results, recall rates and cancer detection rates. Client satisfaction was assessed by a questionnaire sent to all women with normal results over a 12-week period. General practitioner satisfaction was assessed by a questionnaire sent to all general practitioners in the region who had one or more clients who had attended the service. During this time, 2,882 screening mammograms were performed; 98 women were recalled for assessment (3.4%). Breast cancer was detected in 10 women (3.5 per 1000 women screened). The program was well accepted by clients and general practitioners. Performance criteria were not met for waiting times for results. NTBS faced challenges because of its small and dispersed population, a lack of local radiologists with mammographic experience and the conflict with other pressing health issues, particularly in Aboriginal health. Despite these challenges, the program functioned effectively during its initial 18 months. Mammography screening programs in isolated areas can function effectively. The constraints encountered by NTBS are likely to apply to similar programs. Issues identified requiring further research are the psychological consequences of long waiting times for results, and the prioritisation of mammography for Aboriginal women.

An evaluation of the success of a surgical resident learning portfolio.

PubMed

Webb, Travis P; Merkley, Taylor R

2012-01-01

Learning portfolios have gained modest acceptance in graduate medical education because of challenges related to user satisfaction, time and resource commitment, and quality assessment. In 2001, the Department of Surgery implemented the Surgical Learning and Instructional Portfolio (SLIP) to help residents develop a case-based portfolio demonstrating practice-based learning. In 2008, the format was changed to a Web-based platform with open viewing of portfolios for all learners. This study was performed to evaluate the SLIP program using resident and faculty perspectives in the domains of satisfaction, compliance, and educational value. Likert scale surveys were distributed to residents to assess satisfaction. Using a semistructured format with subsequent qualitative analysis of the meeting transcript, a focus group discussion was held with the SLIP director, SLIP facilitator, and program coordinator. An analysis of the program compliance was performed by review of SLIP entry dates. Finally, the quality of the SLIP entries (n = 420) was analyzed in a blinded manner using a locally developed standardized SLIP assessment tool. Data analysis was performed using Pearson's correlation and Cronbach's alpha. Residents were satisfied with the program and felt the Web-based format promoted self-reflection. They perceived that time spent was appropriate. Residents also believed they gained medical knowledge of their own specific entry topics but did not learn routinely from others' entries. Faculty asserted that the Web-based platform eased the administrative burden but did not necessarily alter the quality of the SLIP entries. Compliance with the assignment was 100%. SLIP entry analysis demonstrated the reflection and understanding of the topics chosen. However, the overall quality assessment of entries was hindered by suboptimal interrater reliability (inter-rater reliability (IR) = 0.636). The SLIP program allows residents to demonstrate practice-based learning and improvement of medical knowledge. The Web-based format provides transparency and ease of administration. Quality assessment of individual portfolio entries remains a challenge to the widespread adoption of portfolios. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

In-Suit Doppler Technology Assessment

NASA Technical Reports Server (NTRS)

Schulze, Arthur E.; Greene, Ernest R.; Nadeau, John J.

1991-01-01

The objective of this program was to perform a technology assessment survey of non-invasive air embolism detection utilizing Doppler ultrasound methodologies. The primary application of this technology will be a continuous monitor for astronauts while performing extravehicular activities (EVA's). The technology assessment was to include: (1) development of a full understanding of all relevant background research; and (2) a survey of the medical ultrasound marketplace for expertise, information, and technical capability relevant to this development. Upon completion of the assessment, LSR was to provide an overview of technological approaches and R&D/manufacturing organizations.

Internal Medicine Residency Program Directors' Views of the Core Entrustable Professional Activities for Entering Residency: An Opportunity to Enhance Communication of Competency Along the Continuum.

PubMed

Angus, Steven V; Vu, T Robert; Willett, Lisa L; Call, Stephanie; Halvorsen, Andrew J; Chaudhry, Saima

2017-06-01

To examine internal medicine (IM) residency program directors' (PDs') perspectives on the Core Entrustable Professional Activities for Entering Residency (Core EPAs)-introduced into undergraduate medical education to further competency-based assessment-and on communicating competency-based information during transitions. A spring 2015 Association of Program Directors in Internal Medicine survey asked PDs of U.S. IM residency programs for their perspectives on which Core EPAs new interns must or should possess on day 1, which are most essential, and which have the largest gap between expected and observed performance. Their views and preferences were also requested regarding communicating competency-based information at transitions from medical school to residency and residency to fellowship/employment. The response rate was 57% (204/361 programs). The majority of PDs felt new interns must/should possess 12 of the 13 Core EPAs. PDs' rankings of Core EPAs by relative importance were more varied than their rankings by the largest gaps in performance. Although preferred timing varied, most PDs (82%) considered it important for medical schools to communicate Core EPA-based information to PDs; nearly three-quarters (71%) would prefer a checklist format. Many (60%) would be willing to provide competency-based evaluations to fellowship directors/employers. Most (> 80%) agreed that there should be a bidirectional communication mechanism for programs/employers to provide feedback on competency assessments. The gaps identified in Core EPA performance may help guide medical schools' curricular and assessment tool design. Sharing competency-based information at transitions along the medical education continuum could help ensure production of competent, practice-ready physicians.

Effects of the Advanced Innovative Internet-Based Communication Education Program on Promoting Communication Between Nurses and Patients With Dementia.

PubMed

Chao, Hui-Chen; Kaas, Merrie; Su, Ying-Hwa; Lin, Mei-Feng; Huang, Mei-Chih; Wang, Jing-Jy

2016-06-01

Effective communication between nurses and patients with dementia promotes the quality of patient care by improving the identification of patient needs and by reducing the miscommunication-related frustration of patients and nurses. This study evaluates the effects of an advanced innovative Internet-based communication education (AIICE) program on nurses' communication knowledge, attitudes, frequency of assessing patient communication capacity, and communication performance in the context of care for patients with dementia. In addition, this study attempts to evaluate the indirect effects of this program on outcomes for patients with dementia, including memory and behavior-related problems and depressive symptoms. A quasi-experimental research design with a one-group repeated measure was conducted. Convenience sampling was used to recruit nurses from long-term care facilities in southern Taiwan. Data were analyzed using general estimating equations to compare changes over time across three points: baseline, fourth-week posttest, and 16th-week posttest. One hundred five nurses completed the AIICE program and the posttest surveys. The findings indicate that nurses' communication knowledge, frequency in assessing patients' communication capacity, and communication performance had improved significantly over the baseline by either the 4th- or 16th-week posttest (p < .01). However, communication attitude showed no significant improvement in the posttest survey (p = .40). Furthermore, the findings indicate that the memory and behavior-related problems and the depressive symptoms of patients had decreased significantly by the 16th-week posttest (p = .05). This study showed that the AIICE program improves nurses' communication knowledge, frequency to assess patients' communication capacity, and communication performance and alleviates the memory and behavior-related problems and depressive symptoms of patients. The continuous communication training of nurses using the AIICE program is thus recommended.

Developing a pain management program through continuous improvement strategies.

PubMed

Woodward, Dora

2005-01-01

Pain affects more than one third of cancer patients in the early stages of their disease, dramatically rising above 70% in the advanced stages. Numerous studies have been conducted in the pursuit of cancer pain relief, yet the prevalence of pain persists. This article focuses on a pain management program, developed by a performance improvement team, which addressed the inadequacies of current pain management. Performance improvement activities are described through the process of assessment, planning, implementation, and evaluation of the pain management program. This pain management program is uniquely derived from a unit core value that all staff is responsible and accountable for pain management.

Evaluation of an Outpatient Rehabilitative Program to Address Mobility Limitations Among Older Adults

PubMed Central

Brown, Lorna G.; Ni, Meng; Schmidt, Catherine T.; Bean, Jonathan F.

2017-01-01

Abstract Live Long Walk Strong is a clinical demonstration program for community-dwelling older patients. It was designed to be consistent with current fall prevention guidelines and reimbursed under the Medicare model. Patients were screened within primary care and referred to a physiatrist followed by systematic assessment and treatment within an outpatient rehabilitative care setting. The treatment included behavioral modification, fall prevention education, community/home exercise integration, and exercise targeting strength, power, flexibility, balance, and endurance. Treatment duration and frequency varied with each patient based on baseline presentation, clinical judgment, and patient preference. Program feasibility and preliminary effectiveness were evaluated by assessing participation and changes in physical performance, respectively. There were 266 patients referred to the program, and 147 were willing to participate. Of these, 116 patients completed all scheduled visits (10.8 ± 3.9 visits). The noncompleters (n = 31) had a higher rate of falls in the previous 6 months and lower baseline Short Physical Performance Battery composite score. At the completion of care, the adjusted mean change in Short Physical Performance Battery was 1.66 units, surpassing a large clinically meaningful threshold (1 unit). The Live Long Walk Strong program appears to be feasible to implement and demonstrates preliminary effectiveness in enhancing mobility among older adults. PMID:28079616

The Future Value of Serious Games for Assessment: Where Do We Go Now?

ERIC Educational Resources Information Center

de Klerk, Sebastiaan; Kato, Pamela M.

2017-01-01

Game-based assessments will most likely be an increasing part of testing programs in future generations because they provide promising possibilities for more valid and reliable measurement of students' skills as compared to the traditional methods of assessment like paper-and-pencil tests or performance-based assessments. The current status of…

Program Characteristics and Enrollees' Outcomes in the Program of All-Inclusive Care for the Elderly (PACE)

PubMed Central

Mukamel, Dana B; Peterson, Derick R; Temkin-Greener, Helena; Delavan, Rachel; Gross, Diane; Kunitz, Stephen J; Williams, T Franklin

2007-01-01

The Program of All-Inclusive Care for the Elderly (PACE) is a unique program providing a full spectrum of health care services, from primary to acute to long-term care for frail elderly individuals certified to require nursing home care. The objective of this article is to identify program characteristics associated with better risk-adjusted health outcomes: mortality, functional status, and self-assessed health. The article examines statistical analyses of information combining DataPACE (individual-level clinical data), a survey of direct care staff about team performance, and interviews with management in twenty-three PACE programs. Several program characteristics were associated with better functional outcomes. Fewer were associated with long-term self-assessed health, and only one with mortality. These findings offer strategies that may lead to better care. PMID:17718666

Computer System Performance Measurement Techniques for ARTS III Computer Systems

DOT National Transportation Integrated Search

1973-12-01

The potential contribution of direct system measurement in the evolving ARTS 3 Program is discussed and software performance measurement techniques are comparatively assessed in terms of credibility of results, ease of implementation, volume of data,...

42 CFR 482.21 - Condition of participation: Quality assessment and performance improvement program.

Code of Federal Regulations, 2011 CFR

2011-10-01

... learning throughout the hospital. (3) The hospital must take actions aimed at performance improvement and... QIO cooperative project, but its own projects are required to be of comparable effort. (e) Standard...

Developing Statistical Models to Assess Transplant Outcomes Using National Registries: The Process in the United States.

PubMed

Snyder, Jon J; Salkowski, Nicholas; Kim, S Joseph; Zaun, David; Xiong, Hui; Israni, Ajay K; Kasiske, Bertram L

2016-02-01

Created by the US National Organ Transplant Act in 1984, the Scientific Registry of Transplant Recipients (SRTR) is obligated to publicly report data on transplant program and organ procurement organization performance in the United States. These reports include risk-adjusted assessments of graft and patient survival, and programs performing worse or better than expected are identified. The SRTR currently maintains 43 risk adjustment models for assessing posttransplant patient and graft survival and, in collaboration with the SRTR Technical Advisory Committee, has developed and implemented a new systematic process for model evaluation and revision. Patient cohorts for the risk adjustment models are identified, and single-organ and multiorgan transplants are defined, then each risk adjustment model is developed following a prespecified set of steps. Model performance is assessed, the model is refit to a more recent cohort before each evaluation cycle, and then it is applied to the evaluation cohort. The field of solid organ transplantation is unique in the breadth of the standardized data that are collected. These data allow for quality assessment across all transplant providers in the United States. A standardized process of risk model development using data from national registries may enhance the field.

A pilot study of biomechanical assessment before and after an integrative training program for adolescents with juvenile fibromyalgia.

PubMed

Tran, Susan T; Thomas, Staci; DiCesare, Christopher; Pfeiffer, Megan; Sil, Soumitri; Ting, Tracy V; Williams, Sara E; Myer, Gregory D; Kashikar-Zuck, Susmita

2016-07-22

Adolescents with juvenile fibromyalgia (JFM) tend to be very sedentary and avoid participation in physical activity. A prior study suggested that JFM patients show altered biomechanics compared to healthy adolescents which may make them more prone to pain/injury during exercise. A new intervention combining well established cognitive behavioral therapy (CBT) techniques with specialized neuromuscular exercise -Fibromyalgia Integrative Training for Teens (FIT Teens) was developed and shown to be promising in improving functioning in adolescents with JFM. In contrast to traditional exercise programs such as aerobic or resistance training, neuromuscular training is a tailored approach which targets gait, posture, balance and movement mechanics which form the foundation for safe exercise participation with reduced risk for injury or pain (and hence more tolerable by JFM patients). The aim of this pilot feasibility study was to establish whether objective biomechanical assessment including sophisticated 3-D motion analysis would be useful in measuring improvements in strength, balance, gait, and functional performance after participation in the 8-week FIT Teens program. Eleven female participants with JFM (ages 12-18 years) completed pre- and post-treatment assessments of biomechanics, including walking gait analysis, lower extremity strength assessment, functional performance, and dynamic postural stability. Descriptive data indicated that mechanics of walking gait and functional performance appeared to improve after treatment. Hip abduction strength and dynamic postural control also demonstrated improvements bilaterally. Overall, the results of this pilot study offer initial evidence for the utility of biomechanical assessment to objectively demonstrate observable changes in biomechanical performance after an integrated training intervention for youth with JFM. If replicated in larger controlled studies, findings would suggest that through the FIT Teens intervention, adolescents with JFM can progress towards normalized strength and biomechanics, which may enhance their ability to engage in physical exercise.

[Individualization of exercise load control for inpatient cardiac rehabilitation. Development and evaluation of a HRV-based intervention program for patients with ischemic heart failure].

PubMed

Behrens, K; Hottenrott, K; Weippert, M; Montanus, H; Kreuzfeld, S; Rieger, A; Lübke, J; Werdan, K; Stoll, R

2015-03-01

The effective use of rehabilitation programs is of primary importance in order to improve the physical performance of cardiac disease patients. A modular program has been developed which is intended to structure and individualize conventional, exercise-based rehabilitation programs according to the individual needs and physical condition of each patient. The individualization of the program is based on detailed diagnostics before patients enter the program and daily measurements of heart rate variability (HRV) during cardiac rehabilitation. A total of 30 patients with ischemic heart disease were randomly assigned either to the intervention group (IG), completing the modular individualized rehabilitation program [n=15, mean age 54.4±4.2 years and mean left ventricular ejection fraction (LVEF) 28.53±6.25%) or to the control group (CG) taking part in the conventional rehabilitation program (n=15, mean age 56.4±4.4 years and mean LVEF 27.63±5.62). Before and after the intervention, cardiorespiratory fitness was assessed by measurement of maximal oxygen consumption (relative VO2max) during bicycle ergometry and the 6-minute walk test (6-MWT). Pre-post comparisons of cardiorespiratory fitness indicators were used to evaluate the effectiveness of the rehabilitation program. In addition to the results of the basic clinical investigations and the cardiorespiratory testing, results of standardized HRV measurements of 10 min at morning rest served as criteria for program individualization. The relative VO2max increased significantly (p<0.05) in the IG whereas no change was found in the CG. Similar results were found for maximum power output during bicycle ergometry (p<0.01) and for 6-MWT distance (p<0.001). Although patients in the IG completed less aerobic exercise sessions than those in the CG (p<0.001) the physical performance of the IG improved significantly. The results prove the effectiveness and efficacy of the modular individualized rehabilitation program. They further suggest the need for an individual program matrix instead of a maximum performance matrix in cardiac rehabilitation. Individualization should be based on clinical and performance diagnostics before and accompanying assessments of training condition, e.g. by HRV measurements, during rehabilitation programs. Each patient should only perform those intervention programs which match the results of the basic clinical investigation and additional analyses during rehabilitation.

Speech-language pathology program for reading comprehension and orthography: effects on the spelling of dyslexic individuals.

PubMed

Nogueira, Débora Manzano; Cárnio, Maria Silvia

2018-01-01

Purpose Prepare a Speech-language Pathology Program for Reading Comprehension and Orthography and verify its effects on the reading comprehension and spelling of students with Developmental Dyslexia. Methods The study sample was composed of eleven individuals (eight males), diagnosed with Developmental Dyslexia, aged 09-11 years. All participants underwent a Speech-language Pathology Program in Reading Comprehension and Orthography comprising 16 individual weekly sessions. In each session, tasks of reading comprehension of texts and orthography were developed. At the beginning and end of the Program, the participants were submitted to a specific assessment (pre- and post-test). Results The individuals presented difficulty in reading comprehension, but the Cloze technique proved to be a useful remediation tool, and significant improvement in their performance was observed in the post-test evaluation. The dyslexic individuals showed poor performance for their educational level in the spelling assessment. At the end of the program, their performance evolved, but it remained below the expected, showing the same error pattern at the pre- and post-tests, with errors in both natural and arbitrary spelling. Conclusion The proposed Speech-language Pathology Program for Reading Comprehension and Orthography produced positive effects on the reading comprehension, spelling, and motivation to reading and writing of the participants. This study presents an unprecedented contribution by proposing joint stimulation of reading and writing by means of a program easy to apply and analyze in individuals with Developmental Dyslexia.

Plan, do, study, act model to improve an orientation program.

PubMed

Ragsdale, Mary Alice; Mueller, John

2005-01-01

The Franciscan Health System has designed a new employee orientation program that is both interactive and thought-provoking. The program has transitioned from a predominantly lecture-based format to one that consists of group discussion, role playing, lunch with senior leaders in the organization, and the utilization of adult learning principles. This article describes the shortcomings of the previous program, gaps identified in the needs assessment, and performance improvement methodology used to enhance the program.

The assessment and treatment of performance anxiety in musicians.

PubMed

Clark, D B; Agras, W S

1991-05-01

Performance anxiety in musicians may be severe enough to require intervention but has been the subject of relatively little clinical research. The authors' objectives were to describe the results of a comprehensive clinical and laboratory assessment and to perform a double-blind, placebo-controlled study comparing buspirone, cognitive-behavior therapy, and the combination of these treatments for performance anxiety. Ninety-four subjects were recruited by mass media announcements and were seen in a university-based outpatient psychiatric clinic. Assessments were 1) questionnaires for all 94 subjects, 2) diagnostic interview of 50 subjects, and 3) laboratory performance of 34 subjects. Treatment conditions were 1) 6 weeks of buspirone, 2) 6 weeks of placebo, 3) a five-session, group cognitive-behavior therapy program with buspirone, or 4) the cognitive-behavior therapy program with placebo. Treatment outcome measures included subjective anxiety ratings and heart rate measures during a laboratory performance, a questionnaire measure of performance confidence, and a blind rating of musical performance quality. All subjects fulfilled criteria for DSM-III-R social phobia. Of the 15 full-time professional musicians, ten had tried propranolol and three had stopped performing. Most of the subjects had substantial anxiety and heart rate increases during laboratory speech and musical performances. Cognitive-behavior therapy resulted in statistically significant reductions in subjective anxiety, improved quality of musical performance, and improved performance confidence. Buspirone was not an effective treatment. Cognitive-behavior therapy is a viable treatment approach for performance anxiety in musicians.

Propulsion system-flight control integration-flight evaluation and technology transition

NASA Technical Reports Server (NTRS)

Burcham, Frank W., Jr.; Gilyard, Glenn B.; Myers, Lawrence P.

1990-01-01

Integration of propulsion and flight control systems and their optimization offering significant performance improvement are assessed. In particular, research programs conducted by NASA on flight control systems and propulsion system-flight control interactions on the YF-12 and F-15 aircraft are addressed; these programs have demonstrated increased thrust, reduced fuel consumption, increased engine life, and improved aircraft performance. Focus is placed on altitude control, speed-Mach control, integrated controller design, as well as flight control systems and digital electronic engine control. A highly integrated digital electronic control program is analyzed and compared with a performance seeking control program. It is shown that the flight evaluation and demonstration of these technologies have been a key part in the transition of the concepts to production and operational use on a timely basis.

Toward development of a comprehensive external quality assurance program for polyfunctional intracellular cytokine staining assays

PubMed Central

Staats, Janet S.; Enzor, Jennifer H.; Sanchez, Ana M.; Rountree, Wes; Chan, Cliburn; Jaimes, Maria; Chan, Ray Chun-Fai; Gaur, Amitabh; Denny, Thomas N.; Weinhold, Kent J.

2014-01-01

The External Quality Assurance Program Oversight Laboratory (EQAPOL) Flow Cytometry Program assesses the proficiency of NIH/NIAID/DAIDS-supported and potentially other interested research laboratories in performing Intracellular Cytokine Staining (ICS) assays. The goal of the EQAPOL Flow Cytometry External Quality Assurance Program (EQAP) is to provide proficiency testing and remediation for participating sites. The program is not punitive; rather, EQAPOL aims to help sites identify areas for improvement. EQAPOL utilizes a highly standardized ICS assay to minimize variability and readily identify those sites experiencing technical difficulties with their assays. Here, we report the results of External Proficiency 3 (EP3) where participating sites performed a 7-color ICS assay. On average, sites perform well in the Flow Cytometry EQAP (median score is “Good”). The most common technical issues identified by the program involve protocol adherence and data analysis; these areas have been the focus of site remediation. The EQAPOL Flow Cytometry team is now in the process of expanding the program to 8-color ICS assays. Evaluating polyfunctional ICS responses would align the program with assays currently being performed in support of HIV immune monitoring assays. PMID:24968072

Effects of a virtual reality-based exercise program on functional recovery in stroke patients: part 1

PubMed Central

Lee, Kyoung-Hee

2015-01-01

This study aimed to determine the effects of a virtual reality exercise program using the Interactive Rehabilitation and Exercise System (IREX) on the recovery of motor and cognitive function and the performance of activities of daily living in stroke patients. [Subjects] The study enrolled 10 patients diagnosed with stroke who received occupational therapy at the Department of Rehabilitation Medicine of Hospital A between January and March 2014. [Methods] The patients took part in the virtual reality exercise program for 30 minutes each day, three times per week, for 4 weeks. Then, the patients were re-evaluated to determine changes in upper extremity function, cognitive function, and performance of activities of daily living 4 weeks after the baseline assessment. [Results] In the experimental group, there were significant differences in the Korea-Mini Mental Status Evaluation, Korean version of the modified Barthel index, and Fugl-Meyer assessment scores between the baseline and endpoint. [Conclusion] The virtual reality exercise program was effective for restoring function in stroke patients. Further studies should develop systematic protocols for rehabilitation training with a virtual reality exercise program. PMID:26180287

Effects of a virtual reality-based exercise program on functional recovery in stroke patients: part 1.

PubMed

Lee, Kyoung-Hee

2015-06-01

This study aimed to determine the effects of a virtual reality exercise program using the Interactive Rehabilitation and Exercise System (IREX) on the recovery of motor and cognitive function and the performance of activities of daily living in stroke patients. [Subjects] The study enrolled 10 patients diagnosed with stroke who received occupational therapy at the Department of Rehabilitation Medicine of Hospital A between January and March 2014. [Methods] The patients took part in the virtual reality exercise program for 30 minutes each day, three times per week, for 4 weeks. Then, the patients were re-evaluated to determine changes in upper extremity function, cognitive function, and performance of activities of daily living 4 weeks after the baseline assessment. [Results] In the experimental group, there were significant differences in the Korea-Mini Mental Status Evaluation, Korean version of the modified Barthel index, and Fugl-Meyer assessment scores between the baseline and endpoint. [Conclusion] The virtual reality exercise program was effective for restoring function in stroke patients. Further studies should develop systematic protocols for rehabilitation training with a virtual reality exercise program.

ASC Tri-lab Co-design Level 2 Milestone Report 2015

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hornung, Rich; Jones, Holger; Keasler, Jeff

2015-09-23

In 2015, the three Department of Energy (DOE) National Laboratories that make up the Advanced Sci- enti c Computing (ASC) Program (Sandia, Lawrence Livermore, and Los Alamos) collaboratively explored performance portability programming environments in the context of several ASC co-design proxy applica- tions as part of a tri-lab L2 milestone executed by the co-design teams at each laboratory. The programming environments that were studied included Kokkos (developed at Sandia), RAJA (LLNL), and Legion (Stan- ford University). The proxy apps studied included: miniAero, LULESH, CoMD, Kripke, and SNAP. These programming models and proxy-apps are described herein. Each lab focused on amore » particular combination of abstractions and proxy apps, with the goal of assessing performance portability using those. Performance portability was determined by: a) the ability to run a single application source code on multiple advanced architectures, b) comparing runtime performance between \

NASA's aeronautics research and technology base

NASA Technical Reports Server (NTRS)

1979-01-01

NASA's research technology base in aeronautics is assessed in terms of: (1) US aeronautical technology needs and requirements in the future; (2) objectives of the aeronautics program; (3) magnitude and scope of the program; and (4) research and technology performed by NASA and other research organizations.

Job-Preference and Job-Matching Assessment Results and Their Association with Job Performance and Satisfaction among Young Adults with Developmental Disabilities

ERIC Educational Resources Information Center

Hall, Julie; Morgan, Robert L.; Salzberg, Charles L.

2014-01-01

We investigated the effects of preference and degree of match on job performance of four 19 to 20-year-old young adults with developmental disabilities placed in community-based job conditions. We identified high-preference, high-matched and low-preference, low-matched job tasks using a video web-based assessment program. The job matching…

Curriculum Based Functional Vocational Assessment Guide. Correlation of the Life Centered Career Education Curriculum with Specific Occupational Programs, Standards of Work Performance, and Campus Assessment Instruments.

ERIC Educational Resources Information Center

Quinones, William A.

This document is a guide developed for the Dallas Independent School District's (DISD's) Multiple Careers Magnet Center, which provides special education students with training in standards of work performance and specific occupational skills for successful transition to community life and employment. The document also provides information for…

TRU Waste Management Program. Cost/schedule optimization analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Detamore, J.A.; Raudenbush, M.H.; Wolaver, R.W.

This Current Year Work Plan presents in detail a description of the activities to be performed by the Joint Integration Office Rockwell International (JIO/RI) during FY86. It breaks down the activities into two major work areas: Program Management and Program Analysis. Program Management is performed by the JIO/RI by providing technical planning and guidance for the development of advanced TRU waste management capabilities. This includes equipment/facility design, engineering, construction, and operations. These functions are integrated to allow transition from interim storage to final disposition. JIO/RI tasks include program requirements identification, long-range technical planning, budget development, program planning document preparation, taskmore » guidance development, task monitoring, task progress information gathering and reporting to DOE, interfacing with other agencies and DOE lead programs, integrating public involvement with program efforts, and preparation of reports for DOE detailing program status. Program Analysis is performed by the JIO/RI to support identification and assessment of alternatives, and development of long-term TRU waste program capabilities. These analyses include short-term analyses in response to DOE information requests, along with performing an RH Cost/Schedule Optimization report. Systems models will be developed, updated, and upgraded as needed to enhance JIO/RI's capability to evaluate the adequacy of program efforts in various fields. A TRU program data base will be maintained and updated to provide DOE with timely responses to inventory related questions.« less

Redesigning a clinical mentoring program for improved outcomes in the clinical training of clerks

PubMed Central

Lin, Chia-Der; Lin, Blossom Yen-Ju; Lin, Cheng-Chieh; Lee, Cheng-Chun

2015-01-01

Introduction Mentorship has been noted as critical to medical students adapting to clinical training in the medical workplace. A lack of infrastructure in a mentoring program might deter relationship building between mentors and mentees. This study assessed the effect of a redesigned clinical mentoring program from the perspective of clerks. The objective was to assess the benefits of the redesigned program and identify potential improvements. Methods A redesigned clinical mentoring program was launched in a medical center according to previous theoretical and practical studies on clinical training workplaces, including the elements of mentor qualifications, positive and active enhancers for mentor–mentee relationship building, the timing of mentoring performance evaluation, and financial and professional incentives. A four-wave web survey was conducted, comprising one evaluation of the former mentoring program and three evaluations of the redesigned clinical mentoring program. Sixty-four fifth-year medical students in clerkships who responded to the first wave and to at least two of the three following waves were included in the study. A structured and validated questionnaire encompassing 15 items on mentor performance and the personal characteristics of the clerks was used. Mixed linear models were developed for repeated measurements and to adjust for personal characteristics. Results The results revealed that the redesigned mentoring program improved the mentors’ performance over time for most evaluated items regarding professional development and personal support provided to the mentees. Conclusions Our findings serve as an improved framework for the role of the institution and demonstrate how institutional policies, programs, and structures can shape a clinical mentoring program. We recommend the adoption of mentorship schemes for other cohorts of medical students and for different learning and training stages involved in becoming a physician. PMID:26384479

Field Assessment of Energy Audit Tools for Retrofit Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Edwards, J.; Bohac, D.; Nelson, C.

2013-07-01

This project focused on the use of home energy ratings as a tool to promote energy retrofits in existing homes. A home energy rating provides a quantitative appraisal of a home’s energy performance, usually compared to a benchmark such as the average energy use of similar homes in the same region. Rating systems based on energy performance models, the focus of this report, can establish a home’s achievable energy efficiency potential and provide a quantitative assessment of energy savings after retrofits are completed, although their accuracy needs to be verified by actual measurement or billing data. Ratings can also showmore » homeowners where they stand compared to their neighbors, thus creating social pressure to conform to or surpass others. This project field-tested three different building performance models of varying complexity, in order to assess their value as rating systems in the context of a residential retrofit program: Home Energy Score, SIMPLE, and REM/Rate.« less

The Vehicle Integrated Performance Analysis Experience: Reconnecting With Technical Integration

NASA Technical Reports Server (NTRS)

McGhee, D. S.

2006-01-01

Very early in the Space Launch Initiative program, a small team of engineers at MSFC proposed a process for performing system-level assessments of a launch vehicle. Aimed primarily at providing insight and making NASA a smart buyer, the Vehicle Integrated Performance Analysis (VIPA) team was created. The difference between the VIPA effort and previous integration attempts is that VIPA a process using experienced people from various disciplines, which focuses them on a technically integrated assessment. The foundations of VIPA s process are described. The VIPA team also recognized the need to target early detailed analysis toward identifying significant systems issues. This process is driven by the T-model for technical integration. VIPA s approach to performing system-level technical integration is discussed in detail. The VIPA process significantly enhances the development and monitoring of realizable project requirements. VIPA s assessment validates the concept s stated performance, identifies significant issues either with the concept or the requirements, and then reintegrates these issues to determine impacts. This process is discussed along with a description of how it may be integrated into a program s insight and review process. The VIPA process has gained favor with both engineering and project organizations for being responsive and insightful

Learning Skills Profiles of master's students in nursing administration: assessing the impact of problem-based learning.

PubMed

Baker, Constance M; McDaniel, Anna M; Pesut, Daniel J; Fisher, Mary L

2007-01-01

Attempts to compare graduate student performances before and after introducing new curricula are rare; yet faculties need outcome measures to justify program costs and demonstrate effectiveness. Boyatzis and Kolb's Learning Skills Profile is used to assess the outcomes of a problem-based learning MSN program. Increases were demonstrated among all 12 learning skills; statistically significant increases were found in eight of the personal learning skills and six of the job skill demands. Comparisons are made between scores of students in the MSN program and scores of master's students in business administration.

An Overview of the VHITAL Program: A Two-Stage Bismuth Fed Very High Specific Impulse Thruster with Anode Layer

NASA Technical Reports Server (NTRS)

Sengupta, Anita; Marrese-Reading, Colleen; Capelli, Mark; Scharfe, David; Tverdokhlebov, Sergey; Semenkin, Sasha; Tverdokhlebov, Oleg; Boyd, Ian; Keidar, Michael; Yalin, Azer;

The relationship between physician participation in continuing professional development programs and physician in-practice peer assessments.

PubMed

Wenghofer, Elizabeth F; Marlow, Bernard; Campbell, Craig; Carter, Lorraine; Kam, Sophia; McCauley, William; Hill, Lori

2014-06-01

To investigate the relationship between physicians' performance, as evaluated through in-practice peer assessments, and their participation in continuing professional development (CPD). The authors examined the predictive effects of participating in the CPD programs of the Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada one year before in-practice peer assessments conducted by the medical regulatory authority in Ontario, Canada, in 2008-2009. Two multivariate logistic regression models were used to determine whether physicians who reported participating in any CPD and group-based, assessment-based, and/or self-directed CPD activities were more or less likely to receive satisfactory assessments than physicians who had not. All models were adjusted for the effects of sex, age, specialty certification, practice location, number of patient visits per week, hours worked per week, and international medical graduate status. A total of 617 physicians were included in the study. Analysis revealed that physicians who reported participating in any CPD activities were significantly more likely (odds ratio [OR] = 2.5; P = .021) to have satisfactory assessments than those who had not. In addition, physicians participating in group-based CPD activities were more likely to have satisfactory assessments than those who did not (OR = 2.4; P = .016). There is encouraging evidence supporting a positive predictive association between participating in CPD and performance on in-practice peer assessments. The findings have potential implications for policies which require physicians to participate in programs of lifelong learning.

Assessment of village health worker training program in Tuguegarao, Philippine.

PubMed

Kim, Jung Min; Koh, Kwang Wook; Oak, Chul Ho; Jung, Woo Hyuk; Kim, Sung Hyun; Park, Dae Hee

2009-11-01

This study was performed to evaluate the effectiveness of 'village health worker training program' which aimed to build community participatory health promotion capacity of community leaders in villages of low developed country and to develop methods for further development of the program. The intervention group were 134 community leaders from 25 barangays (village). Control group were 149 form 4 barangays. Intervention group participated 3-day training program. Questionnaire was developed based on 'Health Promotion Capacity Checklist' which assessed capacity in 4 feathers; 'knowledge', 'skill', 'commitment', and 'resource'. Each feather was assessed in 4 point rating scale. Capacity scores between intervention group and control group were examined to identify changes between the pre- and post-intervention periods. A qualitative evaluation of the program was conducted to assess the appropriateness of the program. The program was conducted in Tuguegarao city, Philippine in January, 2009. The result showed significant increases in the total health promotion capacity and each feather of health promotion capacities between pre and post assessment of intervention group. But there was no significant change in that of control group. Participants marked high level of satisfaction for preparedness, selection of main subjects and education method. Qualitative evaluation revealed that training program facilitated community participatory health promotion capacity of participants. This study suggested that the Village health worker training program is effective for building health promotion capacity of community leaders and it can be a main method for helping low developed countries with further development.

Long-Term Effectiveness of the Reading Recovery Early Reading Intervention Program in a Rural School District

ERIC Educational Resources Information Center

Vaughan, Adam Warren

2011-01-01

There are many programs that specialize in teaching students the necessary strategies for reading. But which ones will have the greatest impact and provide lasting skills to struggling students? The purpose of this study was to assess the effectiveness of the Reading Recovery early intervention program on the lowest performing first grade students…

Top Textbooks on Reserve: Creating, Promoting, and Assessing a Program to Help Meet Students' Need for Affordable Textbooks

ERIC Educational Resources Information Center

Thompson, Hilary H.; Cotton, Jennifer E. M.

2017-01-01

In Fall 2014 the University of Maryland Libraries launched a textbook reserves program to help relieve the burden of high textbook costs on students. Although its initial performance was lackluster, workflow refinements and expanded promotion greatly improved usage, resulting in a tenfold increase in circulation and expansion of the program. This…

Mississippi Curriculum Framework for Vehicle and Mobile Equipment Mechanics (Program CIP: 47.0699--Vehicle and Mobile Equipment Mech.). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for vehicle and mobile equipment mechanics I and II. Presented first are a…

Mississippi Curriculum Framework for Child Care and Guidance Management and Services (Program CIP: 20.0201--Child Care & Guidance Workers and Managers). Secondary Programs.

ERIC Educational Resources Information Center

Mississippi Research and Curriculum Unit for Vocational and Technical Education, State College.

This document, which reflects Mississippi's statutory requirement that instructional programs be based on core curricula and performance-based assessment, contains outlines of the instructional units required in local instructional management plans and daily lesson plans for child care and guidance management and services I and II. Presented first…

The Impact of the Stanford Math Intervention Program and School Climate on Mathematics Achievement Levels of Female Middle School Students

ERIC Educational Resources Information Center

Carwell, Tamika L.

2012-01-01

The study's focus was to determine whether or not there was a significant statistical relationship between improved student performance scores from the Education Program for Gifted Youth (EPGY) Stanford Math Intervention Program and Discovery Formative Assessment mathematics mean scores of female middle school students. An additional focus of…