Evaluation: Review of the Past, Preview of the Future.

ERIC Educational Resources Information Center

Smith, M. F.

1994-01-01

This paper summarized contributors' ideas about evaluation as a field and where it is going. Topics discussed were qualitative versus quantitative debate; evaluation's purpose; professionalization; program failure; program development; evaluators as advocates; evaluation knowledge; evaluation expansion; and methodology and design. (SLD)

Evaluation of a Research Mentorship Program in Community Care

ERIC Educational Resources Information Center

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Building for the Future: Community College Leadership Development Program Evaluation

ERIC Educational Resources Information Center

Bresso, Michele

2012-01-01

This qualitative descriptive study examines and evaluates an internal, grow-your-own, community college leadership development program. Participants in a community college leadership development program self-reported their leadership knowledge, attitudes, and practices (KAP) before, during, and after participation in the program. Study…

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Introduction Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Methods Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Results Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. Conclusions The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Program Evaluation: A Review and Synthesis.

ERIC Educational Resources Information Center

Webber, Charles F.

This paper reviews models of program evaluation. Major topics and issues found in the evaluation literature include quantitative versus qualitative approaches, identification and involvement of stakeholders, formulation of research questions, collection of data, analysis and interpretation of data, reporting of results, evaluation utilization, and…

Miramar College Program Evaluation: Aviation Maintenance.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in aviation maintenance. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent…

An Interprofessional Program Evaluation Case Study: Utilizing Multiple Measures To Assess What Matters. AIR 1997 Annual Forum Paper.

ERIC Educational Resources Information Center

Delaney, Anne Marie

This paper reviews the first two years of a model program-evaluation case study which is intended to show: (1) how program evaluation can contribute to academic and professional degree programs; (2) how qualitative and quantitative techniques can be used to produce reliable measures for evaluation studies; and (3) how the role of the institutional…

Miramar College Program Evaluation: Criminal Justice.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in criminal justice. The report first outlines the information gathered in an interview with the program chairperson, conducted to determine program objectives and goals and how they were determined,…

Miramar College Program Evaluation: Fire Science.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in fire sciences. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent to…

New Teacher Induction: A Program Evaluation

ERIC Educational Resources Information Center

Hunter, J. Warren

2016-01-01

The purpose of this qualitative program evaluation was to examine the impact a two-year new teacher induction program had on teachers' feelings of support, satisfaction, and self-efficacy. The program purports that higher feelings of support, satisfaction, and self-efficacy in teachers will lead to lower teacher attrition. In turn, research shows…

Impact of Participation in TimeSlips, a Creative Group-Based Storytelling Program, on Medical Student Attitudes Toward Persons With Dementia: A Qualitative Study

PubMed Central

George, Daniel R.; Stuckey, Heather L.; Dillon, Caroline F.; Whitehead, Megan M.

2011-01-01

Purpose: To evaluate whether medical student participation in TimeSlips (TS), a creative group-based storytelling program, with persons affected by dementia would improve student attitudes toward this patient population. Design and Methods: Fifteen fourth-year medical students from Penn State College of Medicine participated in a month-long regimen of TS sessions at a retirement community. Student course evaluations were analyzed at the conclusion of the program to examine perceived qualitative changes in attitude. Findings: Qualitative data revealed insights into the manner in which student attitudes toward a geriatric patient population became more positive. Implications: This is the first known pilot study to suggest that participation in a creative group-based storytelling program might improve medical student attitudes toward persons with dementia. PMID:21665958

Evaluation of National Institute for Learning Development and Discovery Educational Therapy Program

ERIC Educational Resources Information Center

Frimpong, Prince Christopher

2014-01-01

In Maryland, some Christian schools have enrolled students with learning disabilities (LDs) but do not have any interventional programs at the school to help them succeed academically. The purpose of this qualitative program evaluation was to evaluate the National Institute for Learning Development (NILD) and Discovery Therapy Educational Program…

Qualitative Evaluation of Emotional Intelligence In-Service Program for Secondary School Teachers

ERIC Educational Resources Information Center

Fer, Seval

2004-01-01

This paper is an attempt to evaluate the Emotional Intelligence (EQ) In-Service Program on the basis of experiences of 20 secondary school teachers who attended the program in a private school in Turkey. A phenomenological approach, with a focus group method was used. The first objective of this study was to evaluate EQ program on the basis of…

Qualitative Analysis of Written Reflections during a Teaching Certificate Program

PubMed Central

Castleberry, Ashley N.; Payakachat, Nalin; Ashby, Sarah; Nolen, Amanda; Carle, Martha; Neill, Kathryn K.

2016-01-01

Objective. To evaluate the success of a teaching certificate program by qualitatively evaluating the content and extent of participants’ reflections. Methods. Two investigators independently identified themes within midpoint and final reflection essays across six program years. Each essay was evaluated to determine the extent of reflection in prompted teaching-related topic areas (strengths, weaknesses, assessment, feedback). Results. Twenty-eight themes were identified within 132 essays. Common themes encompassed content delivery, student assessment, personal successes, and challenges encountered. Deep reflection was exhibited, with 48% of essays achieving the highest level of critical reflection. Extent of reflection trended higher from midpoint to final essays, with significant increases in the strengths and feedback areas. Conclusion. The teaching certificate program fostered critical reflection and self-reported positive behavior change in teaching, thus providing a high-quality professional development opportunity. Such programs should strongly consider emphasizing critical reflection through required reflective exercises at multiple points within program curricula. PMID:26941436

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

The Design and Pilot Evaluation of an Interactive Learning Environment for Introductory Programming Influenced by Cognitive Load Theory and Constructivism

ERIC Educational Resources Information Center

Moons, Jan; De Backer, Carlos

2013-01-01

This article presents the architecture and evaluation of a novel environment for programming education. The design of this programming environment, and the way it is used in class, is based on the findings of constructivist and cognitivist learning paradigms. The environment is evaluated based on qualitative student and teacher evaluations and…

Evaluating the BK 21 Program. Research Brief

ERIC Educational Resources Information Center

Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.

2008-01-01

The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…

Supplemental Literacy Instruction for Students with Down Syndrome: A Program Evaluation

ERIC Educational Resources Information Center

Regan, Lisa Michelle

2013-01-01

The study utilizes an inductive, qualitative approach to program evaluation to understand the nature of an afterschool literacy tutoring program for students with Down syndrome. Two research questions guide this study: (a) What are the curricular and instructional elements of the Let's Read Now (LRN) literacy tutoring program for students…

A qualitative evaluation of fire safety education programs for older adults.

PubMed

Diekman, Shane T; Stewart, Tamara A; Teh, S Leesia; Ballesteros, Michael F

2010-03-01

This article presents a qualitative evaluation of six fire safety education programs for older adults delivered by public fire educators. Our main aims were to explore how these programs are implemented and to determine important factors that may lead to program success, from the perspectives of the public fire educators and the older adults. For each program, we interviewed the public fire educator(s), observed the program in action, and conducted focus groups with older adults attending the program. Analysis revealed three factors that were believed to facilitate program success (established relationships with the older adult community, rapport with older adult audiences, and presentation relevance) as well as three challenges (lack of a standardized curriculum and program implementation strategies, attendance difficulties, and physical limitations due to age). More fire safety education should be developed for older adult populations. For successful programs, public fire educators should address the specific needs of their local older adult community.

An economic analysis methodology for project evaluation and programming.

DOT National Transportation Integrated Search

2013-08-01

Economic analysis is a critical component of a comprehensive project or program evaluation methodology that considers all key : quantitative and qualitative impacts of highway investments. It allows highway agencies to identify, quantify, and value t...

Computing in Qualitative Analysis: A Healthy Development?

ERIC Educational Resources Information Center

Richards, Lyn; Richards, Tom

1991-01-01

Discusses the potential impact of computers in qualitative health research. Describes the original goals, design, and implementation of NUDIST, a qualitative computing software. Argues for evaluation of the impact of computer techniques and for an opening of debate among program developers and users to address the purposes and power of computing…

Quantitative and Qualitative Evaluations of the Enhanced Logo-autobiography Program for Korean-American Women.

PubMed

Sung, Kyung Mi; Bernstein, Kunsook

2017-12-01

This study extends Bernstein et al.'s (2016) investigation of the effects of the Enhanced Logo-autobiography Program on Korean-American women's depressive symptoms, coping strategies, purpose in life, and posttraumatic growth by analyzing quantitative and qualitative data. This study's participants significantly improved on quantitative measures of depression, coping strategies, purpose in life, and post-traumatic growth at eight weeks post-intervention and follow-up. The qualitative content analysis revealed 17 themes with five essential themes. The program's activity to promote purpose in life through posttraumatic growth facilitated participants' recovery from traumatic experiences. Standardized guidelines are needed to conduct this program in Korean community centers.

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

75 FR 25239 - Integrated Risk Information System (IRIS); Announcement of Availability of Literature Searches...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-07

... human health assessment program that evaluates quantitative and qualitative risk information on effects... quantitative and qualitative risk information on effects that may result from exposure to specific chemical...

Systematic review of qualitative evaluations of reentry programs addressing problematic drug use and mental health disorders amongst people transitioning from prison to communities.

PubMed

Kendall, Sacha; Redshaw, Sarah; Ward, Stephen; Wayland, Sarah; Sullivan, Elizabeth

2018-03-02

The paper presents a systematic review and metasynthesis of findings from qualitative evaluations of community reentry programs. The programs sought to engage recently released adult prison inmates with either problematic drug use or a mental health disorder. Seven biomedical and social science databases, Cinahl, Pubmed, Scopus, Proquest, Medline, Sociological abstracts and Web of Science and publisher database Taylor and Francis were searched in 2016 resulting in 2373 potential papers. Abstract reviews left 140 papers of which 8 were included after detailed review. Major themes and subthemes were identified through grounded theory inductive analysis of results from the eight papers. Of the final eight papers the majority (6) were from the United States. In total, the papers covered 405 interviews and included 121 (30%) females and 284 (70%) males. Findings suggest that the interpersonal skills of case workers; access to social support and housing; and continuity of case worker relationships throughout the pre-release and post-release period are key social and structural factors in program success. Evaluation of community reentry programs requires qualitative data to contextualize statistical findings and identify social and structural factors that impact on reducing incarceration and improving participant health. These aspects of program efficacy have implications for reentry program development and staff training and broader social and health policy and services.

Partnership, knowledge translation, and substance abuse prevention with a First Nations community.

PubMed

Baydala, Lola; Fletcher, Fay; Worrell, Stephanie; Kajner, Tania; Letendre, Sherry; Letendre, Liz; Rasmussen, Carmen

2014-01-01

Having identified substance abuse as an issue of concern in their community, the Alexis Nakota Sioux Nation invited University of Alberta researchers to partner on the cultural adaptation, delivery, and evaluation of a school-based drug and alcohol abuse prevention program. Researchers conducted a literature review of available drug and alcohol prevention programs for children and youth, identifying the Life Skills Training (LST) program as a viable model for cultural adaptation. Four program objectives were developed: (1) Review and cultural adaptation of the elementary and junior high LST programs, (2) delivery of the adapted programs, (3) measurement of changes in students' knowledge of the negative effects of drug and alcohol use, attitudes toward drugs and alcohol, drug and alcohol refusal and life skills, and changes in self-esteem/self-concept, and (4) documentation of the community's experience of the project. Using the principles of community-based participatory research (CBPR), we employed both qualitative and quantitative methods to evaluate the impact of the project. Qualitative evaluation of the program adaptation and implementation were both positive. Qualitative measures of program impact on students revealed a positive effect, whereas results of the quantitative measures were mixed. Culturally adapted, evidence-based programs can have a positive effect on Aboriginal youth and their communities. Strategies to expand knowledge translation (KT) when working with Aboriginal communities include working to create an "ethical space" that draws on the strengths of both Western and Indigenous worldviews.

Innovations in Doctoral Education: Distance Education Methodology Applied

ERIC Educational Resources Information Center

Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan

2009-01-01

This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…

Effectiveness of the Combat Operational Stress Control Training Program: Expectations of the U.S. Marine Corps

ERIC Educational Resources Information Center

Sipko, Marek M.

2010-01-01

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions. The…

Community Engaged Service-Learning: The Effect on University Students and Community Partners

ERIC Educational Resources Information Center

Steele, Susan C.

2012-01-01

The notion that an ethic of service can be fostered through participation in an academic community engaged service-learning program was the underlying premise for this program evaluation study. The purpose of this program evaluation study, using both quantitative and qualitative measures in a thoughtfully organized setting of university and…

An Evaluation of a Program to Help Dual-Earner Couples Share the Second Shift.

ERIC Educational Resources Information Center

Hawkins, Alan J.; And Others

1994-01-01

Used both traditional scientific and feminist methodologies to evaluate effectiveness of family life education program designed to help dual-earner couples (n=14 couples) share domestic labor. Both quantitative and qualitative data suggest that program produced small increases in husbands' involvement in both housework and child care and large…

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

Harnessing health information to foster disadvantaged teens' community engagement, leadership skills, and career plans: a qualitative evaluation of the Teen Health Leadership Program.

PubMed

Keselman, Alla; Ahmed, Einas A; Williamson, Deborah C; Kelly, Janice E; Dutcher, Gale A

2015-04-01

This paper describes a qualitative evaluation of a small-scale program aiming to improve health information literacy, leadership skills, and interest in health careers among high school students in a low-income, primarily minority community. Graduates participated in semi-structured interviews, transcripts of which were coded with a combination of objectives-driven and data-driven categories. The program had a positive impact on the participants' health information competency, leadership skills, academic orientation, and interest in health careers. Program enablers included a supportive network of adults, novel experiences, and strong mentorship. The study suggests that health information can provide a powerful context for enabling disadvantaged students' community engagement and academic success.

Pre-Placement Program for Severely Multi-Handicapped Deaf-Blind Children, 1980-1981. Final Evaluation Report.

ERIC Educational Resources Information Center

Tobias, Robert; And Others

Evaluation of the sixth and final year of operation for a preplacement program for 13 severely multiply handicapped deaf blind children, located in the Industrial Home for the Blind, is reported. The program is explained to prepare students for entrance into their existing special education programs. Qualitative findings on the physical setting,…

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program

ERIC Educational Resources Information Center

Davis, LaShara A.; Morgan, Susan E.; Mobley, Amy R.

2016-01-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported…

Evaluating the Impact of Cooperative Extension Outreach via Twitter

ERIC Educational Resources Information Center

O'Neill, Barbara

2014-01-01

Twitter is increasingly being used by Extension educators as a teaching and program-marketing tool. It is not enough, however, to simply use Twitter to disseminate information. Steps must be taken to evaluate program impact with quantitative and qualitative data. This article described the following Twitter evaluation metrics: unique hashtags,…

Evaluation Techniques for the Sandy Point Discovery Center, Great Bay National Estuarine Research Reserve.

ERIC Educational Resources Information Center

Heffernan, Bernadette M.

1998-01-01

Describes work done to provide staff of the Sandy Point Discovery Center with methods for evaluating exhibits and interpretive programming. Quantitative and qualitative evaluation measures were designed to assess the program's objective of estuary education. Pretest-posttest questionnaires and interviews are used to measure subjects' knowledge and…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

Using qualitative and quantitative methods to evaluate small-scale disease management pilot programs.

PubMed

Esposito, Dominick; Taylor, Erin Fries; Gold, Marsha

2009-02-01

Interest in disease management programs continues to grow as managed care plans, the federal and state governments, and other organizations consider such efforts as a means to improve health care quality and reduce costs. These efforts vary in size, scope, and target population. While large-scale programs provide the means to measure impacts, evaluation of smaller interventions remains valuable as they often represent the early planning stages of larger initiatives. This paper describes a multi-method approach for evaluating small interventions that sought to improve the quality of care for Medicaid beneficiaries with multiple chronic conditions. Our approach relied on quantitative and qualitative methods to develop a complete understanding of each intervention. Quantitative data in the form of both process measures, such as case manager contacts, and outcome measures, such as hospital use, were reported and analyzed. Qualitative information was collected through interviews and the development of logic models to document the flow of intervention activities and how they were intended to affect outcomes. The logic models helped us to understand the underlying reasons for the success or lack thereof of each intervention. The analysis provides useful information on several fronts. First, qualitative data provided valuable information about implementation. Second, process measures helped determine whether implementation occurred as anticipated. Third, outcome measures indicated the potential for favorable results later, possibly suggesting further study. Finally, the evaluation of qualitative and quantitative data in combination helped us assess the potential promise of each intervention and identify common themes and challenges across all interventions.

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Reflections on Empowerment Evaluation: Learning from Experience.

ERIC Educational Resources Information Center

Fetterman, David M.

1999-01-01

Reflects on empowerment evaluation, the use of evaluation to foster improvement and self-determination. Empowerment evaluation uses quantitative and qualitative methods, and usually focuses on program evaluation. Discusses the growth in empowerment evaluation as a result of interest in participatory evaluation. (SLD)

A Mobile Health App–Based Postnatal Educational Program (Home-but not Alone): Descriptive Qualitative Study

PubMed Central

Yang, Yen Yen; Dennis, Cindy-Lee

2018-01-01

Background The postnatal period poses numerous challenges for new parents. Various educational programs are available to support new parents during this stressful period. However, the usefulness of educational programs must be evaluated to ascertain their credibility. Objective The aim of this descriptive, qualitative study was to explore the views of parents of newborns with regard to the content and delivery of a mobile health (mHealth) app–based postnatal educational program. Methods A qualitative semistructured interview guide was used to collect data from 17 participants who belonged to the intervention group of a randomized controlled trial. The intervention, a 4-week-long access to a mHealth app–based educational program, was evaluated. The interviews were conducted in English and at the participants’ homes. Thematic analysis was used to analyze the data. The Consolidated Criteria for Reporting Qualitative Research checklist was used to report the findings. Results The interviews revealed 4 main themes: (1) positive features of the mHealth app, (2) advice from midwives, (3) experiences gained from using the mHealth app, and (4) recommendations for the future. The participants evaluated the educational program to be a good source of information that was tailored to the local context. The different modes of delivery, including audio and video, accentuated the accessibility of information. The parents evaluated that the facilitator of the featured communication platform, a midwife, provided trustworthy advice. Belongingness to a virtual community beyond the hospital endowed the parents the confidence that they were not alone and were supported by other parents and health care professionals. Conclusions According to the parents, the mHealth app–based educational program was helpful in supporting a multi-ethnic sample of parents during the postnatal period. This insight indicates that the program could be implemented in a wide community of parents in the postnatal period. The helpfulness of the educational program is a testament of the potential benefits of using telemedicine among new parents postnatally. Resources can also be dedicated toward extending the duration of access to the app beyond 1 month and developing relevant content for parents across the perinatal period. PMID:29674314

Health Care Merged With Senior Housing: Description and Evaluation of a Successful Program.

PubMed

Barry, Theresa Teta

2017-01-01

Objective: This article describes and evaluates a successful partnership between a large health care organization and housing for seniors. The program provides on-site, primary care visits by a physician and a nurse in addition to intensive social services to residents in an affordable senior housing apartment building located in Pennsylvania. Per Donabedian's "Structure-Process-Outcome" model, the program demonstrated positive health care outcomes for its participants via a prescribed structure. To provide guidance for replication in similar settings, we qualitatively evaluated the processes by which successful outcomes were obtained. Methods: With program structures in place and outcomes measured, this case study collected and analyzed qualitative information taken from key informant interviews on care processes involved in the program. Themes were extracted from semistructured interviews and used to describe the processes that helped and hindered the program. Results and Discussion: Common processes were identified across respondents; however, the nuanced processes that lead to successful outcomes suggest that defined structures and processes may not be sufficient to produce similar outcomes in other settings. Further research is needed to determine the program's replicability and policy implications.

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

Evaluating Writing Programs: Paradigms, Problems, Possibilities.

ERIC Educational Resources Information Center

McLeod, Susan H.

1992-01-01

Describes two methodological approaches (qualitative and quantitative) that grow out of two different research examples. Suggests the problems these methods present. Discusses the ways in which an awareness of these problems can help teachers to understand how to work with researchers in designing useful evaluations of writing programs. (PRA)

An Evaluation of the Federal Class-Size Reduction Program in Wake County, North Carolina--1999-2000.

ERIC Educational Resources Information Center

Scudder, David F.

An empirical evaluation of the federal class-size reduction (CSR) program in Wake County, North Carolina, during the 1999-2000 school year is presented. The qualitative process evaluation showed implementation issues involving the mechanics and the meaning of CSR. Often, schools did not understand where CSR occurred because of changing enrollment…

The relevance of qualitative research for clinical programs in psychiatry.

PubMed

Goering, Paula; Boydell, Katherine M; Pignatiello, Antonio

2008-03-01

It is time to move beyond education about qualitative research theory and methods to using them to understand and improve psychiatric practice. There is a good fit between this agenda and current thinking about research use that broadens definitions of evidence beyond the results of experiments. This paper describes a qualitative program evaluation to illustrate what kind of useful knowledge is generated and how it can be created through a clinician-researcher partnership. The linkage and exchange model of effective knowledge translation described involves interaction between clinicians and researchers throughout the research process and results in mutual learning through the planning, disseminating, and application of existing or new qualitative research in decision making.

Medical Students' and Tutors' Experiences of Directed and Self-Directed Learning Programs in Evidence-Based Medicine: A Qualitative Evaluation Accompanying a Randomized Controlled Trial

ERIC Educational Resources Information Center

Bradley, Peter; Oterholt, Christina; Nordheim, Lena; Bjorndal, Arild

2005-01-01

This qualitative study aims to interpret the results of a randomized controlled trial comparing two educational programs (directed learning and self-directed learning) in evidence-based medicine (EBM) for medical students at the University of Oslo from 2002 to 2003. There is currently very little comparative educational research in this field. In…

Tennessee long-range transportation plan : project evaluation system

DOT National Transportation Integrated Search

2005-12-01

The Project Evaluation System (PES) Report is an analytical methodology to aid programming efforts and prioritize multimodal investments. The methodology consists of both quantitative and qualitative evaluation criteria built upon the Guiding Princip...

Title I ESEA, High School; English as a Second Language: 1979-1980. OEE Evaluation Report.

ERIC Educational Resources Information Center

New York City Board of Education, Brooklyn, NY. Office of Educational Evaluation.

The report is an evaluation of the 1979-80 High School Title I English as a Second Language Program. Two types of information are presented: (1) a narrative description of the program which provides qualitative data regarding the program, and (2) a statistical analysis of test results which consists of quantitative, city-wide data. By integrating…

A System for the Exchange of Information on Instructional Materials: An Evaluation for Planned Change in Australian Education.

ERIC Educational Resources Information Center

Watt, Michael G.

This evaluation project presents a plan for a program to establish a clearinghouse for exchanging qualitative and quantitative data on instructional materials used in Australian schools. A range of elements necessary to plan a program suited to Australian requirements and conditions was investigated. Focus was on: the program's mission,…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

VoiceThread: A Useful Program Evaluation Tool

ERIC Educational Resources Information Center

Mott, Rebecca

2018-01-01

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

PubMed

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

Adult Offenders' Perceptions of Rehabilitation Programs in Africa

ERIC Educational Resources Information Center

Ngozwana, Nomazulu

2017-01-01

This article reflects on adult offenders' perceptions of rehabilitation programs in Africa. It also evaluates whether offenders are consulted when planning rehabilitation programs. Adult education principles were used as a lens to understand offenders' perceptions of rehabilitation programs. Using an interpretive paradigm and qualitative approach,…

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Developing Leadership for Life: Outcomes from a Collegiate Student-Alumni Mentoring Program

ERIC Educational Resources Information Center

Priest, Kerry L.; Donley, Sarah

2014-01-01

This application brief describes the exploratory assessment of a mentoring program between current students and alumni of a leadership studies minor program. We connect leadership education research and practice in two ways: first, we describe a process of qualitative program evaluation to inform program best practices and improvement. In doing…

Program Performance Inventory: Six Juvenile Offender Programs.

ERIC Educational Resources Information Center

Thomalla, Terri Groff; Dougherty, Victoria J.

This report describes the performance of 6 Connecticut juvenile justice alternative sanction programs in 14 qualitative areas: community reintegration; outcomes and evaluation; assessment methods; risk factors; escalation of criminal activity; family involvement; community involvement; work ethic and vocational training; education and life skills;…

Utility of the Living (Well Through) Intergenerational Fitness and Exercise Program as a County-Delivered Extension Program

ERIC Educational Resources Information Center

Sowle, Ashleigh J.; Francis, Sarah L.; Margrett, Jennifer A.; Franke, Warren D.

2016-01-01

Rural-residing older adults are not participating in regular physical activity. Extension is in an excellent position to fill this programming void through transdisciplinary programming such as the Living (well through) Intergenerational Fitness and Exercise (LIFE) program. Qualitative evaluation was conducted to assess the LIFE program's utility…

An Investigation into the Development, Implementation, and Evaluation of Online Learning Programs for Small Rural Public Schools in Texas

ERIC Educational Resources Information Center

Tabor, Bruce

2012-01-01

This qualitative study investigated the experiences of 10 superintendents in Pre-K-8, 1A, and small 2A schools located in rural areas of Texas, who have implemented an online learning program or programs. Narrative techniques were used to explore the challenges that they faced in the pre-planning, planning, implementation and evaluation of their…

Mentoring doctoral students for qualitative research: interviews with experienced nursing faculty in Japan.

PubMed

Kayama, Mami; Gregg, Misuzu F; Asahara, Kiyomi; Yamamoto-Mitani, Noriko; Okuma, Keiko; Ohta, Kikuko; Kinoshita, Yasuhito

2013-05-01

This study aimed to describe the process of mentoring doctoral students for qualitative research in Japanese graduate programs in nursing. Nine experienced faculty-seven nurse researchers and two sociologists-were interviewed. Participants were asked about their process of mentoring students for qualitative nursing dissertations. Data analysis was conducted using a qualitative descriptive method. Participants' age ranged from 48 to 60 years. The first theme in the mentoring process is about the individualized, one-on-one mentorship process. The second theme occurs in a group process. The third theme is coordinating mentors and establishing a network to support the evaluation system. The mentoring processes identified in this study will be useful for future faculty development. The study elucidated much room for improvement in doctoral education programs for qualitative research methods in nursing science. Copyright 2013, SLACK Incorporated.

Class Size Reduction in a Large Urban School District: A Mixed Methodology Evaluation Research Study.

ERIC Educational Resources Information Center

Munoz, Marco A.

This study evaluated the Class Size Reduction (CSR) program in 34 elementary schools in Kentucky's Jefferson County Public Schools. The CSR program is a federal initiative to help elementary schools improve student learning by hiring additional teachers. Qualitative data were collected using unstructured interviews, site observations, and document…

Transitional Services for Youth with Developmental Disabilities: Living in College Dorms

ERIC Educational Resources Information Center

Kirkendall, Abbie; Doueck, Howard J.; Saladino, Albert

2009-01-01

This study evaluates the impact of a college-based dormitory program on transitioning youth with intellectual disabilities. A qualitative study, with interviews at pre and post, was conducted to evaluate the program's impact. Data were collected with semistructured interviews from young adults with intellectual disabilities who participated in a…

Evaluating the Effectiveness of READ 180: A Reading Program for Struggling Middle School Students

ERIC Educational Resources Information Center

Johnson, Latonya R.

2011-01-01

This study was conducted using a qualitative approach to evaluate the effectiveness of READ 180 Program in improving students reading interests and achievement at West Bolivar Middle School (WBMS). A number of interviews and observations were conducted. Two teachers and nine students were interviewed, and nine classroom observations were…

Online Extensive Reading for Advanced Foreign Language Learners: An Evaluation Study

ERIC Educational Resources Information Center

Arnold, Nike

2009-01-01

The following article reports the findings of a qualitative evaluation of an online extensive reading program in German as a foreign language. Designed for advanced learners, it differs from traditional extensive reading programs in two important aspects: students read online instead of printed materials, and there was no teacher preselection to…

Quality dimensions in health evaluation: manager's conceptions.

PubMed

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

Empowerment Evaluation: A Form of Self-Evaluation.

ERIC Educational Resources Information Center

Fetterman, David M.

Empowerment evaluation is an innovative approach that uses evaluation concepts and techniques to foster improvement and self-determination. Empowerment evaluation employs qualitative and quantitative methodologies. Although it can be applied to individuals and organizations, the usual focus is on programs. The value orientation of empowerment…

Rational drug therapy education in clinical phase carried out by task-based learning

PubMed Central

Bilge, S. Sırrı; Akyüz, Bahar; Ağrı, Arzu Erdal; Özlem, Mıdık

2017-01-01

Objectives: Irrational drug use results in drug interactions, treatment noncompliance, and drug resistance. Rational pharmacotherapy education is being implemented in many faculties of medicine. Our aim is to introduce rational pharmacotherapy education by clinicians and to evaluate task-based rational drug therapy education in the clinical context. Methods: The Kirkpatrick's evaluation model was used for the evaluation of the program. The participants evaluated the program in terms of constituents of the program, utilization, and contribution to learning. Voluntary participants responded to the evaluation forms after the educational program. Data are evaluated using both quantitative and qualitative tools. SPSS (version 21) used for quantitative data for determining mean and standard deviation values. Descriptive qualitative analysis approach is used for the analysis of open-ended questions. Results: It was revealed that the program and its components have been favorable. A total 95.9% of the students consider the education to be beneficial. Simulated patients practice and personal drug choice/problem-based learning sessions were appreciated by the students in particular. 93.9% of the students stated that all students of medicine should undergo this educational program. Among the five presentations contained in the program, “The Principles of Prescribing” received the highest points (9 ± 1.00) from participating students in general evaluation of the educational program. Conclusion: This study was carried out to improve task-based rational drug therapy education. According to feedback from the students concerning content, method, resource, assessment, and program design; some important changes, especially in number of facilitators and indications, are made in rational pharmacotherapy education in clinical task-based learning program. PMID:28458432

Cardiac Rehabilitation Online Pilot: Extending Reach of Cardiac Rehabilitation.

PubMed

Higgins, Rosemary O; Rogerson, Michelle; Murphy, Barbara M; Navaratnam, Hema; Butler, Michael V; Barker, Lauren; Turner, Alyna; Lefkovits, Jeffrey; Jackson, Alun C

While cardiac rehabilitation (CR) is recommended for all patients after an acute cardiac event, limitations exist in reach. The purpose of the current study was to develop and pilot a flexible online CR program based on self-management principles "Help Yourself Online." The program was designed as an alternative to group-based CR as well as to complement traditional CR. The program was based on existing self-management resources developed previously by the Heart Research Centre. Twenty-one patients admitted to Cabrini Health for an acute cardiac event were recruited to test the program. The program was evaluated using qualitative and quantitative methods. Quantitative results demonstrated that patients believed the program would assist them in their self-management. Qualitative evaluation, using focus group and interview methods with 15 patients, showed that patients perceived the online CR approach to be a useful instrument for self-management. Broader implications of the data include the acceptability of the intervention, timing of intervention delivery, and patients' desire for additional online community support.

A Hospice Rotation for Military Medical Residents: A Mixed Methods, Multi-Perspective Program Evaluation

PubMed Central

Boyden, Jackelyn Y.; Kalish, Virginia B.; Muir, J. Cameron; Richardson, Suzanne; Connor, Stephen R.

2016-01-01

Abstract Background: An estimated 6,000 to 18,000 additional hospice and palliative medicine (HPM) physicians are needed in the United States. A source could be the military graduate medical education system where 15% of U.S. medical residents are trained. A community-based hospice and palliative care organization created a one-week rotation for military residents including participation in interdisciplinary group visits at patients' homes, facilities, and an inpatient hospice unit. Objective: Our goal was to evaluate the effectiveness of a one-week community HPM rotation for military medical residents. Methods: A mixed-methods, multi-stakeholder perspective program evaluation model was used for program years 2011 to 2013. Data were managed and analyzed using Microsoft Excel and Atlas.ti. Participants in the rotation were residents training at two local military hospitals. Program evaluation data were collected from residents, military program liaisons, and hospice clinical preceptors. Quantitative data included pre- and post-tests based on Accreditation Council for Graduate Medical Education competencies completed by residents. Qualitative data included resident essays and semi-structured interviews with hospice preceptors and military program liaisons. Results: Quantitative and qualitative data suggested that the rotation increased military residents' knowledge, attitudes, and comfort level with HPM. Quantitative analysis of test scores indicated improvements from pre- to post-tests in each of five areas of learning. Qualitative data indicated the rotation created a greater appreciation for the overall importance of HPM and increased understanding of eligibility and methods for pain and symptom management. Conclusions: A one-week community hospice rotation for medical military residents impacts participant's knowledge of and attitudes toward HPM. PMID:27139524

A Mobile Health App-Based Postnatal Educational Program (Home-but not Alone): Descriptive Qualitative Study.

PubMed

Shorey, Shefaly; Yang, Yen Yen; Dennis, Cindy-Lee

2018-04-19

The postnatal period poses numerous challenges for new parents. Various educational programs are available to support new parents during this stressful period. However, the usefulness of educational programs must be evaluated to ascertain their credibility. The aim of this descriptive, qualitative study was to explore the views of parents of newborns with regard to the content and delivery of a mobile health (mHealth) app-based postnatal educational program. A qualitative semistructured interview guide was used to collect data from 17 participants who belonged to the intervention group of a randomized controlled trial. The intervention, a 4-week-long access to a mHealth app-based educational program, was evaluated. The interviews were conducted in English and at the participants' homes. Thematic analysis was used to analyze the data. The Consolidated Criteria for Reporting Qualitative Research checklist was used to report the findings. The interviews revealed 4 main themes: (1) positive features of the mHealth app, (2) advice from midwives, (3) experiences gained from using the mHealth app, and (4) recommendations for the future. The participants evaluated the educational program to be a good source of information that was tailored to the local context. The different modes of delivery, including audio and video, accentuated the accessibility of information. The parents evaluated that the facilitator of the featured communication platform, a midwife, provided trustworthy advice. Belongingness to a virtual community beyond the hospital endowed the parents the confidence that they were not alone and were supported by other parents and health care professionals. According to the parents, the mHealth app-based educational program was helpful in supporting a multi-ethnic sample of parents during the postnatal period. This insight indicates that the program could be implemented in a wide community of parents in the postnatal period. The helpfulness of the educational program is a testament of the potential benefits of using telemedicine among new parents postnatally. Resources can also be dedicated toward extending the duration of access to the app beyond 1 month and developing relevant content for parents across the perinatal period. ©Shefaly Shorey, Yen Yen Yang, Cindy-Lee Dennis. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.04.2018.

Evaluating the Success of the Commanders Emergency Response Program in Herat Province, Afghanistan

DTIC Science & Technology

2016-12-01

Afghanistan. The thesis uses a qualitative approach, gathering information and observations from CERP projects completed in Herat Province...Province, Afghanistan. The thesis uses a qualitative approach, gathering information and observations from CERP projects completed in Herat Province...HERAT TEACHER TRAINING CENTER ...................................................................................................33  F.  SUCCESSFUL

75 FR 76982 - Integrated Risk Information System (IRIS); Announcement of Availability of Literature Searches...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-12-10

... quantitative and qualitative risk information on effects that may result from exposure to specific chemical...), Office of Research and Development, U.S. Environmental Protection Agency, Washington, DC 20460; telephone... human health assessment program that evaluates quantitative and qualitative risk information on effects...

77 FR 20817 - Integrated Risk Information System (IRIS); Announcement of Availability of Literature Searches...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-06

... quantitative and qualitative risk information on effects that may result from exposure to specific chemical... Deputy Director, National Center for Environmental Assessment, (mail code: 8601D), Office of Research and... program that evaluates quantitative and qualitative risk information on effects that may result from...

77 FR 41784 - Integrated Risk Information System (IRIS); Announcement of Availability of Literature Searches...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-07-16

... health assessment program that evaluates quantitative and qualitative risk information on effects that..., National Center for Environmental Assessment, (mail code: 8601P), Office of Research and Development, U.S... quantitative and qualitative risk information on effects that may result from exposure to specific chemical...

A Qualitative Evaluation of the Students of Service (SOS) Program for Sexual Abstinence in Louisiana

ERIC Educational Resources Information Center

Yoo, Seunghyun; Johnson, Carolyn C.; Rice, Janet; Manuel, Powlin

2004-01-01

Abstinence-only programs for preventing teen pregnancy are the only options in some states but are the programs of choice in others. Effectiveness data, however, are lacking. The SOS Adolescent Family Life Program (SOS), an abstinence-only teen pregnancy prevention program, was implemented in south central Louisiana. Peer mentoring with an…

Design of a study evaluating the effects, health economics, and stakeholder perspectives of a multi-component occupational rehabilitation program with an added workplace intervention - a  study protocol.

PubMed

Rise, Marit B; Skagseth, Martin; Klevanger, Nina E; Aasdahl, Lene; Borchgrevink, Petter; Jensen, Chris; Tenggren, Hanne; Halsteinli, Vidar; Jacobsen, Trym N; Løland, Svein B; Johnsen, Roar; Fimland, Marius S

2018-02-05

Recent research has suggested that interventions at the workplace might be the most potent ingredient in return to work interventions, but few studies have investigated the different effects of workplace interventions as part of occupational rehabilitation programs. The comprehensive design described in this article includes effect (on return to work and health outcomes), and health economic evaluations of a workplace intervention added to a multicomponent rehabilitation program. Qualitative and mixed method studies will investigate sick-listed persons', rehabilitation therapists' and employers' perspectives on the usability and outcomes of the rehabilitation program and the workplace intervention. The program and intervention are provided to patients with musculoskeletal, psychological or general and unspecified diagnoses. The program is multi-component and includes Acceptance and Commitment Therapy, physical exercise, patient education and creating a plan for increased work participation. Persons who are employed, aged from 18 to 60 years, with a current sick leave status of 50% or more and a diagnosis within the musculoskeletal, psychological or general and unspecified chapters of International Classification of Primary Care-2 (ICPC-2) will be recruited to a researcher-blinded parallel-group randomized controlled trial. All participants take part in an in-patient occupational rehabilitation program, while the intervention group also takes part in an intervention at the workplace. The effect and economic evaluation will investigate the effect of the added workplace intervention. The primary outcome measures will be time until full sustainable return to work and total number of sickness absence days in the 12 months after inclusion. Health economic evaluations will investigate the cost-effectiveness and cost-utility. Qualitative studies will investigate rehabilitation therapists' experiences with working towards return to work within an ACT-approach and stakeholders' experiences with the workplace intervention. A mixed methods study will combine quantitative and qualitative findings on the participants' expectations and motivation for return to work. The outline of this comprehensive study could represent an important addition to the standard designs of return to work evaluation. The mixed methods design, with qualitative approaches as well as a rigorous randomized controlled trial, might prove useful to shed light on contextual factors. ClinicalTrials.gov : NCT02541890 . September 4, 2015.

An Exploratory Study of the United States Naval Academy Engineering Curriculum

DTIC Science & Technology

2007-06-01

research was conducted in an entirely quantitative fashion. There is a large amount of qualitative data that was not analyzed. These data are from the... qualitative assessment of the Naval Academy’s engineering program, and would be an excellent opportunity for future research . Overall, the results of...California: Sage Publications. Patton, M. Q. (1987). How to Use Qualitative Methods in Evaluation. California: Sage Publications. 89

Integrative Reiki for cancer patients: a program evaluation.

PubMed

Fleisher, Kimberly A; Mackenzie, Elizabeth R; Frankel, Eitan S; Seluzicki, Christina; Casarett, David; Mao, Jun J

2014-01-01

This mixed methods study sought to evaluate the outcomes of an integrative Reiki volunteer program in an academic medical oncology center setting. We used de-identified program evaluation data to perform both quantitative and qualitative analyses of participants' experiences of Reiki sessions. The quantitative data were collected pre- and postsession using a modified version of the distress thermometer. The pre- and postsession data from the distress assessment were analyzed using a paired Student's : test. The qualitative data were derived from written responses to open-ended questions asked after each Reiki session and were analyzed for key words and recurring themes. Of the 213 pre-post surveys of first-time sessions in the evaluation period, we observed a more than 50% decrease in self-reported distress (from 3.80 to 1.55), anxiety (from 4.05 to 1.44), depression (from 2.54 to 1.10), pain (from 2.58 to 1.21), and fatigue (from 4.80 to 2.30) with P < .001 for all. Using conservative estimates that treat missing data as not endorsing Reiki, we found 176 (82.6%) of participants liked the Reiki session, 176 (82.6%) found the Reiki session helpful, 157 (73.7%) plan to continue using Reiki, and 175 (82.2%) would recommend Reiki to others. Qualitative analyses found that individuals reported that Reiki induced relaxation and enhanced spiritual well-being. An integrative Reiki volunteer program shows promise as a component of supportive care for cancer patients. More research is needed to evaluate and understand the impact that Reiki may have for patients, caregivers, and staff whose lives have been affected by cancer.

Supportive Training for Inexperienced and New Teachers (STINT). Part I.

ERIC Educational Resources Information Center

Fox, David J.; And Others

This document is an evaluative description of the program conducted by the New York City Board of Education during the 1968-69 school year. Opening chapters describe the two-phase evaluation design (descriptive and qualitative) and outline the program in which an initial group of 152 master teachers plus 100 more added in Febraury were assigned as…

Right timing in formative program evaluation.

PubMed

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Qualitative methods in PhD theses from general practice in Scandinavia.

PubMed

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-12-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox.

Qualitative methods in PhD theses from general practice in Scandinavia

PubMed Central

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-01-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox. PMID:29094644

The Basic Shelf Experience: a comprehensive evaluation.

PubMed

Dewolfe, Judith A; Greaves, Gaye

2003-01-01

The Basic Shelf Experience is a program designed to assist people living on limited incomes to make better use of their food resources. The purpose of this research was to learn if the Basic Shelf Experience program helps such people to 1. utilize food resources more effectively and 2. cope, through group support, with poverty-associated stressors that influence food security. Both quantitative and qualitative methods were used to evaluate the program objectives. Participants completed a questionnaire at the beginning and end of the six-week program. The questionnaire asked about their food access, food security, and feelings about themselves. Participants returned for a focus group discussion and completed the questionnaire again three months after the program ended. The focus group was designed to elicit information about perceived changes, if any, attributed to the program. Forty-two people completed the questionnaires pre-program and 20 post-program; 17 participated in the three-month follow-up session. While results from quantitative data analysis indicate that program objectives were not met, qualitative data provide evidence that the program did achieve its stated objectives. Our results suggest such programs as the Basic Shelf Experience can assist people living on limited incomes to achieve food security.

Implementation and Outcomes of Forensic Housing First Programs.

PubMed

Kriegel, Liat S; Henwood, Benjamin F; Gilmer, Todd P

2016-01-01

This mixed-method study used administrative data from 68 supportive housing programs and evaluative and qualitative site visit data from a subset of four forensic programs to (a) compare fidelity to the Housing First model and residential client outcomes between forensic and nonforensic programs and (b) investigate whether and how providers working in forensic programs can navigate competing Housing First principles and criminal justice mandates. Quantitative findings suggested that forensic programs were less likely to follow a harm reduction approach to substance use and clients in those programs were more likely to live in congregate settings. Qualitative findings suggested that an interplay of court involvement, limited resources, and risk environments influenced staff decisions regarding housing and treatment. Existing mental health and criminal justice collaborations necessitate adaptation to the Housing First model to accommodate client needs.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Understanding the Social Context of School Health Promotion Program Implementation

ERIC Educational Resources Information Center

Cargo, Margaret; Salsberg, Jon; Delormier, Treena; Desrosiers, Serge; Macaulay, Ann C.

2006-01-01

Purpose: Although implementation fidelity is an important component in the evaluation of school health promotion programs, it assumes that teaching is the most relevant teacher role. To understand the social context of program implementation, a qualitative study was undertaken with the aim of identifying the schoolteacher's role in implementing…

Portfolio as a Teaching Method: A Capstone Project to Promote Recognition of Professional Growth

ERIC Educational Resources Information Center

Wolffe, Robert; Crowe, Helja Antola; Evens, Wayne; McConnaughay, Kelly

2013-01-01

A reflective portfolio as a capstone assignment was selected to accomplish recognition by teachers completing a science, technology, mathematics, engineering master's program for elementary teachers about their professional and personal changes and to provide program evaluators additional qualitative data regarding attainment of program goals. As…

77 FR 30512 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-23

..., including through the use of information technology. Please note that written comments received in response.... This study aims to fill a gap by conducting qualitative case studies of up to 15 sites. This study will systematically analyze qualitative data across multiple respondents to generate portraits of programs and...

Evaluation of a Postdischarge Call System Using the Logic Model.

PubMed

Frye, Timothy C; Poe, Terri L; Wilson, Marisa L; Milligan, Gary

2018-02-01

This mixed-method study was conducted to evaluate a postdischarge call program for congestive heart failure patients at a major teaching hospital in the southeastern United States. The program was implemented based on the premise that it would improve patient outcomes and overall quality of life, but it had never been evaluated for effectiveness. The Logic Model was used to evaluate the input of key staff members to determine whether the outputs and results of the program matched the expectations of the organization. Interviews, online surveys, reviews of existing patient outcome data, and reviews of publicly available program marketing materials were used to ascertain current program output. After analyzing both qualitative and quantitative data from the evaluation, recommendations were made to the organization to improve the effectiveness of the program.

Feasibility of Recruiting Families into a Heart Disease Prevention Program Based on Dietary Patterns

PubMed Central

Schumacher, Tracy L.; Burrows, Tracy L.; Thompson, Deborah I.; Spratt, Neil J.; Callister, Robin; Collins, Clare E.

2015-01-01

Offspring of parents with a history of cardiovascular disease (CVD) inherit a similar genetic profile and share diet and lifestyle behaviors. This study aimed to evaluate the feasibility of recruiting families at risk of CVD to a dietary prevention program, determine the changes in diet achieved, and program acceptability. Families were recruited into a pilot parallel group randomized controlled trial consisting of a three month evidence-based dietary intervention, based on the Mediterranean and Portfolio diets. Feasibility was assessed by recruitment and retention rates, change in diet by food frequency questionnaire, and program acceptability by qualitative interviews and program evaluation. Twenty one families were enrolled over 16 months, with fourteen families (n = 42 individuals) completing the study. Post-program dietary changes in the intervention group included small daily increases in vegetable serves (0.8 ± 1.3) and reduced usage of full-fat milk (−21%), cheese (−12%) and meat products (−17%). Qualitative interviews highlighted beneficial changes in food purchasing habits. Future studies need more effective methods of recruitment to engage families in the intervention. Once engaged, families made small incremental improvements in their diets. Evaluation indicated that feedback on diet and CVD risk factors, dietetic counselling and the resources provided were appropriate for a program of this type. PMID:26308048

Feasibility of Recruiting Families into a Heart Disease Prevention Program Based on Dietary Patterns.

PubMed

Schumacher, Tracy L; Burrows, Tracy L; Thompson, Deborah I; Spratt, Neil J; Callister, Robin; Collins, Clare E

2015-08-21

Offspring of parents with a history of cardiovascular disease (CVD) inherit a similar genetic profile and share diet and lifestyle behaviors. This study aimed to evaluate the feasibility of recruiting families at risk of CVD to a dietary prevention program, determine the changes in diet achieved, and program acceptability. Families were recruited into a pilot parallel group randomized controlled trial consisting of a three month evidence-based dietary intervention, based on the Mediterranean and Portfolio diets. Feasibility was assessed by recruitment and retention rates, change in diet by food frequency questionnaire, and program acceptability by qualitative interviews and program evaluation. Twenty one families were enrolled over 16 months, with fourteen families (n = 42 individuals) completing the study. Post-program dietary changes in the intervention group included small daily increases in vegetable serves (0.8 ± 1.3) and reduced usage of full-fat milk (-21%), cheese (-12%) and meat products (-17%). Qualitative interviews highlighted beneficial changes in food purchasing habits. Future studies need more effective methods of recruitment to engage families in the intervention. Once engaged, families made small incremental improvements in their diets. Evaluation indicated that feedback on diet and CVD risk factors, dietetic counselling and the resources provided were appropriate for a program of this type.

A Holistic Approach to Evaluating Vocational Education: Traditional Chinese Physicians (TCP) Model.

ERIC Educational Resources Information Center

Lee, Lung-Sheng; Chang, Liang-Te

Conventional approaches to evaluating vocational education have often been criticized for failing to deal holistically with the institution or program being evaluated. Integrated quantitative and qualitative evaluation methods have documented benefits; therefore, it would be useful to consider possibility of developing a model for evaluating…

Evaluation of Educational Administration: A Decade Review of Research (2001-2010)

ERIC Educational Resources Information Center

Parylo, Oksana

2012-01-01

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

Are We There Yet? Evaluating Library Collections, Reference Services, Programs, and Personnel.

ERIC Educational Resources Information Center

Robbins-Carter, Jane; Zweizig, Douglas L.

1985-01-01

This second in a five-lesson tutorial on library evaluation focuses on the evaluation of library collections. Highlights include the seven-step evaluation process described in lesson one; quantitative methods (total size, unfilled requests, circulation, turnover rate); and qualitative methods (impressionistic, list-checking). One required and…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

How Service Works. Summary of the W. K. Kellogg Foundation's "Service Works": A Retrospective Evaluation of Higher Education Service Programs.

ERIC Educational Resources Information Center

Kellogg Foundation, Battle Creek, MI.

Service learning is an undergraduate education strategy found across four program areas funded by the W. K. Kellogg Foundation (WKKF). This cross-foundation, retrospective evaluation examines 35 projects of $100,000 or more funded between 1985-95. Study information was based on qualitative data and approaches, with the majority of project…

34 CFR 350.61 - What evaluation requirements must a grantee meet?

Code of Federal Regulations, 2014 CFR

2014-07-01

... RESEARCH PROJECTS AND CENTERS PROGRAM What Conditions Must Be Met After an Award? § 350.61 What evaluation... qualitative. (b) A grantee must make periodic assessments of progress that will provide the grantee with...

34 CFR 350.61 - What evaluation requirements must a grantee meet?

Code of Federal Regulations, 2011 CFR

2011-07-01

... RESEARCH PROJECTS AND CENTERS PROGRAM What Conditions Must Be Met After an Award? § 350.61 What evaluation... qualitative. (b) A grantee must make periodic assessments of progress that will provide the grantee with...

Improving Evaluation of Dental Hygiene Students' Cultural Competence with a Mixed-Methods Approach.

PubMed

Flynn, Priscilla; Sarkarati, Nassim

2018-02-01

Most dental hygiene educational programs include cultural competence education, but may not evaluate student outcomes. The aim of this study was to design and implement a mixed-methods evaluation to measure dental hygiene students' progression toward cultural competence. Two cohorts consisting of consecutive classes in one U.S. dental hygiene program participated in the study. A total of 47 dental hygiene students (100% response rate) completed self-assessments to measure their attitudes and knowledge at three time points between 2014 and 2016. Mean scores were calculated for three domains: Physical Environment, Communication, and Values. Qualitative analysis of the students' cultural diversity papers was also conducted to further evaluate students' knowledge and skills. Bennett's five-level conceptual framework was used to code phrases or sentences to place students in the general categories of ethnocentric or ethno-relative. The quantitative and qualitative results yielded different outcomes for Cohort 1, but not for Cohort 2. The Cohort 1 students assessed themselves statistically significantly lower over time in one of the three measured domains. However, the Cohort 2 students assessed themselves as statistically significantly more culturally competent in all three domains. Qualitative results placed 72% of Cohort 1 students and 83% of Cohort 2 students in the more desirable ethno-relative category. Since quantitative methods consisting of student self-assessments may not adequately measure students' cultural competence, adding qualitative methods to measure skills specific to patient care in this study added a robust dimension to evaluating this complex dental hygiene student competence.

The Patient Passport Program: An Intervention to Improve Patient-Provider Communication for Hospitalized Minority Children and Their Families.

PubMed

Lee, Lois K; Mulvaney-Day, Norah; Berger, Anne M; Bhaumik, Urmi; Nguyen, Hiep T; Ward, Valerie L

2016-07-01

Effective patient-provider communication is essential to improve health care delivery and satisfaction and to minimize disparities in care for minorities. The objective of our study was to evaluate the impact of a patient-provider communication program, the Patient Passport Program, to improve communication and satisfaction for hospitalized minority children. This was a qualitative evaluation of a communication project for families with hospitalized children. Families were assigned to either the Patient Passport Program or to usual care. The Passport Program consisted of a personalized Passport book and additional medical rounds with medical providers. Semistructured interviews at the time of patient discharge were conducted with all participants to measure communication quality and patient/family satisfaction. Inductive qualitative methods were used to identify common themes. Of the 40 children enrolled in the Passport Program, 60% were boys; the mean age was 9.7 years (range, 0.16-19 years). The most common themes in the qualitative analysis of the interviews were: 1) organization of medical care; 2) emotional expressions about the hospitalization experience; and 3) overall understanding of the process of care. Spanish- and English-speaking families had similar patient satisfaction experiences, but the Passport families reported improved quality of communication with the medical care team. The Patient Passport Program enhanced the quality of communication among minority families of hospitalized children with some common themes around the medical care expressed in the Passport book. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

A Qualitative Analysis of Participant Learning and Growth Using a New Outward Bound Outcomes Instrument

ERIC Educational Resources Information Center

Bobilya, Andrew J.; Lindley, Betsy R.; Faircloth, W. Brad; Holman, Tom

2017-01-01

Evidence-based programming and the importance of research has gained attention among outdoor and adventure-based programs in recent years (Sibthorp, 2009) regardless of the challenges that often accompany this type of investigation (Bialeschki, Henderson, Hickerson, & Browne, 2012). Programs must often develop their own evaluation instruments,…

78 FR 51719 - Draft Toxicological Review of Benzo[a]pyrene: In Support of the Summary Information in the...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-21

... Environmental Assessment (NCEA) within the EPA Office of Research and Development (ORD). EPA is releasing this... Program is a human health assessment program that evaluates quantitative and qualitative risk information... IRIS Program, EPA provides the highest quality science-based human health assessments to support the...

Promoting a smokers' quitline in Ontario, Canada: an evaluation of an academic detailing approach.

PubMed

Kirst, Maritt; Schwartz, Robert

2015-06-01

This study assesses the impact of an academic detailing quitline promotional outreach program on integration of patient referrals to the quitline by fax in healthcare settings and quitline utilization in Ontario, Canada. The study employed a mixed methods approach for evaluation, with trend analysis of quitline administrative data from the year before program inception (2005) to 2011 and qualitative interviews with quitline stakeholders. Participants in the qualitative interviews included academic detailing program staff, regional tobacco control stakeholders and quitline promotion experts. Quantitative outcomes included the number of fax referral partners and fax referrals received, and quitline reach. Trends in proximal and distal outreach program outcomes were assessed. The qualitative data were analysed through a process of data coding involving the constant comparative technique derived from grounded theory methods. The study identified that the outreach program has had some success in integrating the fax referral program in healthcare settings through evidence of increased fax referrals since program inception. However, organizational barriers to program partner engagement have been encountered. While referral from health professionals through the fax referral programs has increased since the inception of the outreach program, the overall reach of the quitline has not increased. The study findings highlight that an academic detailing approach to quitline promotion can have some success in achieving increased fax referral program integration in healthcare settings. However, findings suggest that investment in a comprehensive promotional strategy, incorporating academic detailing, media and the provision of free cessation medications may be a more effective approach to quitline promotion. © The Author (2013). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Students' experiences and perceived benefits of a sex education curriculum: a qualitative analysis.

PubMed

Smith, Peggy B; Realini, Janet P; Buzi, Ruth S; Martinez, Mario

2011-01-01

A qualitative evaluation explored the experiences and perceived benefits of students who participated in an abstinence-plus sex education program at enrollment and conclusion. The sample included 1130 inner-city high school students, 73.7% of whom were Hispanic. Thematic analysis was used to identify main themes in responses made by students to 3 open-ended questions. The most common preparticipation request was for information about sexually transmitted infections. At program conclusion, the most common response theme involved the quality of course delivery. Students indicated that they appreciated the facilitators who allowed open conversations. The implications of these findings to sex education programs are discussed.

Improving Healthy Living Youth Development Program Outreach in Extension: Lessons Learned from the 4-H Health Rocks! Program

ERIC Educational Resources Information Center

Kumaran, Muthusami; Fogarty, Kate; Fung, Whitney M.; Terminello, Amanda

2015-01-01

This article discusses a qualitative evaluation of the Florida 4-H Health Rocks! program aimed at youth alcohol, tobacco, and other drug use prevention. A questionnaire was distributed to Extension professionals across Florida to gain insight into the strengths and barriers they faced with programming. Programmatic strengths included targeting a…

77 FR 47617 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-09

... information technology. Please note that written comments received in response to this notice will be... conducting qualitative case studies of up to 15 sites with a focus on preventing students from dropping out... qualitative data across multiple respondents to generate portraits of programs and strategies that the sites...

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.

A qualitative evaluation of the 2005-2011 National Academic Centers of Excellence in Youth Violence Prevention Program.

PubMed

Holland, Kristin M; Vivolo-Kantor, Alana M; Dela Cruz, Jason; Massetti, Greta M; Mahendra, Reshma

2015-12-01

The Centers for Disease Control and Prevention's Division of Violence Prevention (DVP) funded eight National Academic Centers of Excellence (ACEs) in Youth Violence Prevention from 2005 to 2010 and two Urban Partnership Academic Centers of Excellence (UPACEs) in Youth Violence Prevention from 2006 to 2011. The ACEs and UPACEs constitute DVP's 2005-2011 ACE Program. ACE Program goals include partnering with communities to promote youth violence (YV) prevention and fostering connections between research and community practice. This article describes a qualitative evaluation of the 2005-2011 ACE Program using an innovative approach for collecting and analyzing data from multiple large research centers via a web-based Information System (ACE-IS). The ACE-IS was established as an efficient mechanism to collect and document ACE research and programmatic activities. Performance indicators for the ACE Program were established in an ACE Program logic model. Data on performance indicators were collected through the ACE-IS biannually. Data assessed Centers' ability to develop, implement, and evaluate YV prevention activities. Performance indicator data demonstrate substantial progress on Centers' research in YV risk and protective factors, community partnerships, and other accomplishments. Findings provide important lessons learned, illustrate progress made by the Centers, and point to new directions for YV prevention research and programmatic efforts. Published by Elsevier Ltd.

Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centred Instructional Program in Indonesia

ERIC Educational Resources Information Center

Rahayu, Sri; Chandrasegaran, A. L.; Treagust, David F.; Kita, Masakazu; Ibnu, Suhadi

2011-01-01

This study was a mixed quantitative-qualitative research to evaluate the efficacy of a designed student-centred instructional (DSCI) program for teaching about acids and bases. The teaching innovation was designed based on constructivist, hands-on inquiry and context-based approaches and implemented in seven 45-min lessons with a class of 36 grade…

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

South Korean Family Caregiver Involvement in Delirium Care: A Qualitative Descriptive Study.

PubMed

Kang, Yun; Moyle, Wendy; Cooke, Marie; O'Dwyer, Siobhan

2017-12-01

The current study aimed to describe the effect of an educational program on RN-initiated efforts to involve family caregivers in delirium care. A descriptive qualitative study was performed. A purposive sample of 12 RNs who participated in a one group, pre-post evaluation of a delirium educational program, and a nominated sample of six family caregivers of patients who had been cared for by RNs in the program participated in individual, in-depth interviews. The qualitative findings indicated that the inclusion of a delirium brochure in ward orientation on admission, with reinforcement during shift changes, and RN-initiated engagement with family caregivers promoted family caregiver involvement in delirium prevention. Further studies in South Korea are needed to determine which family-centered nursing care interventions are culturally appropriate and most effective for RNs and family caregivers in delirium care. [Journal of Gerontological Nursing, 43(12), 44-51.]. Copyright 2017, SLACK Incorporated.

College Admissions and Academic Ethic: How Context-Specific Evaluation within a Science-Based Compensatory Program Benefits African American Students

ERIC Educational Resources Information Center

Wooten, Melissa E.

2016-01-01

This study investigates how the college readiness of participants in a compensatory program designed to facilitate interest in science and engineering was determined. Archival data were used to qualitatively analyze the performance reports of 205 student participants during the compensatory program's first 5 years. Findings indicate participants…

Cooking, healthy eating, fitness and fun (CHEFFs): qualitative evaluation of a nutrition education program for children living at urban family homeless shelters.

PubMed

Rodriguez, Jacqueline; Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-12-01

We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants' understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children's knowledge and understanding of content, (2) children's shift in attitudes or intentions, and (3) interpretations through children's life experience. Food insecurity as well as shelter food service and policies were important influences on children's choices, hunger, and sense of well-being. Children's experiences highlighted the need to advocate for shelter policies that adequately provide for children's nutritional and physical activity requirements and foster academic development.

Mentoring in Higher Education Should Be the Norm to Assure Success: Lessons Learned from the Faculty Mentoring Program, West Chester University, 2008-2011

ERIC Educational Resources Information Center

Bean, Nadine M.; Lucas, Lisa; Hyers, Lauri L.

2014-01-01

Despite a wealth of qualitative and quantitative data regarding the positive effects of higher education mentoring programs on faculty satisfaction, retention, tenure, and promotion, mentoring programs are not widespread. The authors examine evaluative data from the first four years of the Faculty Mentoring Program at West Chester University. Of…

Female Physicist Doctoral Experiences

ERIC Educational Resources Information Center

Dabney, Katherine P.; Tai, Robert H.

2013-01-01

The underrepresentation of women in physics doctorate programs and in tenured academic positions indicates a need to evaluate what may influence their career choice and persistence. This qualitative paper examines eleven females in physics doctoral programs and professional science positions in order to provide a more thorough understanding of why…

Evaluating the Fine Arts Program at the Center for Excellence in Disabilities

ERIC Educational Resources Information Center

Schlosnagle, Leo; McBean, Amanda L.; Cutlip, Milisa; Panzironi, Helen; Jarmolowicz, David P.

2014-01-01

Art programs for people with disabilities may encourage creativity, promote engagement, emphasize inclusion, and extend access and opportunities for community involvement. This mixed methods study utilized quantitative and qualitative data, repeated measures, action research, and stakeholder collaboration to develop and implement an evaluation…

Assessment of village health worker training program in Tuguegarao, Philippine.

PubMed

Kim, Jung Min; Koh, Kwang Wook; Oak, Chul Ho; Jung, Woo Hyuk; Kim, Sung Hyun; Park, Dae Hee

2009-11-01

This study was performed to evaluate the effectiveness of 'village health worker training program' which aimed to build community participatory health promotion capacity of community leaders in villages of low developed country and to develop methods for further development of the program. The intervention group were 134 community leaders from 25 barangays (village). Control group were 149 form 4 barangays. Intervention group participated 3-day training program. Questionnaire was developed based on 'Health Promotion Capacity Checklist' which assessed capacity in 4 feathers; 'knowledge', 'skill', 'commitment', and 'resource'. Each feather was assessed in 4 point rating scale. Capacity scores between intervention group and control group were examined to identify changes between the pre- and post-intervention periods. A qualitative evaluation of the program was conducted to assess the appropriateness of the program. The program was conducted in Tuguegarao city, Philippine in January, 2009. The result showed significant increases in the total health promotion capacity and each feather of health promotion capacities between pre and post assessment of intervention group. But there was no significant change in that of control group. Participants marked high level of satisfaction for preparedness, selection of main subjects and education method. Qualitative evaluation revealed that training program facilitated community participatory health promotion capacity of participants. This study suggested that the Village health worker training program is effective for building health promotion capacity of community leaders and it can be a main method for helping low developed countries with further development.

In It Together: A Qualitative Evaluation of Participant Experiences of a 10-Week, Group-Based, Workplace HIIT Program for Insufficiently Active Adults.

PubMed

Kinnafick, Florence-Emilie; Thøgersen-Ntoumani, Cecilie; Shepherd, Sam O; Wilson, Oliver J; Wagenmakers, Anton J M; Shaw, Christopher S

2018-02-01

Using guidance from the reach, efficacy, adoption, implementation, and maintenance evaluation framework, we aimed to qualitatively evaluate the participant experiences of a workplace high-intensity interval training (HIIT) intervention. Twelve previously insufficiently active individuals (four males and eight females) were interviewed once as part of three focus groups. Perceptions of program satisfaction, barriers to and facilitators of adherence, and persistence to exercise were explored. HIIT initiates interest because of its novelty, provides a sense of accomplishment, and overcomes the barriers of perceived lack of time. The feeling of relatedness between the participants can attenuate negative unpleasant responses during the HIIT sessions. HIIT, in this workplace setting, is an acceptable intervention for physically inactive adults. However, participants were reluctant to maintain the same mode of exercise, believing that HIIT sessions were for the very fit.

Student Perceptions of an Online Medical Dosimetry Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lenards, Nishele, E-mail: lenards.nish@uwlax.ed

2011-07-01

The University of Wisconsin-La Crosse offers the first online medical dosimetry program in the nation. There is no data to research a program of this type. This research consisted of the evaluation of other distance education programs including health profession programs in addition to face-to-face medical dosimetry programs. There was a need to collect and analyze student perceptions of online learning in medical dosimetry. This research provided a guide for future implementation by other programs as well as validated the University of Wisconsin-La Crosse program. Methodology used consisted of an electronic survey sent to all previous and currently enrolled studentsmore » in the University of Wisconsin-La Crosse medical dosimetry program. The survey was both quantitative and qualitative in demonstrating attitudinal perceptions of students in the program. Quantitative data was collected and analyzed using a 5-point Likert scale. Qualitative data was gathered based on the open-ended responses and the identifying themes from the responses. The results demonstrated an overall satisfaction with this program, the instructor, and the online courses. Students felt a sense of belonging to the courses and the program. Considering that a majority of the students had never taken an online course previously, the students felt there were no technology issues. Future research should include an evaluation of board exam statistics for students enrolled in the online and face-to-face medical dosimetry programs.« less

The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

NASA Astrophysics Data System (ADS)

Luera, Gail Rose

As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

An Evaluation of University Recreation Center Outdoor Programs for People with Disabilities: Perspectives from Professionals

ERIC Educational Resources Information Center

Daniels, Erin; Cottingham, Michael; Walsh, David W.; Pearson, Demetrius

2017-01-01

In this study, the researchers explored the perspectives of recreational practitioners currently working in the field of outdoor adventure programming on college campuses and their knowledge and interactions with students with disabilities participating in integrated outdoor adventure activities. A qualitative descriptive thematic analysis was…

Child and Parent Voices on a Community-Based Prevention Program (FAST)

ERIC Educational Resources Information Center

Fearnow-Kenney, Melodie; Hill, Patricia; Gore, Nicole

2016-01-01

Families and Schools Together (FAST) is a collaborative program involving schools, families, and community-based partners in efforts to prevent substance use, juvenile delinquency, school failure, child abuse and neglect, mental health problems, and violence. Although evaluated extensively, there remains a dearth of qualitative data on child and…

Stewardship matters: Case studies in establishment success of urban trees

Treesearch

Lara A. Roman; Lindsey A. Walker; Catherine M. Martineau; David J. Muffly; Susan A. MacQueen; Winnie Harris

2015-01-01

Urban tree planting initiatives aim to provide ecosystem services that materialize decades after planting, therefore understanding tree survival and growth is essential to evaluating planting program performance. Tree mortality is relatively high during the establishment phase, the first few years after planting. Qualitative assessments of programs with particularly...

Literacy, Language and Social Interaction in Special Schools

ERIC Educational Resources Information Center

Reichenberg, Monica

2015-01-01

The present study is a follow up study to a quantitative intervention study where two intervention programs, Reciprocal Teaching and Inference Training, were practiced. This study aims at capturing the potentials benefits and qualitative aspects of one of the programs evaluated, Reciprocal Teaching. More specifically, I have investigated the video…

Employer Incentives to Participate in a Comprehensive School-to-Work Transition Program.

ERIC Educational Resources Information Center

Klein, Steven G.

This report evaluated economic incentives for employer participation in a comprehensive school-to-work (STW) initiative. In general, the business, economic, and educational literature emphasizes quantifying the fiscal benefits of employer-sponsored training, although only qualitative outcomes are available for some programs. The literature…

Compromise in Collaborating with Families: Perspectives of Beginning Special Education Teachers

ERIC Educational Resources Information Center

Hansuvadha, Nat

2009-01-01

This qualitative study evaluated the belief systems and professional practice of program graduates of an early childhood special education teacher preparation program regarding collaboration with families of children with disabilities. Eleven graduates were interviewed over the course of a school year to identify perceived challenges to their…

Constructing Adult Literacies at a Local Literacy Tutor-Training Program

ERIC Educational Resources Information Center

Roderick, Ryan

2013-01-01

This study investigates how literacy was constructed at an adult literacy organization's volunteer tutor-training program. By drawing on qualitative analysis of training texts used during training, such as training evaluations, and data gathered from interviews with experienced tutors, it is possible to identify the assumptions about literacy…

Interviewer as Instrument: Accounting for Human Factors in Evaluation Research

ERIC Educational Resources Information Center

Brown, Joel H.

2006-01-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug,…

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Midwest School District Transition Academy: A Qualitative, Process Evaluation of a Program for Students with Autism Spectrum Disorders or Emotional Disturbances

ERIC Educational Resources Information Center

Myers, Paul D.

2012-01-01

The purpose of the study was to examine the implementation of a special education program designed to support students with autism and social/emotional disturbances in a large, suburban school district. The study examined how services are delivered to students, staffing/personnel aspects, and budgetary considerations relative to programming.…

Impact of "Grassroots on Work" (GROW) Extension Program to the Bachelor of Arts in Political Science Students' Sense of Civic Responsibility

ERIC Educational Resources Information Center

Paga, Mark Leo Huit

2015-01-01

Purpose: The purpose of this study was to determine the medium term effect of service-learning program or "Grassroots on Work" extension program to civic responsibility of AB Political Science students. Methodology: This study employed an impact evaluation research design and both qualitative and quantitative. The data on goals and…

Developing Community Health Worker Diabetes Training

ERIC Educational Resources Information Center

Ferguson, W. J.; Lemay, C. A.; Hargraves, J. L.; Gorodetsky, T.; Calista, J.

2012-01-01

We designed, implemented and evaluated a 48-hour training program for community health workers (CHWs) deployed to diabetes care teams in community health centers (CHCs). The curriculum included core knowledge/skills with diabetes content to assist CHWs in developing patient self-management goals. Our qualitative evaluation included…

77 FR 62216 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-12

...: National Institute of Standards and Technology (NIST). Title: Generic Clearance for Program Evaluation Data... National Institute of Standards and Technology (NIST), a non-regulatory agency of the Department of Commerce, proposes to conduct surveys--both quantitative and qualitative--designed to evaluate our current...

75 FR 38819 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-06

... disorders; (12) conducts and supports both qualitative and quantitative research to expand the knowledge... division, supports program evaluation, and ensures that research meets the highest standards in the field...) develops, implements and evaluates long term plans for surveillance, research and prevention activities...

Hey girlfriend: an evaluation of AIDS prevention among women in the sex industry.

PubMed

Dorfman, L E; Derish, P A; Cohen, J B

1992-01-01

Increasingly, acquired immunodeficiency syndrome (AIDS) prevention programs have been developed to reach and influence street-based populations. Standard methods of evaluation do not fit the conditions of such programs. This article describes a process and outcome evaluation of an AIDS prevention program for sex workers in which qualitative and quantitative methods were combined in order to mediate research problems endemic to street-based populations. Methods included epidemiological questionnaires, open-ended interviews with participants, and ethnographic field notes. Process evaluation findings show that field staff who were indigenous to the neighborhood and population readily gained access to the community of sex workers and simultaneously became role models for positive behavior change. Outcome findings show that sex workers do feel at risk for AIDS, but usually from clients rather than from husbands or boyfriends. Accordingly, they use condoms more frequently with clients than with steady partners. Increasing condom use among sex workers with their steady partners remains an important challenge for AIDS prevention. Combining qualitative and quantitative research data provided a more comprehensive assessment of how to reach sex workers with effective AIDS risk reduction messages than either method could have provided alone.

Health in the urban environment: a qualitative review of the Brighton and Hove WHO Healthy City Program.

PubMed

Hall, Caroline; Davies, John Kenneth; Sherriff, Nigel

2010-01-01

Phase IV of the WHO European Region's Healthy Cities Program ended in December 2008. This article presents the findings from a recently completed review of Brighton and Hove's Healthy City Program which aimed to scope whether added value had accrued from the city's role as a WHO Healthy City during phase IV. In contrast to most other evaluations of healthy cities, this review adopted a qualitative approach representing an appraisal of the Brighton and Hove Healthy City Program from the internal viewpoint of its local stakeholders. In addition to documentary analysis and a facilitated workshop, a series of in-depth interviews (N = 27) were conducted with stakeholders from the Brighton and Hove Healthy City Partnership representing each of the sectors reflected in the Local Strategic Partnership (public, statutory, elected, community and voluntary, neighborhood and communities, business). The key findings of the review are presented in a way which reflects the three key areas of the review including (1) the healthy cities approach, (2) participation in phase IV of the WHO Healthy Cities Program, and (3) the Brighton and Hove Healthy City Partnership. These findings are discussed, and recommendations for action at local, national, and European levels are proposed. In particular, we argue that there is an urgent need to develop a suitable monitoring and evaluation system for the WHO Healthy Cities Program with appropriate indicators that are meaningful and relevant to local stakeholders. Moreover, it would be important for any such system to capitalize on the benefits that qualitative methodologies can offer alongside more traditional quantitative indicators.

76 FR 72003 - Proposed Collection, Laura Bush 21st Century Librarian Grant Program Evaluation

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-21

... responses. ADDRESSES: Send comments to: Matthew Birnbaum, Ph.D., Evaluation and Research Officer, Institute... the Institute. Current research initiatives include analysis of grants made to educational and... communities. IMLS proposes to collect qualitative and quantitative information from grant recipients and...

The role of Aboriginal family workers in delivering a child safety focused home visiting program for Aboriginal families in an urban region of NSW.

PubMed

Clapham, Kathleen; Bennett-Brook, Keziah; Hunter, Kate

2018-05-09

Aboriginal Australian children experience higher rates of injury than other Australian children. However few culturally acceptable programs have been developed or evaluated. The Illawarra Aboriginal Medical Service (IAMS) developed the Safe Homes Safe Kids program as an injury prevention program targeting disadvantaged Aboriginal families with children aged 0-5 in an urban region of NSW. Delivered by Aboriginal Family Workers the program aims to reduce childhood injury by raising awareness of safety in the home. A program evaluation was conducted to determine the effectiveness of the home visiting model as an injury prevention program. This paper reports on the qualitative interviews which explored the ways in which clients, IAMS staff, and external service providers experienced the program and assessed its delivery by the Aboriginal Family Workers. A qualitative program evaluation was conducted between January 2014 and June 2015. We report here on the semi-structured interviews undertaken with 34 individuals. The results show increased client engagement in the program; improved child safety knowledge and skills; increased access to services; improved attitudes to home and community safety; and changes in the home safety environment. Safe Homes Safe Kids provides a culturally appropriate child safety program delivered by Aboriginal Family Workers to vulnerable families. Clients, IAMS staff, and external service were satisfied with the family workers' delivery of the program and the holistic model of service provision. SO WHAT?: This promising program could be replicated in other Aboriginal health services to address unintentional injury to vulnerable Aboriginal children. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Content Validity of National Post Marriage Educational Program Using Mixed Methods

PubMed Central

MOHAJER RAHBARI, Masoumeh; SHARIATI, Mohammad; KERAMAT, Afsaneh; YUNESIAN, Masoud; ESLAMI, Mohammad; MOUSAVI, Seyed Abbas; MONTAZERI, Ali

2015-01-01

Background: Although the validity of content of program is mostly conducted with qualitative methods, this study used both qualitative and quantitative methods for the validation of content of post marriage training program provided for newly married couples. Content validity is a preliminary step of obtaining authorization required to install the program in country's health care system. Methods: This mixed methodological content validation study carried out in four steps with forming three expert panels. Altogether 24 expert panelists were involved in 3 qualitative and quantitative panels; 6 in the first item development one; 12 in the reduction kind, 4 of them were common with the first panel, and 10 executive experts in the last one organized to evaluate psychometric properties of CVR and CVI and Face validity of 57 educational objectives. Results: The raw data of post marriage program had been written by professional experts of Ministry of Health, using qualitative expert panel, the content was more developed by generating 3 topics and refining one topic and its respective content. In the second panel, totally six other objectives were deleted, three for being out of agreement cut of point and three on experts' consensus. The validity of all items was above 0.8 and their content validity indices (0.8–1) were completely appropriate in quantitative assessment. Conclusion: This study provided a good evidence for validation and accreditation of national post marriage program planned for newly married couples in health centers of the country in the near future. PMID:26056672

Key ingredients of anti-stigma programs for health care providers: a data synthesis of evaluative studies.

PubMed

Knaak, Stephanie; Modgill, Geeta; Patten, Scott B

2014-10-01

As part of its ongoing effort to combat stigma against mental illness among health care providers, the Mental Health Commission of Canada partnered with organizations conducting anti-stigma interventions. Our objective was to evaluate program effectiveness and to better understand what makes some programs more effective than others. Our paper reports the elements of these programs found to be most strongly associated with favourable outcomes. Our study employed a multi-phased, mixed-methods design. First, a grounded theory qualitative study was undertaken to identify key program elements. Next, each program (n = 22) was coded according to the presence or absence of the identified key program ingredients. Then, random-effects, meta-regression modelling was used to examine the association between program outcomes and the key ingredients. The qualitative analysis led to a 6-ingredient model of key program elements. Results of the quantitative analysis showed that programs that included all 6 of these ingredients performed significantly better than those that did not. Individual analyses of each of the 6 ingredients showed that including multiple forms of social contact and emphasizing recovery were characteristics of the most effective programs. The results provide a validation of a 6-ingredient model of key program elements for anti-stigma programming for health care providers. Emphasizing recovery and including multiple types of social contact are of particular importance for maximizing the effectiveness of anti-stigma programs for health care providers.

Outcomes-Based Education Integration in Home Economics Program: An Evaluative Study

ERIC Educational Resources Information Center

Limon, Mark Raguindin; Castillo Vallente, John Paul

2016-01-01

This study examined the factors that affect the integration of Outcomes-Based Education (OBE) in the Home Economics (HE) education curriculum of the Technology and Livelihood Education (TLE) program of a State University in the northern part of the Philippines. Descriptive survey and qualitative design were deployed to gather, analyze, and…

Evaluation of safe routes to school programs : qualitative and quantitative analysis of parental decision-making.

DOT National Transportation Integrated Search

2011-08-01

In the United States, walking to school declined from 42% of 5-18 year olds in 1969 to 16% in 20011. The US : Department of Transportation has responded to this dramatic decrease by funding the Safe Routes to School program : for $612 million in SAFE...

Teachers' Perceptions of the Impact of the Jolly Phonics Program on Students' Literacy

ERIC Educational Resources Information Center

Moodie-Reid, Lorane

2016-01-01

At 2 primary schools in Western Jamaica, students at the Grade 1 level lacked basic literacy skills of comprehension, letter recognition, letter sounds, and oral communication. The purpose of this qualitative evaluation study was to investigate teachers' perceptions of the Jolly Phonics program implemented to improve students' literacy in Grades…

Teacher Educators' Evaluation of the English Language Teaching Program: A Turkish Case

ERIC Educational Resources Information Center

Yavuz, Aysun; Zehir Topkaya, Ece

2013-01-01

This study explored the perceptions of teacher educators regarding the changes in the English Language Teacher Education Program introduced by the Turkish Higher Education Council (HEC) in 2006. Employing a qualitative design, open-ended questionnaires were administered to 18 lecturers working at five different state universities. The analysis of…

EnvironMentors: Mentoring At-Risk High School Students through University Partnerships

ERIC Educational Resources Information Center

Monk, Melissa H.; Baustian, Melissa M.; Saari, Courtney R.; Welsh, Susan; D'Elia, Christopher F.; Powers, Joseph E.; Gaston, Suzan; Francis, Pamela

2014-01-01

Informal place-based environmental education is a proven approach for increasing environmental awareness for students in urban cities. This article describes and qualitatively evaluates the first two academic years of the EnvironMentors program at Louisiana State University (LSU-EM), which is part of a national network of EnvironMentors programs.…

Implementing Change through the Creation of Graduation Requirements for Community and Service Learning

ERIC Educational Resources Information Center

Mogle, Andrew Lee

2014-01-01

As school districts and communities struggle to increase civic engagement for their students, a medium-sized suburban school district implemented required community service hours as part of their high school graduation requirements. The purpose of this qualitative program evaluation was to investigate how the community service program was meeting…

The Impact of an Immersion Program for Newcomers on the Transitional Period

ERIC Educational Resources Information Center

Rivera, Carmen Iris

2009-01-01

This evaluative dissertation was designed to determine how an immersion program for newcomer students affects their transitional period upon entering the school system. A key element of the study investigated the connection between the emotional state of mind of newcomer students and academic achievement. Both qualitative and quantitative…

Multidisciplinary Difficult Airway Course: An Essential Educational Component of a Hospital-Wide Difficult Airway Response Program.

PubMed

Leeper, W Robert; Haut, Elliott R; Pandian, Vinciya; Nakka, Sajan; Dodd-O, Jeffrey; Bhatti, Nasir; Hunt, Elizabeth A; Saheed, Mustapha; Dalesio, Nicholas; Schiavi, Adam; Miller, Christina; Kirsch, Thomas D; Berkow, Lauren

2018-04-05

A hospital-wide difficult airway response team was developed in 2008 at The Johns Hopkins Hospital with three central pillars: operations, safety monitoring, and education. The objective of this study was to assess the outcomes of the educational pillar of the difficult airway response team program, known as the multidisciplinary difficult airway course (MDAC). The comprehensive, full-day MDAC involves trainees and staff from all provider groups who participate in airway management. The MDAC occurs within the Johns Hopkins Medicine Simulation Center approximately four times per year and uses a combination of didactic lectures, hands-on sessions, and high-fidelity simulation training. Participation in MDAC is the main intervention being investigated in this study. Data were collected prospectively using course evaluation survey with quantitative and qualitative components, and prepost course knowledge assessment multiple choice questions (MCQ). Outcomes include course evaluation scores and themes derived from qualitative assessments, and prepost course knowledge assessment MCQ scores. Tertiary care academic hospital center PARTICIPANTS: Students, residents, fellows, and practicing physicians from the departments of Surgery, Otolaryngology Head and Neck Surgery, Anesthesiology/Critical Care Medicine, and Emergency Medicine; advanced practice providers (nurse practitioners and physician assistants), nurse anesthetists, nurses, and respiratory therapists. Totally, 23 MDACs have been conducted, including 499 participants. Course evaluations were uniformly positive with mean score of 86.9 of 95 points. Qualitative responses suggest major value from high-fidelity simulation, the hands-on skill stations, and teamwork practice. MCQ scores demonstrated significant improvement: median (interquartile range) pre: 69% (60%-81%) vs post: 81% (72%-89%), p < 0.001. Implementation of a MDAC successfully disseminated principles and protocols to all airway providers. Demonstrable improvement in prepost course knowledge assessment and overwhelmingly positive course evaluations (quantitative and qualitative) suggest a critical and ongoing role for the MDAC course. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Use of Evidence in the Implementation of Social Programs: A Qualitative Study from Chile.

PubMed

Flores, Rodrigo; Naranjo, Carola; Hein, Andreas

2016-01-01

Through this qualitative, empirical study the authors aim to explore and describe the sources of knowledge that are used to guide intervention practice by social workers in Chile. Particular attention was paid to factors that may facilitate or hinder the use of research-based evidence to guide social interventions design, implementation, and outcome evaluation. In order to explore these issues, 25 semi-structured interviews with social workers from Chilean social service non-profit organizations were conducted. The main findings suggest that social workers do not use research-based evidence to support their social interventions due to various personal organizational constraints (e.g., lack of time, lack of access to resources for disseminating evidence, lack of English command). In addition, no evaluation processes of social programs which will support evidence-based effectiveness could be found. One key barrier to support use of evidence and evidence production may be related to the fact that most non-governmental organizations maintain a hierarchical and vertical relationship with state agencies (program design, oversight, and funding) for social program development.

Training of lay health educators to implement an evidence-based behavioral weight loss intervention in rural senior centers.

PubMed

Krukowski, Rebecca A; Lensing, Shelly; Love, Sharhonda; Prewitt, T Elaine; Adams, Becky; Cornell, Carol E; Felix, Holly C; West, Delia

2013-02-01

Lay health educators (LHEs) offer great promise for facilitating the translation of evidence-based health promotion programs to underserved areas; yet, there is little guidance on how to train LHEs to implement these programs, particularly in the crucial area of empirically validated obesity interventions. This article describes experiences in recruiting, training, and retaining 20 LHEs who delivered a 12-month evidence-based behavioral lifestyle intervention (based on the Diabetes Prevention Program) in senior centers across a rural state. A mixed method approach was used which incorporated collecting the folllowing: quantitative data on sociodemographic characteristics of LHEs; process data related to training, recruitment, intervention implementation, and retention of LHEs; and a quantitative program evaluation questionnaire, which was supplemented by a qualitative program evaluation questionnaire. Descriptive statistics were calculated for quantitative data, and qualitative data were analyzed using content analysis. The training program was well received, and the LHEs effectively recruited participants and implemented the lifestyle intervention in senior centers following a structured protocol. The methods used in this study produced excellent long-term retention of LHEs and good adherence to intervention protocol, and as such may provide a model that could be effective for others seeking to implement LHE-delivered health promotion programs.

Participative Evaluation and the Quality of Community Empowerment Training of "Program Keluarga Harapan" (PKH) Companions

ERIC Educational Resources Information Center

Rasyad, Ach.

2016-01-01

This research is aiming at describing: (1) the implementation of community empowerment training of PKH companions, (2) types of participative evaluation used in the PKH companion training, and (3) obstacles and supporting factors in PKH companion training using the participative evaluation. The study employed qualitative approach with case study…

"Can't We Just Have Some Sazón?" Student, Family, and Staff Perspectives on a New School Food Program at a Boston High School

ERIC Educational Resources Information Center

Chatterjee, Avik; Daftary, Genevieve; Campbell, Meg; Gatison, Lenward; Day, Liam; Ramsey, Kibret; Goldman, Roberta; Gillman, Matthew W.

2016-01-01

Background: In September 2013, a Massachusetts high school launched a nutrition program in line with 2013 United States Department of Agriculture requirements. We sought to understand attitudes of stakeholders toward the new program. Methods: We employed community-based participatory research methods in a qualitative evaluation of the food program…

Perceived Benefits of Yoga among Urban School Students: A Qualitative Analysis

PubMed Central

Wang, Donna; Hagins, Marshall

2016-01-01

This study reports on the findings of a qualitative evaluation of a yoga intervention program for urban middle and high school youth in New York City public and charter schools. Six focus groups were conducted with students who participated in a year-long yoga program to determine their perceptions of mental and physical benefits as well as barriers and challenges. Results show that students perceived the benefits of yoga as increased self-regulation, mindfulness, self-esteem, physical conditioning, academic performance, and stress reduction. Barriers and challenges for a yoga practice include lack of time and space. The extent to which the benefits experienced are interrelated to one another is discussed. Suggestions for future research and school-based programming are also offered. PMID:26884797

Exploring the acquisition of entry-to-practice competencies by second-degree nursing students during a preceptorship experience.

PubMed

Sedgwick, Monique; Kellett, Peter; Kalischuck, Ruth Grant

2014-03-01

Nursing programs across Canada have begun to implement at an unprecedented rate second-degree nursing programs in response to consumer demands and a nursing shortage. While these types of programs are enjoying considerable popularity among prospective students and employers, it is imperative that nursing programs assess their graduates' ability to meet Registered Nursing entry-to-practice competencies (ETCs). This study sought to determine if second-degree undergraduate nursing students achieved the entry-to-practice competencies established by the provincial regulatory body for registered nurses of Alberta, Canada. The study took place in southern Alberta, Canada as the first cohort of second-degree undergraduate nursing students were completing the final practice course for the program. In this exploratory study, quantitative and qualitative data generation approaches were used. Quantitative data were collected using the nursing program's standardized Clinical Evaluation Tool which is mapped to the 119 ETCs established by the regulatory body. Qualitative data were generated by conducting focus group interviews with students, faculty advisors, and preceptors. A convenience sample consisting of both male and female students (n=14) submitted their mid-term and final clinical evaluations for inclusion in the dataset. Thirteen preceptors submitted mid-term and final clinical evaluations. Three students, three faculty advisors, and two preceptors participated in focus group interviews. At mid-term, statistically significant differences were noted on 31% of the indicators within the clinical evaluation tool between students and preceptors with preceptors consistently ranking students higher than the students' ratings of their performance. Student and preceptor ratings of students' clinical performance were more consistent on the final evaluation. However, where there were differences, preceptors rated students higher than student ratings. Qualitative data analysis suggests that the concept of competence is complex and multifaceted and understood differently by students, preceptors, and advisors. The findings of this study suggest that there is ambiguity among second-degree students, preceptors and faculty advisors surrounding the concept of competence. In order to develop an understanding of competence, nursing program administrators must encourage faculty advisors, preceptors and students to engage in a discussion at the outset of the preceptored practice experience in regard to what is meant by competence within various practice setting. Further, we suggest nursing programs in collaboration with their clinical partners and re-examine their practice evaluation tools to determine the degree to which they are sensitive to the clinical practice context. Copyright © 2013 Elsevier Ltd. All rights reserved.

Cooking, Healthy Eating, Fitness and Fun (CHEFFs): Qualitative Evaluation of a Nutrition Education Program for Children Living at Urban Family Homeless Shelters

PubMed Central

Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-01-01

Objectives. We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. Methods. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants’ understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. Results. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children’s knowledge and understanding of content, (2) children’s shift in attitudes or intentions, and (3) interpretations through children’s life experience. Food insecurity as well as shelter food service and policies were important influences on children’s choices, hunger, and sense of well-being. Conclusions. Children’s experiences highlighted the need to advocate for shelter policies that adequately provide for children’s nutritional and physical activity requirements and foster academic development. PMID:24148062

Organizational Learning for Library Enhancements: A Collaborative, Research-Driven Analysis of Academic Department Needs

ERIC Educational Resources Information Center

Loo, Jeffery L.; Dupuis, Elizabeth A.

2015-01-01

This article presents a qualitative evaluation methodology of academic departments for library organizational learning and library enhancement planning. This evaluation used campus units' academic program review reports as a data source and employed collaborative content analysis by library liaisons to extract departmental strengths, weaknesses,…

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety

PubMed Central

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative–reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research. PMID:26297629

Evaluation of an implementation model: a national investigation of VA residential programs.

PubMed

Cook, Joan M; Dinnen, Stephanie; Coyne, James C; Thompson, Richard; Simiola, Vanessa; Ruzek, Josef; Schnurr, Paula P

2015-03-01

This national investigation utilizes qualitative data to evaluate an implementation model regarding factors influencing provider use of two evidence-based treatments for posttraumatic stress disorder (PTSD). Semi-structured qualitative interviews with 198 mental health providers from 38 Department of Veterans Affairs' (VA) residential treatment programs were used to explore these issues regarding prolonged exposure (PE) and cognitive processing therapy (CPT) in VA residential PTSD programs. Several unique and some overlapping predictors emerged. Leadership was viewed as an influence on implementation for both CPT and PE, while a lack of dedicated time and resources was viewed as a deterrent for both. Compatibility of CPT with providers' existing practices and beliefs, the ability to observe noticeable patient improvement, a perceived relative advantage of CPT over alternative treatments, and the presence of a supportive peer network emerged as influential on CPT implementation. Leadership was associated with PE implementation. Implications for the design and improvement of training and implementation efforts are discussed.

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety.

PubMed

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative-reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research.

A cervical cancer community-based participatory research project in a Native American community.

PubMed

Christopher, Suzanne; Gidley, Allison L; Letiecq, Bethany; Smith, Adina; McCormick, Alma Knows His Gun

2008-12-01

The Messengers for Health on the Apsáalooke Reservation project uses a community-based participatory research (CBPR) approach and lay health advisors (LHAs) to generate knowledge and awareness about cervical cancer prevention among community members in a culturally competent manner. Northern Plains Native Americans, of whom Apsáalooke women are a part, continue to be disproportionately affected by cervical cancer. This article examines quantitative and qualitative changes that occurred in the community since the inception of the Messengers for Health program. Paired sample t tests are used to evaluate the one-group pretest and posttest interviews of 83 Apsáalooke women in knowledge, comfort, and cancer awareness levels. Results reveal cervical cancer knowledge gains, gains in participants' comfort discussing cancer issues, and gains in awareness of cervical cancer and the Messengers program. Field notes, meeting minutes, and community perceptions are used to qualitatively evaluate the effectiveness of the Messengers program. Practice implications are discussed.

Using Mixed Methods to Evaluate a Community Intervention for Sexual Assault Survivors: A Methodological Tale.

PubMed

Campbell, Rebecca; Patterson, Debra; Bybee, Deborah

2011-03-01

This article reviews current epistemological and design issues in the mixed methods literature and then examines the application of one specific design, a sequential explanatory mixed methods design, in an evaluation of a community-based intervention to improve postassault care for sexual assault survivors. Guided by a pragmatist epistemological framework, this study collected quantitative and qualitative data to understand how the implementation of a Sexual Assault Nurse Examiner (SANE) program affected prosecution rates of adult sexual assault cases in a large midwestern community. Quantitative results indicated that the program was successful in affecting legal systems change and the qualitative data revealed the mediating mechanisms of the intervention's effectiveness. Challenges of implementing this design are discussed, including epistemological and practical difficulties that developed from blending methodologies into a single project. © The Author(s) 2011.

Expanding children's food experiences: the impact of a school-based kitchen garden program.

PubMed

Gibbs, Lisa; Staiger, Petra K; Johnson, Britt; Block, Karen; Macfarlane, Susie; Gold, Lisa; Kulas, Jenny; Townsend, Mardie; Long, Caroline; Ukoumunne, Obioha

2013-03-01

Evaluate achievement of the Stephanie Alexander Kitchen Garden Program in increasing child appreciation of diverse, healthy foods. Comparative 2-year study. Six program and 6 comparison primary schools in rural and metropolitan Victoria, Australia, matched for socioeconomic status and size. A total of 764 children in grades 3 to 6 (8-12 years of age) and 562 parents recruited. Retention rates at follow-up included 85% children and 75% parents. Each week of the school year, children spent 45 to 60 minutes in a garden class and 90 minutes in a kitchen class. Program impact on children's willingness to try new foods, capacity to describe foods, and healthy eating. Qualitative data analyzed using inductive thematic analysis. Quantitative data analyzed using random-effects linear regressions adjusted for school clustering. Child and parent qualitative and quantitative measures (if never tried before, odds ratio 2.0; confidence interval, 1.06-3.58) showed increases in children's reported willingness to try new foods. No differences in articulation of food descriptions (program vs comparison groups). Qualitative evidence showed that the program extended its influence to healthy eating, but this was not reflected in the quantitative evidence. Findings indicate program success in achieving its primary objective, meriting further program research. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Positive Effects of a Stress Reduction Program Based on Mindfulness Meditation in Brazilian Nursing Professionals: Qualitative and Quantitative Evaluation.

PubMed

dos Santos, Teresa Maria; Kozasa, Elisa Harumi; Carmagnani, Isabel Sampaio; Tanaka, Luiza Hiromi; Lacerda, Shirley Silva; Nogueira-Martins, Luiz Antonio

2016-01-01

Mindfulness meditation has been shown to effectively mitigate the negative effects of stress among nursing professionals, but in countries like Brazil, these practices are relatively unexplored. To evaluate the effects of a Stress Reduction Program (SRP) including mindfulness and loving kindness meditation among nursing professionals working in a Brazilian hospital setting. Pilot study with a mixed model using quantitative and qualitative methods was used to evaluate a group of participants. The quantitative data were analyzed at three different time points: pre-intervention, post-intervention, and follow-up. The qualitative data were analyzed at post-intervention. Hospital São Paulo (Brazil). Sample 13 nursing professionals, including nurses, technicians, and nursing assistants working in a hospital. Participants underwent mindfulness and loving kindness meditation during a period of six weeks. Perceived Stress Scale (PSS), Maslach Burnout Inventory (MBI), Beck Depression Inventory (BDI), State-Trait Anxiety Inventory (STAI), Satisfaction With Life Scale (SWLS), Self-Compassion Scale (SCS), WHOQOL-BREF quality of life assessment, and Work Stress Scale (WSS). Qualitative data were collected via a group interview following six weeks participation in the SRP. The quantitative analyses revealed a significant reduction (P < .05) between pre-intervention and post-intervention scores for perceived stress, burnout, depression, and anxiety (trait). These variables showed no significant differences between post-intervention and follow-up scores. The WHOQOL-BREF revealed significant increase (P < .05) just in the physical and psychological domains at post-intervention scores, which remained at the follow-up. Qualitative results showed improvement in the reactivity to inner experience; a more attentive perception of internal and external experiences; greater attention and awareness of actions and attitudes at every moment; and a positive influence of the SRP in nursing activities. Copyright © 2016 Elsevier Inc. All rights reserved.

A multi-level qualitative analysis of Telehomecare in Ontario: challenges and opportunities.

PubMed

Hunting, Gemma; Shahid, Nida; Sahakyan, Yeva; Fan, Iris; Moneypenny, Crystal R; Stanimirovic, Aleksandra; North, Taylor; Petrosyan, Yelena; Krahn, Murray D; Rac, Valeria E

2015-12-09

Despite research demonstrating the potential effectiveness of Telehomecare for people with Chronic Obstructive Pulmonary Disease and Heart Failure, broad-scale comprehensive evaluations are lacking. This article discusses the qualitative component of a mixed-method program evaluation of Telehomecare in Ontario, Canada. The objective of the qualitative component was to explore the multi-level factors and processes which facilitate or impede the implementation and adoption of the program across three regions where it was first implemented. The study employs a multi-level framework as a conceptual guide to explore the facilitators and barriers to Telehomecare implementation and adoption across five levels: technology, patients, providers, organizations, and structures. In-depth semi-structured interviews and ethnographic observations with program stakeholders, as well as a Telehomecare document review were used to elicit key themes. Study participants (n = 89) included patients and/or informal caregivers (n = 39), health care providers (n = 23), technicians (n = 2), administrators (n = 12), and decision makers (n = 13) across three different Local Health Integration Networks in Ontario. Key facilitators to Telehomecare implementation and adoption at each level of the multi-level framework included: user-friendliness of Telehomecare technology, patient motivation to participate in the program, support for Telehomecare providers, the integration of Telehomecare into broader health service provision, and comprehensive program evaluation. Key barriers included: access-related issues to using the technology, patient language (if not English or French), Telehomecare provider time limitations, gaps in health care provision for patients, and structural barriers to patient participation related to geography and social location. Though Telehomecare has the potential to positively impact patient lives and strengthen models of health care provision, a number of key challenges remain. As such, further implementation and expansion of Telehomecare must involve continuous assessments of what is working and not working with all stakeholders. Increased dialogue, evaluation, and knowledge translation within and across regions to understand the contextual factors influencing Telehomecare implementation and adoption is required. This can inform decision-making that better reflects and addresses the needs of all program stakeholders.

A qualitative evaluation of the 2005–2011 National Academic Centers of Excellence in Youth Violence Prevention Program☆

PubMed Central

Holland, Kristin M.; Vivolo-Kantor, Alana M.; Cruz, Jason Dela; Massetti, Greta M.; Mahendra, Reshma

2018-01-01

The Centers for Disease Control and Prevention’s Division of Violence Prevention (DVP) funded eight National Academic Centers of Excellence (ACEs) in Youth Violence Prevention from 2005 to 2010 and two Urban Partnership Academic Centers of Excellence (UPACEs) in Youth Violence Prevention from 2006 to 2011. The ACEs and UPACEs constitute DVP’s 2005–2011 ACE Program. ACE Program goals include partnering with communities to promote youth violence (YV) prevention and fostering connections between research and community practice. This article describes a qualitative evaluation of the 2005–2011 ACE Program using an innovative approach for collecting and analyzing data from multiple large research centers via a web-based Information System (ACE-IS). The ACE-IS was established as an efficient mechanism to collect and document ACE research and programmatic activities. Performance indicators for the ACE Program were established in an ACE Program logic model. Data on performance indicators were collected through the ACE-IS biannually. Data assessed Centers’ ability to develop, implement, and evaluate YV prevention activities. Performance indicator data demonstrate substantial progress on Centers’ research in YV risk and protective factors, community partnerships, and other accomplishments. Findings provide important lessons learned, illustrate progress made by the Centers, and point to new directions for YV prevention research and programmatic efforts. PMID:26319174

Socioeconomic impact assessment in ex ante evaluations: a case study on the rural development programs of the European Union.

PubMed

Vidueira, Pablo; Díaz-Puente, José M; Rivera, María

2014-08-01

Ex ante impact assessment has become a fundamental tool for effective program management, and thus, a compulsory task when establishing a new program in the European Union (EU). This article aims to analyze benefits from ex ante impact assessment, methodologies followed, and difficulties encountered. This is done through the case study on the rural development programs (RDPs) in the EU. Results regarding methodologies are then contrasted with the international context in order to provide solid insights to evaluators and program managing authorities facing ex ante impact assessment. All European RDPs from the period 2007 through 2013 (a total of 88) and their corresponding available ex ante evaluations (a total of 70) were analyzed focusing on the socioeconomic impact assessment. Only 46.6% of the regions provide quantified impact estimations on socioeconomic impacts in spite of it being a compulsory task demanded by the European Commission (EC). Recommended methods by the EC are mostly used, but there is a lack of mixed method approaches since qualitative methods are used in substitution of quantitative ones. Two main difficulties argued were the complexity of program impacts and the lack of needed program information. Qualitative approaches on their own have been found as not suitable for ex ante impact assessment, while quantitative approaches-such as microsimulation models-provide a good approximation to actual impacts. However, time and budgetary constraints make that quantitative and mixed methods should be mainly applied on the most relevant impacts for the program success. © The Author(s) 2014.

Technical Assistance and Changes in Nutrition and Physical Activity Practices in the National Early Care and Education Learning Collaboratives Project, 2015–2016

PubMed Central

Smith, Teresa M.; Estabrooks, Paul A.; Rasmussen, Cristy Geno; Blaser, Casey; Yaroch, Amy L

2018-01-01

Purpose and Objectives The National Early Care and Education Learning Collaboratives Project (ECELC) aims to improve best practices in early care and education (ECE) programs in topic areas of the Nutrition and Physical Activity Self-Assessment in Child Care (NAP SACC). Technical assistance is a component of the ECELC, yet its effect on outcomes is unclear. Beyond dose and duration of technical assistance, limited research exists on characteristics of technical assistance that contribute to outcomes. The objective of this study was to identify and describe technical assistance characteristics and explore associations with NAP SACC outcomes. Intervention Approach We collected data from 10 collaboratives comprising 84 ECE programs in 2 states in 2015–2016. The objective of technical assistance was to support programs in improving best practices. Technical assistance was provided to programs via on-site, telephone, or email and was tailored to program needs. Evaluation Methods We used a mixed-methods design to examine associations between technical assistance and NAP SACC outcomes. We used multiple regression analysis to assess quantitative data and qualitative comparative analysis to determine necessary and sufficient technical assistance conditions supporting NAP SACC outcomes. We also conducted a document review to describe technical assistance that referred conditions identified by the qualitative comparative analysis. Results Regression analyses detected an inverse relationship between changes in NAP SACC scores and hours of technical assistance. No clear pattern emerged in the qualitative comparative analysis, leaving no necessary and sufficient conditions. However, the qualitative comparative analysis identified feedback as a potentially important component of technical assistance, whereas resource sharing and frequent email were characteristics that seemed to reduce the likelihood of improved outcomes. Email and resource sharing were considered primarily general information rather than tailored technical assistance. Implications for Public Health Technical assistance may be used in programs and made adaptable to program needs. The inclusion and evaluation of technical assistance, especially tailored approaches, is warranted for environmental interventions, including ECE settings. PMID:29704371

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

PubMed

Holtrop, Jodi Summers; Rabin, Borsika A; Glasgow, Russell E

2018-03-13

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Organizational structure, team process, and future directions of interprofessional health care teams.

PubMed

Cole, Kenneth D; Waite, Martha S; Nichols, Linda O

2003-01-01

For a nationwide Geriatric Interdisciplinary Team Training (GITT) program evaluation of 8 sites and 26 teams, team evaluators developed a quantitative and qualitative team observation scale (TOS), examining structure, process, and outcome, with specific focus on the training function. Qualitative data provided an important expansion of quantitative data, highlighting positive effects that were not statistically significant, such as role modeling and training occurring within the clinical team. Qualitative data could also identify "too much" of a coded variable, such as time spent in individual team members' assessments and treatment plans. As healthcare organizations have increasing demands for productivity and changing reimbursement, traditional models of teamwork, with large teams and structured meetings, may no longer be as functional as they once were. To meet these constraints and to train students in teamwork, teams of the future will have to make choices, from developing and setting specific models to increasing the use of information technology to create virtual teams. Both quantitative and qualitative data will be needed to evaluate these new types of teams and the important outcomes they produce.

Color postprocessing for 3-dimensional finite element mesh quality evaluation and evolving graphical workstation

NASA Technical Reports Server (NTRS)

Panthaki, Malcolm J.

1987-01-01

Three general tasks on general-purpose, interactive color graphics postprocessing for three-dimensional computational mechanics were accomplished. First, the existing program (POSTPRO3D) is ported to a high-resolution device. In the course of this transfer, numerous enhancements are implemented in the program. The performance of the hardware was evaluated from the point of view of engineering postprocessing, and the characteristics of future hardware were discussed. Second, interactive graphical tools implemented to facilitate qualitative mesh evaluation from a single analysis. The literature was surveyed and a bibliography compiled. Qualitative mesh sensors were examined, and the use of two-dimensional plots of unaveraged responses on the surface of three-dimensional continua was emphasized in an interactive color raster graphics environment. Finally, a postprocessing environment was designed for state-of-the-art workstation technology. Modularity, personalization of the environment, integration of the engineering design processes, and the development and use of high-level graphics tools are some of the features of the intended environment.

First Year Experience: How We Can Better Assist First-Year International Students in Higher Education

ERIC Educational Resources Information Center

Yan, Zi; Sendall, Patricia

2016-01-01

While many American colleges and universities are providing a First Year Experience (FYE) course or program for their first year students, those programs are not often customized to take into account international students' (IS) unique challenges. Using quantitative and qualitative methods, this study evaluated a FYE course that was customized for…

Being an Ecoteam Member: Movers and Fighters

ERIC Educational Resources Information Center

Cincera, Jan; Kovacikova, Silvia

2014-01-01

This article presents a qualitative evaluation of the EcoSchool program in the Czech Republic. In order to analyze the way in which pupils interpret the purpose of their membership in EcoTeams, eight focus groups in schools highly involved in the program were interviewed (N = 83). The study is based on the assumption that the implementation of the…

African American perspectives: A qualitative study of an informal science enrichment program

NASA Astrophysics Data System (ADS)

Simpson, Jamila Rashida

The purposes of this study were to determine what program characteristics African American parents consider when they enroll their children into an informal science education enrichment program, the parents' evaluation of a program called Jordan Academy in which they enrolled their children, and the alignment of the parents' perspectives with Black Cultural Ethos (BCE). BCE refers to nine dimensions posited by Wade Boykin, a psychologist, as comprising African American culture. Participants were parents of students that attended Jordan Academy, an informal science enrichment program designed for third through sixth grade students from underserved populations. Qualitative methodologies were utilized to perform a thorough assessment of parents' perspectives. Data sources included classroom observations, student surveys, academy curriculum, photos and video-taped class sessions. Data included teachers and parents' responses to semi-structured, audio recorded interviews and students' written responses to open-ended items on the program's evaluation instrument. The data were analyzed for themes and the findings compared to Black Cultural Ethos. Findings revealed that the participants believed that informal science education offered their children opportunities not realized in the formal school setting - a means of impacting their children holistically. The parents expressed the academic, cultural, and personal development of their children in their characterizations of the ideal informal science education experience and in their evaluations of Jordan Academy. Overall, the parents' views emphasized the BCE values of harmony, affect, verve, movement, orality and communalism. The study has important implications for practices within and research on informal science education.

Utilization-focused evaluation of a STEM enrichment program

NASA Astrophysics Data System (ADS)

Carter, Sally

The purpose of this study was to determine the impact and utilization of a STEM enrichment program (hereafter referred to as The Program). The Program consisted of two parts. First an educator resource center provided free educational materials throughout The Program’s home state. The second part of The Program was a network of education specialists who provided professional development for teachers, modeled lessons with students, and provided presentations for the general public. The problem addressed by this study was a lack of knowledge regarding the impact of The Program. The Program’s director requested a utilization-focused program evaluation to answer thirteen questions. Questions covered Program impact for five areas: overall impact on teachers, overall impact on students, overall impact of materials, overall impact of Program personnel, and overall impact on STEM education. A mixed-methods case study was designed to gather data. Quantitative data included Program archival data regarding the number of contacts and a survey distributed to teachers who had used The Program’s services on at least one occasion. Qualitative data included written comments gathered from the teacher surveys, seven teacher focus groups, and four Program personnel interviews. Data found an overall positive Program impact in all five areas. Both quantitative and qualitative data showed favorable perceptions by teachers and Program personnel. It is not known if data from this case study can be generalized to other STEM enrichment programs. Future research might include a study to determine if The Program’s model could be used to generate new STEM enrichment programs.

Teaching qualitative research to BSW students through exposure to aging.

PubMed

Sidell, Nancy L

2007-01-01

This article describes one rural program's efforts to expose students to gerontology through teaching qualitative research methodology. A collaborative research pilot project was developed with a local nursing home. BSW students worked in two groups to conduct and present qualitative research projects by the course's completion. This article describes the research project and evaluates the project's success from student and instructor viewpoints. Significant differences were found in self-reported student knowledge of key concepts at the project's completion, compared with pre-test knowledge. Student comments revealed value in this teaching approach. Implications for further engaging students in gerontological research are discussed.

A place to call home: study protocol for a longitudinal, mixed methods evaluation of two housing first adaptations in Sydney, Australia.

PubMed

Whittaker, Elizabeth; Swift, Wendy; Flatau, Paul; Dobbins, Timothy; Schollar-Root, Olivia; Burns, Lucinda

2015-04-09

This protocol describes a study evaluating two 'Housing First' programs, Platform 70 and Common Ground, presently being implemented in the inner-city region of Sydney, Australia. The Housing First approach prioritises housing individuals who are homeless in standard lease agreement tenancies as rapidly as possible to lock in the benefits from long-term accommodation, even where the person may not be seen as 'housing ready'. The longitudinal, mixed methods evaluation utilises both quantitative and qualitative data collected at baseline and 12-month follow-up time points. For the quantitative component, clients of each program were invited to complete client surveys that reported on several factors associated with chronic homelessness and were hypothesised to improve under stable housing, including physical and mental health status and treatment rates, quality of life, substance use patterns, and contact with the health and criminal justice systems. Semi-structured interviews with clients and stakeholders comprised the qualitative component and focused on individual experiences with, and perceptions of, the two programs. In addition, program data on housing stability, rental subsidies and support levels provided to clients by agencies was collected and will be used in conjunction with the client survey data to undertake an economic evaluation of the two programs. This study will systematically evaluate the efficacy of a scatter site model (Platform 70) and a congregated model (Common Ground) of the Housing First approach; an examination that has not yet been made either in Australia or internationally. A clear strength of the study is its timing. It was designed and implemented as the programs in question themselves were introduced. Moreover, the programs were introduced when the Australian Government, with State and Territory support, began a more focused, coordinated response to homelessness and funded rapid expansion of innovative homelessness programs across the country, including Common Ground supportive housing developments.

A Strengths-Based Group Intervention for Women Who Experienced Child Sexual Abuse

ERIC Educational Resources Information Center

Walker-Williams, Hayley J.; Fouché, Ansie

2017-01-01

Purpose: This study evaluated the benefits of a ''survivor to thriver'' strengths-based group intervention program to facilitate posttraumatic growth in women survivors of child sexual abuse. Method: A quasi-experimental, one group, pretest, posttest, time-delay design was employed using qualitative methods to evaluate the benefits of the…

Methodology for Evaluating an Adaptation of Evidence-Based Drug Abuse Prevention in Alternative Schools

ERIC Educational Resources Information Center

Hopson, Laura M.; Steiker, Lori K. H.

2008-01-01

The purpose of this article is to set forth an innovative methodological protocol for culturally grounding interventions with high-risk youths in alternative schools. This study used mixed methods to evaluate original and adapted versions of a culturally grounded substance abuse prevention program. The qualitative and quantitative methods…

Assessing the Impact of Planned Social Change. Occasional Paper Series, #8.

ERIC Educational Resources Information Center

Campbell, Donald T.

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

Aspiring Principals' Perspectives about Teacher Supervision and Evaluation: Insights for Educational Leadership Preparation Programs

ERIC Educational Resources Information Center

Range, Bret G.; McKim, Courtney; Mette, Ian M.; Hvidston, David J.

2014-01-01

This qualitative study sought to understand the views of aspiring principals about teacher supervision and evaluation issues, including their perceived definitions of each, as well as concerns about performing either duty in their first administrative role. Thirty-­two educational administration graduate students enrolled in an instructional…

Initial Results of Illinois' Shifting Gears Pilot Demonstration Evaluation

ERIC Educational Resources Information Center

Bragg, Debra D.; Harmon, Timothy; Kirby, Catherine L.; Kim, Sujung

2009-01-01

This report provides initial results of Illinois' Shifting Gears Initiative that operated between July 1, 2007 and June 30, 2009. This mixed method (qualitative and quantitative) evaluation sought to accomplish three goals: (1) to assess program and student outcomes for two models (adult education and developmental education) for two target groups…

Evaluating a nursing communication skills training course: The relationships between self-rated ability, satisfaction, and actual performance.

PubMed

Mullan, Barbara A; Kothe, Emily J

2010-11-01

Effective communication is a vital component of nursing care, however, nurses often lack the skills to communicate with patients, carers and other health care professionals. Communication skills training programs are frequently used to develop these skills. However, there is a paucity of data on how best to evaluate such courses. The aim of the current study was to evaluate the relationship between student self rating of their own ability and their satisfaction with a nurse training course as compared with an objective measure of communication skills. 209 first year nursing students completed a communication skills program. Both qualitative and quantitative data were collected and associations between measures were investigated. Paired samples t-tests showed significant improvement in self-rated ability over the course of the program. Students generally were very satisfied with the course which was reflected in both qualitative and quantitative measures. However, neither self-rated ability nor satisfaction was significantly correlated with the objective measure of performance, but self-rated ability and satisfaction were highly correlated with one another. The importance of these findings is discussed and implications for nurse education are proposed. Copyright © 2010 Elsevier Ltd. All rights reserved.

Evaluator competencies in the context of diversity training: The practitioners' point of view.

PubMed

Froncek, Benjamin; Mazziotta, Agostino; Piper, Verena; Rohmann, Anette

2018-04-01

Evaluator competencies have been discussed since the beginnings of program evaluation literature. More recently, the Essential Competencies for Program Evaluators (Ghere et al., 2006; Stevahn, King, Ghere & Minnema, 2005a) have proven to be a useful taxonomy for learning and improving evaluation practice. Evaluation is critical to diversity training activities, and diversity training providers face the challenge of conducting evaluations of their training programs. We explored what competencies are viewed as instrumental to conducting useful evaluations in this specific field of evaluation practice. In an online survey, N = 172 diversity training providers were interviewed via an open answer format about their perceptions of evaluator competencies, with n = 95 diversity training providers contributing statements. The Essential Competencies for Program Evaluators were used to conduct a deductive qualitative content analysis of the statements. While systematic inquiry, reflective practice, and interpersonal competence were well represented, situational analysis and project management were not. Implications are discussed for evaluation capacity building among diversity training providers and for negotiating evaluation projects with evaluation professionals. Copyright © 2018 Elsevier Ltd. All rights reserved.

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

Students' experiences of embedded academic literacy support in a graduate entry nursing program: A qualitative study.

PubMed

Ramjan, Lucie M; Maneze, Della; Everett, Bronwyn; Glew, Paul; Trajkovski, Suza; Lynch, Joan; Salamonson, Yenna

2018-01-01

Graduate entry nursing (GEN) programs were designed to address the predicted nursing shortfall. In Australia, although these programs attract students from culturally and linguistically diverse (CALD) backgrounds, the workload is compounded by cultural differences and a new academic learning environment which presents additional challenges. This qualitative descriptive study explored the experiences of GEN students enrolled in the introductory unit of their nursing program with embedded academic literacy support in Sydney, Australia. Twenty-four commencing GEN students were interviewed in January 2016. Interviews were transcribed verbatim and thematically analysed. Three main themes emerged which illustrated that GEN students were 'diamonds in the rough'. They possessed a raw natural beauty that required some shaping and polishing to ensure academic needs were met. To ensure retention is high, institutions need to evaluate how best to support and harness the potential of these unique students. Copyright © 2017 Elsevier Ltd. All rights reserved.

Determining Safety Inspection Thresholds for Employee Incentives Programs on Construction Sites

PubMed Central

Sparer, Emily; Dennerlein, Jack

2017-01-01

The goal of this project was to evaluate approaches of determining the numerical value of a safety inspection score that would activate a reward in an employee safety incentive program. Safety inspections are a reflection of the physical working conditions at a construction site and provide a safety score that can be used in incentive programs to reward workers. Yet it is unclear what level of safety should be used when implementing this kind of program. This study explored five ways of grouping safety inspection data collected during 19 months at Harvard University-owned construction projects. Each approach grouped the data by one of the following: owner, general contractor, project, trade, or subcontractor. The median value for each grouping provided the threshold score. These five approaches were then applied to data from a completed project in order to calculate the frequency and distribution of rewards in a monthly safety incentive program. The application of each approach was evaluated qualitatively for consistency, competitiveness, attainability, and fairness. The owner-specific approach resulted in a threshold score of 96.3% and met all of the qualitative evaluation goals. It had the most competitive reward distribution (only 1/3 of the project duration) yet it was also attainable. By treating all workers equally and maintaining the same value throughout the project duration, this approach was fair and consistent. The owner-based approach for threshold determination can be used by owners or general contractors when creating leading indicator incentives programs and by researchers in future studies on incentive program effectiveness. PMID:28638178

Improving Culturally Appropriate Care Using a Community-Based Participatory Research Approach: Evaluation of a Multicomponent Cultural Competency Training Program, Arkansas, 2015–2016

PubMed Central

Long, Christopher R.; Rowland, Brett; Moore, Sarah; Wilmoth, Ralph; Ayers, Britni

2017-01-01

Introduction The United States continues to become more racially and ethnically diverse, and racial/ethnic minority communities encounter sociocultural barriers to quality health care, including implicit racial/ethnic bias among health care providers. In response, health care organizations are developing and implementing cultural competency curricula. Using a community-based participatory research (CBPR) approach, we developed and evaluated a cultural competency training program to improve the delivery of culturally appropriate care in Marshallese and Hispanic communities. Methods We used a mixed-methods evaluation approach based on the Kirkpatrick model of training evaluation. We collected quantitative evaluation data immediately after each training session (March 19, 2015–November 30, 2016) and qualitative data about implementation at 2 points: immediately after each session and 6 months after training. Individuals and organizational units provided qualitative data. Results We delivered 1,250 units of in-person training at 25 organizations. Participants reported high levels of changes in knowledge (91.2%), competence (86.6%), and performance (87.2%) as a result of the cultural competency training. Organizations reported making policy and environmental changes. Conclusion Initial outcomes demonstrate the value of developing and implementing cultural competency training programs using a CBPR approach. Additional research is needed to determine the effect on long-term patient outcomes. PMID:28771402

34 CFR 350.61 - What evaluation requirements must a grantee meet?

Code of Federal Regulations, 2012 CFR

2012-07-01

... REHABILITATION RESEARCH PROJECTS AND CENTERS PROGRAM What Conditions Must Be Met After an Award? § 350.61 What... qualitative. (b) A grantee must make periodic assessments of progress that will provide the grantee with...

34 CFR 350.61 - What evaluation requirements must a grantee meet?

Code of Federal Regulations, 2013 CFR

2013-07-01

... REHABILITATION RESEARCH PROJECTS AND CENTERS PROGRAM What Conditions Must Be Met After an Award? § 350.61 What... qualitative. (b) A grantee must make periodic assessments of progress that will provide the grantee with...

34 CFR 350.61 - What evaluation requirements must a grantee meet?

Code of Federal Regulations, 2010 CFR

2010-07-01

... REHABILITATION RESEARCH PROJECTS AND CENTERS PROGRAM What Conditions Must Be Met After an Award? § 350.61 What... qualitative. (b) A grantee must make periodic assessments of progress that will provide the grantee with...

Qualitative evaluation of a high school yoga program: feasibility and perceived benefits.

PubMed

Conboy, Lisa A; Noggle, Jessica J; Frey, Jessica L; Kudesia, Ravi S; Khalsa, Sat Bir S

2013-01-01

This is the first published qualitative assessment of a yoga program applied in a high school setting. This qualitative interview study was nested in a randomized, controlled trial studying the effects of a yoga program offered in place of a semester of physical education classes at a rural public high school. Student interviews were conducted after taking part in a semester of the yoga program. A formal passive consent with information about the qualitative study was sent home to parents/guardians of all students in the parent study before the interviews. Most students enjoyed the yoga classes and felt benefits. Negative reports of yoga practice were associated with gender as most males sensed peer pressure against practicing yoga. Despite this finding, most students wanted to continue yoga and would continue if it were offered in school. Positive reports include a greater kinesthetic awareness, which some students associated with a greater respect for the body and improved self-image. Among students reporting psychological benefits, many cited stress reduction; many used yoga to manage negative emotions; and some propagated more optimism. Most thought yoga could reduce interest in the use of drugs and alcohol and increase social cohesion with family and peers. We found that a yoga program is feasible in this sample of 9th and 10th graders, especially after benefits are perceived. We also found evidence that yoga may lead to emergent positive benefits in health behaviors not directly prescribed by the program. These results suggest that school-based yoga programs may be appropriate for promoting healthy behaviors at a societal level by focusing on the prevention of negative patterns during the adolescent transition. Copyright © 2013 Elsevier Inc. All rights reserved.

Methods for collecting algal samples as part of the National Water-Quality Assessment Program

USGS Publications Warehouse

Porter, Stephen D.; Cuffney, Thomas F.; Gurtz, Martin E.; Meador, Michael R.

1993-01-01

Benthic algae (periphyton) and phytoplankton communities are characterized in the U.S. Geological Survey's National Water-Quality Assessment Program as part of an integrated physical, chemical, and biological assessment of the Nation's water quality. This multidisciplinary approach provides multiple lines of evidence for evaluating water-quality status and trends, and for refining an understanding of the factors that affect water-quality conditions locally, regionally, and nationally. Water quality can be characterized by evaluating the results of qualitative and quantitative measurements of the algal community. Qualitative periphyton samples are collected to develop of list of taxa present in the sampling reach. Quantitative periphyton samples are collected to measure algal community structure within selected habitats. These samples of benthic algal communities are collected from natural substrates, using the sampling methods that are most appropriate for the habitat conditions. Phytoplankton samples may be collected in large nonwadeable streams and rivers to meet specific program objectives. Estimates of algal biomass (chlorophyll content and ash-free dry mass) also are optional measures that may be useful for interpreting water-quality conditions. A nationally consistent approach provides guidance on site, reach, and habitat selection, as well as information on methods and equipment for qualitative and quantitative sampling. Appropriate quality-assurance and quality-control guidelines are used to maximize the ability to analyze data locally, regionally, and nationally.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

PubMed

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluating the Effectiveness of a Senior Mentor Program: The University of Missouri-Columbia School of Medicine

ERIC Educational Resources Information Center

Hoffman, Kimberly G.; Gray, Peggy; Hosokawa, Michael C.; Zweig, Steven C.

2006-01-01

At the University of Missouri-Columbia School of Medicine, we developed a voluntary senior-mentor program, the Senior Teacher Educator Partnership (STEP), for first- and second-year medical students. Using qualitative research methods, we examined the impact of STEP on medical students' attitudes and then assessed the congruence of what is learned…

Scholar outcomes for dental internship research program in Saudi Arabia: A qualitative evaluation.

PubMed

Bahammam, Laila A; Linjawi, Amal I

2017-04-01

To explore the potential, challenges and needs for internship research activities in achieving scholar outcomes among graduates. A qualitative general needs assessment and evaluation of an internship research program was conducted at King Abdulaziz University, Faculty of Dentistry (KAUFD), KSA, from December 2014 to February 2015 using focus groups and interviews. The participants included: administrates, faculty, and internship students. Data were transcribed and analyzed following the grounded theory. The participants were two administrative personnel, 21 faculty members, and 16 internship students. Results were clustered around five main domains; curriculum design, faculty, students, administrative, and institutional domain. Reported potentials included: a multi-faceted educational intervention approach, and building evidence-based skills and inquiry minds among graduates. Time, load, and incentives were major challenges reported by faculty. Interesting and achievable research topics were major challenges reported by students. Areas that needed development included: equipped research personnel, aligned administrative and institutional support, faculty skills, students' knowledge and skills, aligned curriculum, and clear program goals, objectives, and outcomes. Curriculum design, faculty and students' skills; as well as administrative and institutional support were found to play major roles in the success of the current internship research program at KAUFD.

Commentary on Foubert, Godin, & Tatum (2010): the evolution of sexual violence prevention and the urgency for effectiveness.

PubMed

Tharp, Andra Teten; DeGue, Sarah; Lang, Karen; Valle, Linda Anne; Massetti, Greta; Holt, Melissa; Matjasko, Jennifer

2011-11-01

Foubert, Godin, and Tatum describe qualitative effects among college men of The Men's Program, a one-session sexual violence prevention program. This article and the program it describes are representative of many sexual violence prevention programs that are in practice and provide an opportunity for a brief discussion of the development and evaluation of sexual violence prevention approaches. In this commentary, we will focus on two considerations for an evolving field: the adherence to the principles of prevention and the use of rigorous evaluation methods to demonstrate effectiveness. We argue that the problem of sexual violence has created urgency for effective prevention programs and that scientific and prevention standards provide the best foundation to meet this need.

Evaluation of life and death studies course on attitudes toward life and death among nursing students.

PubMed

Hwang, Huei-Lih; Lin, Huey-Shyan; Chen, Wen-Tin

2005-12-01

The aim of this study was to evaluate attitudes toward life and death among nursing students after attending the life and death studies (LDS) program. Both qualitative and quantitative methods were used to collect data. The pretest-posttest control group design randomly assigned students to an experimental (n = 47) or control group (n = 49). The 13-week course included lectures, video appraisal, games, simulations, films, books, assignments and group sharing. Statistical and content analysis were used to analyze qualitative and quantitative data. The findings showed a significant improvement in perception of the meaningfulness of life in four categories of improvement: expanded viewpoint, sadness about death, treating life sincerely, and instilling hope in life. The qualitative data indicated that a positive change in meaning of life was associated with interaction with others and self-reflection.

Improving clinical and translational research training: a qualitative evaluation of the Atlanta Clinical and Translational Science Institute KL2-mentored research scholars program

PubMed Central

Comeau, Dawn L; Escoffery, Cam; Freedman, Ariela; Ziegler, Thomas R; Blumberg, Henry M

2017-01-01

A major impediment to improving the health of communities is the lack of qualified clinical and translational research (CTR) investigators. To address this workforce shortage, the National Institutes of Health (NIH) developed mechanisms to enhance the career development of CTR physician, PhD, and other doctoral junior faculty scientists including the CTR-focused K12 program and, subsequently, the KL2-mentored CTR career development program supported through the Clinical and Translational Science Awards (CTSAs). Our evaluation explores the impact of the K12/KL2 program embedded within the Atlanta Clinical and Translational Science Institute (ACTSI), a consortium linking Emory University, Morehouse School of Medicine and the Georgia Institute of Technology. We conducted qualitative interviews with program participants to evaluate the impact of the program on career development and collected data on traditional metrics (number of grants, publications). 46 combined K12/KL2 scholars were supported between 2002 and 2016. 30 (65%) of the 46 K12/KL2 scholars are women; 24 (52%) of the trainees are minorities, including 10 (22%) scholars who are members of an underrepresented minority group. Scholars reported increased research skills, strong mentorship experiences, and positive impact on their career trajectory. Among the 43 scholars who have completed the program, 39 (91%) remain engaged in CTR and received over $89 000 000 as principal investigators on federally funded awards. The K12/KL2 funding provided the training and protected time for successful career development of CTR scientists. These data highlight the need for continued support for CTR training programs for junior faculty. PMID:27591319

A program evaluation of Protovation Camp at an elementary school in North Carolina

NASA Astrophysics Data System (ADS)

Cavoly, Denise Y.

The purpose of this program evaluation was to investigate the impact over time teachers' self-efficacies and the outcome expectancies of those who participated in an inquiry-based, hands-on, constructivist professional development program to learn science content. The hope was that after active participation in this inquiry-based professional development program that provides science inquiry experiences, the teachers, graduate students and elementary students would gain content knowledge, increase self-efficacies, and provide the outcome expectancies of the learning development program that provides science inquiry experiences. The mixed-methods approach used quantitative and qualitative data for campers, which consisted of pre-test and post-test scores on the Test of Science-Related Attitudes (TOSRA), the Draw-A-Scientist Test, Science Process Skills Inventory (SPSI) and content tests based on the camp activities. Additionally, TOSRA scores, Teacher Sense of Efficacy Scale (TSES), and Thinking about Science Survey (TSSI) results for the graduate students and elementary teachers were used along with qualitative data collected from plusdelta charts and interviews to determine the impact of participation in Protovation Camp on teachers and students. Results of the program evaluation indicated that when students were taught inquiry-based lessons that ignite wonder, both their attitudes toward science and their knowledge about science improved. An implication for teacher preparation programs was that practicing inquiry-based lessons on actual elementary students was an important component for teachers and graduate students as they prepare to positively impact student learning in their own classrooms. The findings of this study suggest that it is not just the length of the professional development program that is crucial, but the need for an implementation period while teachers work to transfer the learning to the classroom to their own students is critical to the success of process.

Qualitative evaluation of a self-management intervention for people in the early stage of dementia.

PubMed

Martin, Faith; Turner, Andrew; Wallace, Louise M; Stanley, Damian; Jesuthasan, Jana; Bradbury, Nicola

2015-07-01

Self-management programs are effective for people living with chronic illnesses. However, there has been little research addressing self-management for people with dementia in the early stages. This study presents a qualitative evaluation of the experiences of attending a novel self-management program and initial process evaluation. The program was designed with and for people with dementia. It addresses: (a) relationship with family, (b) maintenance of an active lifestyle, (c) psychological well-being, (d) techniques to cope with memory changes and (e) information about dementia. Six participants with early stage dementia completed the intervention that was co-delivered by lay and clinical professional tutors. Participants and tutors attended focus group and interviews at the end of the program to explore their perceptions of the intervention. These were audio-recorded, transcribed verbatim and analysed thematically. Participants reported enjoyment and benefits from the intervention. This was despite some reporting concerns relating to their memory difficulties. The program's flexible nature, focus on strengths and the opportunity to spend time with other people living with dementia were particularly well received. Participants and tutors outlined areas for further improvement. The program was feasible and its flexible delivery appeared to facilitate participant benefit. Emphasis should be placed on maintaining activity and relationships, improving positive well-being and social interaction during the program. Memory of the pleasant experience and strengths focus was evidenced, which may impact positively on quality of life. The results highlight the usefulness and acceptability of self-management for people with early stage dementia and provide initial support for the program's structure and content. © The Author(s) 2013.

Developing medical educators – a mixed method evaluation of a teaching education program

PubMed Central

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) ‘Reaction’ on a professional and emotional level using standardized questionnaires; 2) ‘Learning’ applying a multiple choice test; 3) ‘Behavior’ by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) ‘Results’ from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (P<0.001) as deduced from a pre-post multiple-choice questionnaire, which was retained at 6 months (P<0.001). 3) Behavior: Peer-, self-, and expert-assessment indicated a transfer of learning into teaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students’ evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings. PMID:24679671

Supporting aboriginal knowledge and practice in health care: lessons from a qualitative evaluation of the strong women, strong babies, strong culture program.

PubMed

Lowell, Anne; Kildea, Sue; Liddle, Marlene; Cox, Barbara; Paterson, Barbara

2015-02-05

The Strong Women, Strong Babies, Strong Culture Program (the Program) evolved from a recognition of the value of Aboriginal knowledge and practice in promoting maternal and child health (MCH) in remote communities of the Northern Territory (NT) of Australia. Commencing in 1993 it continues to operate today. In 2008, the NT Department of Health commissioned an evaluation to identify enabling factors and barriers to successful implementation of the Program, and to identify potential pathways for future development. In this paper we focus on the evaluation findings related specifically to the role of Aborignal cultural knowledge and practice within the Program. A qualitative evaluation utilised purposive sampling to maximise diversity in program history and Aboriginal culture. Semi-structured, in-depth interviews with 76 participants were recorded in their preferred language with a registered Interpreter when required. Thematic analysis of data was verified or modified through further discussions with participants and members of the evaluation team. Although the importance of Aboriginal knowledge and practice as a fundamental component of the Program is widely acknowledged, there has been considerable variation across time and location in the extent to which these cultural dimensions have been included in practice. Factors contributing to this variation are complex and relate to a number of broad themes including: location of control over Program activities; recognition and respect for Aboriginal knowledge and practice as a legitimate component of health care; working in partnership; communication within and beyond the Program; access to transport and working space; and governance and organisational support. We suggest that inclusion of Aboriginal knowledge and practice as a fundamental component of the Program is key to its survival over more than twenty years despite serious challenges. Respect for the legitimacy of Aboriginal knowledge and practice within health care, a high level of community participation and control supported through effective governance and sufficient organisational commitment as well as competence in intercultural collaborative practice of health staff are critical requirements for realising the potential for cultural knowledge and practice to improve Aboriginal health outcomes.

Development and Evaluation of Innovative Peer-Led Physical Activity Programs for Mental Health Service Users

PubMed Central

Graham, Candida R.; Larstone, Roseann; Griffiths, Brenda; de Leeuw, Sarah; Anderson, Lesley; Powell-Hellyer, Stephanie; Long, Nansi

2017-01-01

Abstract Mental health service users (MHSUs) have elevated rates of cardiometabolic disturbance. Improvements occur with physical activity (PA) programs. We report the development and evaluation of three innovative peer-developed and peer-led PA programs: 1) walking; 2) fitness; and 3) yoga. Qualitative evaluation with 33 MHSUs in British Columbia, Canada, occurred. These programs yielded improvements for participants, highlighted by powerful narratives of health improvement, and improved social connections. The feasibility and acceptability of innovative peer-developed and peer-led programs were shown. Analyses revealed concepts related to engagement and change. Relating core categories, we theorize effective engagement of MHSUs requires accessibility on three levels (geographic, cost, and program flexibility) and health behavior change occurs within co-constituent relationships (to self, to peers, and to the wider community). This study highlights the benefits of peer involvement in developing and implementing PA programs and provides a theoretical framework of understanding engagement and behavior change in health programs for MHSUs. PMID:28953007

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Interdisciplinary Studies and the Real World: A Practical Rationale for and Guide to Postgraduation Evaluation and Assessment

ERIC Educational Resources Information Center

Brooks, Benjamin; Widders, Evan

2012-01-01

This article is an outgrowth of the evaluation and assessment process in a large interdisciplinary studies (IDS) program at West Virginia University. We argue for the importance of collecting and assessing quantitative and qualitative data concerning learning outcomes, student satisfaction, career choice and development, and graduate education…

Creating Effective Civic Engagement Policy for Adolescents: Quantitative and Qualitative Evaluations of Compulsory Community Service

ERIC Educational Resources Information Center

Henderson, Ailsa; Pancer, S. Mark; Brown, Steven D.

2014-01-01

For high school community service programs to have a positive impact on subsequent civic engagement, students must volunteer in a sustained manner and must evaluate their volunteering experiences positively. Using a survey with 1,293 respondents and 100 semistructured interviews with past participants of the mandatory community service program…

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Understanding parenting in Manitoba First nations: implications for program development.

PubMed

Eni, Rachel; Rowe, Gladys

2011-01-01

This qualitative study introduced the "Manitoba First Nation Strengthening Families Maternal Child Health Pilot Project" program and evaluation methodologies. The study provided a knowledge base for programmers, evaluators, and communities to develop relevant health promotion, prevention, and intervention programming to assist in meeting health needs of pregnant women and young families. Sixty-five open-ended, semistructured interviews were completed in 13 communities. Data analysis was through grounded theory. Three major themes emerged from the data: interpersonal support and relationships; socioeconomic factors; and community initiatives. Complex structural, historical events compromise parenting; capacity and resilience are supported through informal and formal health and social supports.

Youth perceptions of comprehensive adolescent health services through the Boston HAPPENS program.

PubMed

Rosenfeld, S L; Keenan, P M; Fox, D J; Chase, L H; Melchiono, M W; Woods, E R

2000-01-01

The Boston HAPPENS (HIV Adolescent Provider and Peer Education Network for Services) program is a collaborative network of care made up of 8 organizations that serve youth and provide coordinated care for human immunodeficiency virus (HIV)-positive, homeless, and at-risk youth aged 12 to 24 years. Learning youth perceptions about the program is essential to determine if the program is meeting their needs. In this qualitative evaluation, 18 youth served by the network met in 4 focus groups to provide their view of the program. Services within 5 categories were assessed: (a) medical care, (b) mental health and substance abuse care, (c) HIV prevention and care, (d) case management, and (e) allocation of finances. Boston HAPPENS has achieved name recognition and provides many needed services for youth from a wide variety of backgrounds. The youth were comfortable receiving care and were appreciative of the comprehensive services available. They provided suggestions for how mental health services could be offered as one-on-one counseling as part of "wellness care." Young participants also requested more recreational and support opportunities for young people living with HIV. Qualitative evaluations such as this give a voice to youth to advocate for services they need. By including youth ideas and perspectives during program development and implementation, services can be more attractive to groups of at-risk youth who historically have been less likely to seek care.

Stirring up the Mud: Using a Community-Based Participatory Approach to Address Health Disparities through a Faith-Based Initiative

PubMed Central

Kaplan, Sue A.; Ruddock, Charmaine; Golub, Maxine; Davis, Joyce; Foley, Robert; Devia, Carlos; Rosen, Rosa; Berry, Carolyn; Barretto, Brenda; Carter, Toni; Irish-Spencer, Evalina; Marchena, Maria; Purcaro, Ellenrita; Calman, Neil

2011-01-01

This case study provides a mid-course assessment of the Bronx Health REACH faith-based initiative four years into its implementation. The study uses qualitative methods to identify lessons learned and to reflect on the benefits and challenges of using a community-based participatory approach for the development and evaluation of a faith-based program designed to address health disparities. Key findings concern the role of pastoral leadership, the importance of providing a religious context for health promotion and health equality messages, the challenges of creating a bilingual/bi-cultural program, and the need to provide management support to the lay program coordinators. The study also identifies lessons learned about community-based evaluation and the importance of addressing community concern about the balance between evaluation and program. Finally, the study identifies the challenges that lie ahead, including issues of program institution-alization and sustainability. PMID:20168022

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

Accelerated Training of Skilled Birth Attendants in a Marginalized Population on the Thai-Myanmar Border: A Multiple Methods Program Evaluation.

PubMed

White, Adrienne Lynne; Min, Thaw Htwe; Gross, Mechthild M; Kajeechiwa, Ladda; Thwin, May Myo; Hanboonkunupakarn, Borimas; Than, Hla Hla; Zin, Thet Wai; Rijken, Marcus J; Hoogenboom, Gabie; McGready, Rose

2016-01-01

To evaluate a skilled birth attendant (SBA) training program in a neglected population on the Thai-Myanmar border, we used multiple methods to show that refugee and migrant health workers can be given effective training in their own environment to become SBAs and teachers of SBAs. The loss of SBAs through resettlement to third countries necessitated urgent training of available workers to meet local needs. All results were obtained from student records of theory grades and clinical log books. Qualitative evaluation of both the SBA and teacher programs was obtained using semi-structured interviews with supervisors and teachers. We also reviewed perinatal indicators over an eight-year period, starting prior to the first training program until after the graduation of the fourth cohort of SBAs. Four SBA training programs scheduled between 2009 and 2015 resulted in 79/88 (90%) of students successfully completing a training program of 250 theory hours and 625 supervised clinical hours. All 79 students were able to: achieve pass grades on theory examination (median 80%, range [70-89]); obtain the required clinical experience within twelve months; achieve clinical competence to provide safe care during childbirth. In 2010-2011, five experienced SBAs completed a train-the-trainer (TOT) program and went on to facilitate further training programs. Perinatal indicators within Shoklo Malaria Research Unit (SMRU), such as place of birth, maternal and newborn outcomes, showed no significant differences before and after introduction of training or following graduate deployment in the local maternity units. Confidence, competence and teamwork emerged from qualitative evaluation by senior SBAs working with and supervising students in the clinics. We demonstrate that in resource-limited settings or in marginalized populations, it is possible to accelerate training of skilled birth attendants to provide safe maternity care. Education needs to be tailored to local needs to ensure evidence-based care of women and their families.

Accelerated Training of Skilled Birth Attendants in a Marginalized Population on the Thai-Myanmar Border: A Multiple Methods Program Evaluation

PubMed Central

White, Adrienne Lynne; Min, Thaw Htwe; Gross, Mechthild M.; Kajeechiwa, Ladda; Thwin, May Myo; Hanboonkunupakarn, Borimas; Than, Hla Hla; Zin, Thet Wai; Rijken, Marcus J.; Hoogenboom, Gabie; McGready, Rose

2016-01-01

Background To evaluate a skilled birth attendant (SBA) training program in a neglected population on the Thai-Myanmar border, we used multiple methods to show that refugee and migrant health workers can be given effective training in their own environment to become SBAs and teachers of SBAs. The loss of SBAs through resettlement to third countries necessitated urgent training of available workers to meet local needs. Methods and Findings All results were obtained from student records of theory grades and clinical log books. Qualitative evaluation of both the SBA and teacher programs was obtained using semi-structured interviews with supervisors and teachers. We also reviewed perinatal indicators over an eight-year period, starting prior to the first training program until after the graduation of the fourth cohort of SBAs. Results Four SBA training programs scheduled between 2009 and 2015 resulted in 79/88 (90%) of students successfully completing a training program of 250 theory hours and 625 supervised clinical hours. All 79 students were able to: achieve pass grades on theory examination (median 80%, range [70–89]); obtain the required clinical experience within twelve months; achieve clinical competence to provide safe care during childbirth. In 2010–2011, five experienced SBAs completed a train-the-trainer (TOT) program and went on to facilitate further training programs. Perinatal indicators within Shoklo Malaria Research Unit (SMRU), such as place of birth, maternal and newborn outcomes, showed no significant differences before and after introduction of training or following graduate deployment in the local maternity units. Confidence, competence and teamwork emerged from qualitative evaluation by senior SBAs working with and supervising students in the clinics. Conclusions We demonstrate that in resource-limited settings or in marginalized populations, it is possible to accelerate training of skilled birth attendants to provide safe maternity care. Education needs to be tailored to local needs to ensure evidence-based care of women and their families. PMID:27711144

Built environment interventions aimed at improving physical activity levels in rural Ontario health units: a descriptive qualitative study.

PubMed

Coghill, Cara-Lee; Valaitis, Ruta K; Eyles, John D

2015-05-03

Few studies to date have explored the relationship between the built environment and physical activity specifically in rural settings. The Ontario Public Health Standards policies mandate that health units in Ontario address the built environment; however, it is unclear how public health practitioners are integrating the built environment into public health interventions aimed at improving physical activity in chronic disease prevention programs. This descriptive qualitative study explored interventions that have or are being implemented which address the built environment specifically related to physical activity in rural Ontario health units, and the impact of these interventions. Data were collected through twelve in-depth semi-structured interviews with rural public health practitioners and managers representing 12 of 13 health units serving rural communities. Key themes were identified using qualitative content analysis. Themes that emerged regarding the types of interventions that health units are employing included: Engagement with policy work at a municipal level; building and working with community partners, committees and coalitions; gathering and providing evidence; developing and implementing programs; and social marketing and awareness raising. Evaluation of interventions to date has been limited. Public health interventions, and their evaluations, are complex. Health units who serve large rural populations in Ontario are engaging in numerous activities to address physical activity levels. There is a need to further evaluate the impact of these interventions on population health.

A qualitative evaluation of strategies to increase colorectal cancer screening uptake

PubMed Central

Tinmouth, Jill; Ritvo, Paul; McGregor, S. Elizabeth; Claus, Danielle; Pasut, George; Myers, Ronald E.; Guglietti, Crissa; Paszat, Lawrence F.; Hilsden, Robert J.; Rabeneck, Linda

2011-01-01

Abstract Objective To obtain data that could be used to optimize the content and design of the targeted, mailed invitations that Ontario’s provincewide colorectal cancer (CRC) screening program plans to use to increase screening uptake; to identify other strategies to increase CRC screening uptake; and to describe the effects of this qualitative work on a subsequent quantitative pilot study. Design Qualitative study using semistructured focus groups. Setting Four different Ontario communities. Participants Six focus groups comprising a total of 62 participants. Methods Six focus groups were conducted in 4 different Ontario communities. For 3 of the communities, participants were recruited from the general population by a private marketing firm, using random-digit dialing, and received a small honorarium for participating. In Sault Ste Marie, participants were convenience samples recruited from a large primary care practice and were not offered compensation. Responses were elicited regarding various strategies for promoting CRC screening. Findings represent all responses observed as well as recommendations to program planners based on focus groups observations. Main findings Key themes identified included the importance of receiving a CRC screening invitation from one’s family physician; a desire for personalized, brief communications; and a preference for succinct information in mailed materials. Strong support was indicated for direct mailing of the CRC screening kit (fecal occult blood test). Our findings substantially influenced the final design and content of the envelope and letter to be mailed in the subsequent quantitative pilot study. Conclusion We report strong support from our focus groups for a succinct, personalized invitation for CRC screening from one’s own family physician. We have also shown that qualitative evaluation can be used to provide decision makers with pertinent and timely knowledge. Our study is highly relevant to other public health programs, particularly other Canadian jurisdictions planning organized CRC screening programs. PMID:21322288

Investigation of Pre-Service Teachers' Opinions about Science in Terms of the Basic Elements of the Education Program

ERIC Educational Resources Information Center

Sengul, Ozge Aydin

2016-01-01

The purpose of the current study is to investigate the pre-service teachers' opinions about science within the context of the basic elements of the education program, such as objectives, content, learning-teaching process and evaluation. The study was designed as a case study, one of the qualitative research methods. The participants of the study…

Causes of Low Graduation Rates in a Rural High School Located in South Carolina: A Case Study

ERIC Educational Resources Information Center

Sumter, Pamela Robinson

2013-01-01

This qualitative case study examined causes of low graduation rates for young adults. The purpose of this study was to evaluate students participating in an after-school program and reflect on their perceptions of that program a year after they graduated. The theoretical framework for this study reflected upon an open social system. The research…

Behavioural Family Intervention with Parents of Children with ASD: What Do They Find Useful in the Parenting Program Stepping Stones Triple P?

ERIC Educational Resources Information Center

Whittingham, Koa; Sofronoff, Kate; Sheffield, Jeanie; Sanders, Matthew R.

2009-01-01

This study was conducted in conjunction with a randomised controlled trial of the parenting program Stepping Stones Triple P for parents of children with Autism Spectrum Disorders. The current study concerned examination of the qualitative data arising from the RCT as well as evaluation of the particular parenting strategies that the parents found…

Using Zaltman Metaphor Elicitation Technique to Map Beneficiaries' Experiences and Values: A Case Example From the Sanitation Sector

ERIC Educational Resources Information Center

Kokko, Suvi; Lagerkvist, Carl Johan

2017-01-01

Using a case example of an innovative sanitation solution in a slum setting, this study explores the usefulness of the Zaltman Metaphor Elicitation Technique in a program planning and evaluation context. Using a qualitative image-based method to map people's mental models of ill-structured problems such as sanitation can aid program planners and…

Characteristics of Systems and Leadership in K-12 Public School Educational Technology Programs: Understanding Data Use, Decision Making, and Contextual Factors

ERIC Educational Resources Information Center

Smiley, Robert W.

2009-01-01

This qualitative, multi-case research study examines how leaders use data to inform decisions related to technology use, including how they use enGauge program evaluation data, identifies leadership practices and related contextual factors present in four K-12 public school districts. This research study examines the questions: What are the…

Using mixed methods for evaluating an integrative approach to cancer care: a case study.

PubMed

Brazier, Alison; Cooke, Karen; Moravan, Veronika

2008-03-01

To evaluate the impact of participating in an integrative cancer care program at the Centre for Integrated Healing in Vancouver, British Columbia, on patients' lifestyle, quality of life, and overall well-being. A mixed-methods case study with a pre- and posttest design. No control group was utilized. All new patients starting at the Centre for Integrated Healing between May and September of 2004 were invited to join the study. Forty-six of 77 new patients agreed to participate. Quantitative data measuring quality of life, social support, anxiety and depression, locus of control, and hope were assessed at baseline (pre-program start) and at 6 weeks and 5 months from the start of the program. Qualitative data in the form of focus groups and interviews were collected midway through the follow-up period to further explore program impacts. No statistically significant improvements or declines were noted on the quantitative measures between baseline and the 5-month follow-up point. The qualitative findings revealed a theme of patients' active engagement in their cancer care involving empowered decision making and creating personal change. Facilitators of active patient engagement in their own care from the integrative program included healing partnerships with practitioners, information and resources, managing the integration of complementary and conventional therapies, emotional support, and a sense of hope. This case study was a first attempt at documenting the impact of an integrative cancer care program at the Centre for Integrated Healing. Study limitations included a small sample size, which limited power to detect quantitative changes on the questionnaires and a lack of a control group. Qualitative findings indicated that patients found value in the "person-oriented" holistic approach to care, which encouraged patients to take an active role in decision making and self-care. The use of a mixed-methods research design proved to be an effective approach to not only evaluating outcomes but also examining process issues of the experience. Additional research is greatly needed to better understand potential impacts of integrative approaches to cancer care.

Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

PubMed

Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

2015-02-01

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

Evaluation of a community health representative program among the Cree of northern Quebec.

PubMed

Lavallée, C; James, C A; Robinson, E J

1991-01-01

The James Bay Cree Community Health Representative (CHR) program was implemented in 1984 to train persons from the Cree population of northern Quebec to act as health care advocates and educators, as intermediaries between the Cree population, health services and local organizations, and as participants in assessing health needs. A formative evaluation was initiated which included quantitative analysis of the daily tasks of CHRs and a qualitative component based on documentary research, observation and semi-structured interviews. The evaluation revealed that CHRs actively participated in the ongoing community health programs mainly through health education; the people interviewed showed a high level of satisfaction. However, direct supervision, sufficient continuing education for the CHRs and better integration into health care teams are long-term goals which need to be emphasized in the program.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

PubMed

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

A qualitative study exploring adolescents' experiences with a school-based mental health program.

PubMed

Garmy, Pernilla; Berg, Agneta; Clausson, Eva K

2015-10-21

Supporting positive mental health development in adolescents is a major public health concern worldwide. Although several school-based programs aimed at preventing depression have been launched, it is crucial to evaluate these programs and to obtain feedback from participating adolescents. This study aimed to explore adolescents' experiences with a -based cognitive-behavioral depression prevention program. Eighty-nine adolescents aged 13-15 years were divided into 12 focus groups. The focus group interviews were analyzed using qualitative content analysis. Three categories and eight subcategories were found to be related to the experience of the school-based program. The first category, intrapersonal strategies, consisted of the subcategories of directed thinking, improved self-confidence, stress management, and positive activities. The second category, interpersonal awareness, consisted of the subcategories of trusting the group and considering others. The third category, structural constraints, consisted of the subcategories of negative framing and emphasis on performance. The school-based mental health program was perceived as beneficial and meaningful on both individual and group levels, but students expressed a desire for a more health-promoting approach.

Evaluation of the Effectiveness of an Initiative to Develop Leadership among Women in Africa: A Case Study

ERIC Educational Resources Information Center

Wakahiu, Jane M.

2011-01-01

This qualitative case study assesses the impact of a three-year Hilton Foundation-supported, Sisters Leadership Development Initiative (SLDI) in five African nations. The goal was to evaluate the SLDI program for increasing leadership capacities of 340 women in Kenya, Uganda, Tanzania, Ghana and Nigeria. The purpose of this study was to determine…

Evaluation of Two CD-ROMs from a Series on Cell Biology

ERIC Educational Resources Information Center

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as…

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment.

PubMed

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment

PubMed Central

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action. PMID:28992759

A mental health first aid training program for Australian Aboriginal and Torres Strait Islander peoples: description and initial evaluation.

PubMed

Kanowski, Len G; Jorm, Anthony F; Hart, Laura M

2009-06-03

Mental Health First Aid (MHFA) training was developed in Australia to teach members of the public how to give initial help to someone developing a mental health problem or in a mental health crisis situation. However, this type of training requires adaptation for specific cultural groups in the community. This paper describes the adaptation of the program to create an Australian Aboriginal and Torres Strait Islander Mental Health First Aid (AMHFA) course and presents an initial evaluation of its uptake and acceptability. To evaluate the program, two types of data were collected: (1) quantitative data on uptake of the course (number of Instructors trained and courses subsequently run by these Instructors); (2) qualitative data on strengths, weaknesses and recommendations for the future derived from interviews with program staff and focus groups with Instructors and community participants. 199 Aboriginal people were trained as Instructors in a five day Instructor Training Course. With sufficient time following training, the majority of these Instructors subsequently ran 14-hour AMHFA courses for Aboriginal people in their community. Instructors were more likely to run courses if they had prior teaching experience and if there was post-course contact with one of the Trainers of Instructors. Analysis of qualitative data indicated that the Instructor Training Course and the AMHFA course are culturally appropriate, empowering for Aboriginal people, and provided information that was seen as highly relevant and important in assisting Aboriginal people with a mental illness. There were a number of recommendations for improvements. The AMHFA program is culturally appropriate and acceptable to Aboriginal people. Further work is needed to refine the course and to evaluate its impact on help provided to Aboriginal people with mental health problems.

Impact of the Social Café Meals program: a qualitative investigation.

PubMed

Allen, Louise; O'Connor, Jacklin; Amezdroz, Emily; Bucello, Pieta; Mitchell, Hannah; Thomas, Arabella; Kleve, Sue; Bernardi, Anthony; Wallis, Liza; Palermo, Claire

2014-01-01

Social Café Meals Programs aim to reduce food insecurity and social exclusion by providing participants access to subsidised meals in mainstream local cafés. This study aimed to explore the program's ability to address social exclusion and food insecurity and the impact of the program on the community. A qualitative evaluation approach was utilised whereby in-depth interviews were conducted with café owners, café staff and current program members of two Social Café Meals Programs operating in the south-eastern suburbs of Melbourne. Twelve program members and six café staff completed an in-depth interview at the local cafés. Data were analysed using a thematic analysis approach focusing on the lived experience of the café owners, staff and program members. Four key themes were identified. The program (i) improved food access for vulnerable groups and (ii) created community cohesiveness. (iii) The café environment was important in facilitating program use by community members. (iv) Café owners felt rewarded for their community contribution via the program. Social Café Meals Programs may provide a solution to improving food security and reducing social exclusion and may be considered as a strategy for improving nutrition and social health for at-risk and vulnerable groups.

Dual peer mentoring program for undergraduate medical students: exploring the perceptions of mentors and mentees

PubMed Central

Abdolalizadeh, Parya; Pourhassan, Saeed; Gandomkar, Roghayeh; Heidari, Farrokh; Sohrabpour, Amir Ali

2017-01-01

Background: Despite the advantages of dual peer mentoring, there are a few reports of implementing and evaluating such programs for medical students. This study aimed at exploring the perceptions of mentors and mentees about the dual peer mentoring program for the first year undergraduate medical students of Tehran University of Medical Sciences. Methods: This qualitative study was conducted at the end of the first year of implementing the mentoring program. All mentees and mentors were invited to participate in focus group discussions. Data were analyzed using a qualitative content analysis. Results: All mentors (n= 12) and a group of mentees (n= 21) participated in focus group discussion sessions. We provided a variety of supports for the mentees including academic and psychosocial support and positive relationship; as a result, some developments occurred to the mentors We also explored participants’ views on some unique aspects of the program such as student-authorized, dual mentoring, and role model sessions. Conclusion: Our participants found the mentoring program beneficial in various academic achievements and psychosocial supports for both the mentors and the mentees. Dual peer mentoring program can be an alternative to school administered programs. PMID:28638809

Dual peer mentoring program for undergraduate medical students: exploring the perceptions of mentors and mentees.

PubMed

Abdolalizadeh, Parya; Pourhassan, Saeed; Gandomkar, Roghayeh; Heidari, Farrokh; Sohrabpour, Amir Ali

2017-01-01

Background: Despite the advantages of dual peer mentoring, there are a few reports of implementing and evaluating such programs for medical students. This study aimed at exploring the perceptions of mentors and mentees about the dual peer mentoring program for the first year undergraduate medical students of Tehran University of Medical Sciences. Methods: This qualitative study was conducted at the end of the first year of implementing the mentoring program. All mentees and mentors were invited to participate in focus group discussions. Data were analyzed using a qualitative content analysis. Results: All mentors ( n= 12 ) and a group of mentees ( n= 21 ) participated in focus group discussion sessions. We provided a variety of supports for the mentees including academic and psychosocial support and positive relationship; as a result, some developments occurred to the mentors We also explored participants' views on some unique aspects of the program such as student-authorized, dual mentoring, and role model sessions. Conclusion: Our participants found the mentoring program beneficial in various academic achievements and psychosocial supports for both the mentors and the mentees. Dual peer mentoring program can be an alternative to school administered programs.

FIT: Computer Program that Interactively Determines Polynomial Equations for Data which are a Function of Two Independent Variables

NASA Technical Reports Server (NTRS)

Arbuckle, P. D.; Sliwa, S. M.; Roy, M. L.; Tiffany, S. H.

1985-01-01

A computer program for interactively developing least-squares polynomial equations to fit user-supplied data is described. The program is characterized by the ability to compute the polynomial equations of a surface fit through data that are a function of two independent variables. The program utilizes the Langley Research Center graphics packages to display polynomial equation curves and data points, facilitating a qualitative evaluation of the effectiveness of the fit. An explanation of the fundamental principles and features of the program, as well as sample input and corresponding output, are included.

Evaluating the Healthy Start program. Design development to evaluative assessment.

PubMed

Raykovich, K S; McCormick, M C; Howell, E M; Devaney, B L

1996-09-01

The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could be used to evaluate 15 diverse grantees. This article discusses the experience of creating a process and outcomes evaluation design that was both substantively and methodologically appropriate given such issues as the diversity of grantees and their community-based intervention strategies; the process of accessing secondary data sources, including vital records; the quality of client level data submissions; and the need to incorporate both qualitative and quantitative approaches into the evaluation design. The relevance of this experience for the conduct of other field studies of public health interventions is discussed.

A narrative literature review to direct spinal cord injury patient education programming.

PubMed

van Wyk, Kim; Backwell, Amber; Townson, Andrea

2015-01-01

To summarize the evidence on SCI-related education literature, while looking at potential barriers, solutions, benefits, and patient preferences regarding SCI patient education. A literature review was conducted using 5 electronic databases. Quality appraisal instruments were designed to determine the methodological rigor of the quantitative and qualitative studies found. Selected articles were read in their entirety and themes were abstracted. Fourteen articles met the inclusion criteria for this narrative literature review, all of which were based on research studies. Seven of these 14 were quantitative studies, 3 were qualitative studies, and 4 were mixed-methods studies. To improve SCI education during rehabilitation, programs should maximize the receptiveness of newly injured patients to SCI-related information, optimize the delivery of SCI education, increase the number of opportunities for learning, promote and support lifelong learning, and include patient and program evaluation. How these strategies are specifically implemented needs to be determined by program management in consultation with various stakeholders, whilst considering the unique characteristics of the rehabilitation facility.

The evolution of Rare Pride: using evaluation to drive adaptive management in a biodiversity conservation organization.

PubMed

Jenks, Brett; Vaughan, Peter W; Butler, Paul J

2010-05-01

Rare Pride is a social marketing program that stimulates human behavior change in order to promote biodiversity conservation in critically threatened regions in developing countries. A series of formal evaluation studies, networking strategies, and evaluative inquiries have driven a 20-year process of adaptive management that has resulted in extensive programmatic changes within Pride. This paper describes the types of evaluation that Rare used to drive adaptive management and the changes it caused in Pride's theory-of-change and programmatic structure. We argue that (a) qualitative data gathered from partners and staff through structured interviews is most effective at identifying problems with current programs and procedures, (b) networking with other organizations is the most effective strategy for learning of new management strategies, and (c) quantitative data gathered through surveys is effective at measuring program impact and quality. Adaptive management has allowed Rare to increase its Pride program from implementing about two campaigns per year in 2001 to more than 40 per year in 2009 while improving program quality and maintaining program impact. Copyright 2009 Elsevier Ltd. All rights reserved.

Patient and Nurse Experiences in a Rural Chronic Disease Management Program: A Qualitative Evaluation.

PubMed

Davisson, Erica A; Swanson, Elizabeth A

Rural status confounds chronic disease self-management. The purpose of this qualitative, descriptive study was to evaluate the nurse-led "Living Well" chronic disease management program reporting patient recruitment and retention issues since program initiation in 2013. The Chronic Care Model (CCM) was the guiding framework used to reinforce that interdisciplinary teams must have productive patient interactions for their program(s) to be sustainable. A rural, Midwest county clinic's chronic disease management program. Observations, interviews, and within- and across-case coding were used. Patients' responses were analyzed to identify (1) reasons for recruitment and retention problems and (2) program elements that were viewed as successful or needing improvement. A convenience sample of 6 rural, English-speaking adults (65 years or older, with no severe cognitive impairment) with at least one chronic condition was recruited and interviewed. Themes emerged related to nurse knowledge, availability, and value; peer support; overcoming barriers; adherence enhancement; and family/friends' involvement. Patients reported engagement in self-management activities because of program elements such as support groups and productive nurse-patient interactions. Interdisciplinary communication, commitment, and patient referral processes were identified as reasons for recruitment and retention issues. Findings substantiated that certain elements must be present and improved upon for future rural programs to be successful. Interdisciplinary communication may need to be improved to address recruitment and retention problems. It was clear from patient interviews that the nurse coordinators played a major role in patients' self-management adherence and overall satisfaction with the program. This is important to case management because results revealed the need for programs of this nature that incorporate the vital role of nurse coordinators and align with the CCM value of providing a supportive community health care resource for patients with chronic disease.

Qualitative evaluation of a mobile phone and web-based collaborative care intervention for patients with type 2 diabetes.

PubMed

Lyles, Courtney Rees; Harris, Lynne T; Le, Tung; Flowers, Jan; Tufano, James; Britt, Diane; Hoath, James; Hirsch, Irl B; Goldberg, Harold I; Ralston, James D

2011-05-01

Drawing on previous web-based diabetes management programs based on the Chronic Care Model, we expanded an intervention to include care management through mobile phones and a game console web browser. The pilot intervention enrolled eight diabetes patients from the University of Washington in Seattle into a collaborative care program: connecting them to a care provider specializing in diabetes, providing access to their full electronic medical record, allowing wireless glucose uploads and e-mail with providers, and connecting them to the program's web services through a game system. To evaluate the study, we conducted qualitative thematic analysis of semistructured interviews. Participants expressed frustrations with using the cell phones and the game system in their everyday lives, but liked the wireless system for collaborating with a provider on uploaded glucoses and receiving automatic feedback on their blood sugar trends. A majority of participants also expressed that their participation in the trial increased their health awareness. Mobile communication technologies showed promise within a web-based collaborative care program for type 2 diabetes. Future intervention design should focus on integrating easy-to-use applications within mobile technologies already familiar to patients and ensure the system allows for sufficient collaboration with a care provider.

76 FR 39860 - Proposed Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-07

... ``Broad Program Area Categories'' (BPACs) for purposes of conducting the research. For each evaluation... data collection methods than those prescribed for high-rigor. For example, data may be collected by... methods to produce energy savings and outcome estimates. A range of qualitative, quantitative (survey), on...

Food Safety Education Using Music Parodies

ERIC Educational Resources Information Center

Winter, Carl K.; Fraser, Angela M.; Gleason, Jeanne B.; Hovey, Susan K.; McCurdy, Sandra M.; Snider, O. Sue

2009-01-01

Musical parodies of contemporary songs with their lyrics altered to address current food safety issues were incorporated into a variety of food safety educational programs and the effectiveness of the music was evaluated by semiquantitative and qualitative measures. Audiences receiving the music-enriched curricula included school foodservice…

Programming Language CAMIL II: Implementation and Evaluation.

ERIC Educational Resources Information Center

Gardner, Edward

A reimplementation of Computer assisted/managed instruction language (CAMIL) for qualitative and quantitative improvements in the software is presented. The reformatted language is described narratively, and major components of the system software are indicated and discussed. Authoring aids and imbedded support facilities are also described, and…

Qualitative Evaluation of a Role Play Bullying Simulation.

PubMed

Gillespie, Gordon L; Brown, Kathryn; Grubb, Paula; Shay, Amy; Montoya, Karen

Bullying against nurses is becoming a pervasive problem. In this article, a role play simulation designed for undergraduate nursing students is described. In addition, the evaluation findings from a subsample of students who participated in a role play simulation addressing bullying behaviors are reported. Focus group sessions were completed with a subset of eight students who participated in the intervention. Sessions were audiorecorded, transcribed verbatim, and analyzed using Colaizzi's procedural steps for qualitative analysis. Themes derived from the data were "The Experience of Being Bullied", "Implementation of the Program", "Desired Outcome of the Program", and "Context of Bullying in the Nursing Profession". Role play simulation was an effective and active learning strategy to diffuse education on bullying in nursing practice. Bullying in nursing was identified as a problem worthy of incorporation into the undergraduate nursing curriculum. To further enhance the learning experience with role play simulation, adequate briefing instructions, opportunity to opt out of the role play, and comprehensive debriefing are essential.

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation

PubMed Central

Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-01-01

Background This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. Objective The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of “How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?” Methods The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. Results The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1) were .893 for first cycle coding and .784 for the second cycle. In the brief quantitative survey based on a scale of 1 to 5 with 5 as high, the 22 respondents rated their level of awareness of the project with a mean 3.2 (CI 3.02-3.45) and project effectiveness with a mean of 4 (CI 3.72-4.27). Conclusions This study contributes to understanding of the ACCESS AYA survivor community in central Texas and the health care professionals and advocates who aid them in their efforts to a new normal life and wellbeing in their survivorship. The results of the evaluation highlight the need to continue to build both survivor and professional resources to address the unique impact of cancer on AYA cancer survivors. PMID:28410172

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Outcomes of an International Audiology Service-Learning Study-Abroad Program.

PubMed

Krishnan, Lata A; Richards, K Andrew R; Simpson, Jennifer M

2016-03-01

The purpose of this study was to evaluate students' academic and civic learning, with particular interest in cultural competence, gained through participation in the Speech, Language, and Hearing Sciences in Zambia study-abroad program. Twelve female students participated in the program. Quantitative data collected included pre- and postprogram administration of the Public Affairs Scale (Levesque-Bristol & Cornelius-White, 2012) to measure changes in participants' civic learning. Qualitative data included journals, end-of-program reflection papers, videos, and researcher field notes. Feedback was also obtained from community-partner organizations via a questionnaire and rating scale. Comparison of the pre- and postprogram Public Affairs Scale data showed a significant increase in cultural competence and a marginal increase in community engagement at the conclusion of the program. Qualitative data showed that participants' cultural awareness was increased, they benefited from hands-on learning, and they experienced a variety of emotions and emotional and personal growth. Results show that a short-term study-abroad program with a service-learning component can be a mechanism for students to enhance academic and civic learning, specifically cultural competence and clinical skills. Sustainability of programs is a challenge that needs to be addressed.

Technical Assistance and Changes in Nutrition and Physical Activity Practices in the National Early Care and Education Learning Collaboratives Project, 2015-2016.

PubMed

Chiappone, Alethea; Smith, Teresa M; Estabrooks, Paul A; Rasmussen, Cristy Geno; Blaser, Casey; Yaroch, Amy L

2018-04-26

The National Early Care and Education Learning Collaboratives Project (ECELC) aims to improve best practices in early care and education (ECE) programs in topic areas of the Nutrition and Physical Activity Self-Assessment in Child Care (NAP SACC). Technical assistance is a component of the ECELC, yet its effect on outcomes is unclear. Beyond dose and duration of technical assistance, limited research exists on characteristics of technical assistance that contribute to outcomes. The objective of this study was to identify and describe technical assistance characteristics and explore associations with NAP SACC outcomes. We collected data from 10 collaboratives comprising 84 ECE programs in 2 states in 2015-2016. The objective of technical assistance was to support programs in improving best practices. Technical assistance was provided to programs via on-site, telephone, or email and was tailored to program needs. We used a mixed-methods design to examine associations between technical assistance and NAP SACC outcomes. We used multiple regression analysis to assess quantitative data and qualitative comparative analysis to determine necessary and sufficient technical assistance conditions supporting NAP SACC outcomes. We also conducted a document review to describe technical assistance that referred conditions identified by the qualitative comparative analysis. Regression analyses detected an inverse relationship between changes in NAP SACC scores and hours of technical assistance. No clear pattern emerged in the qualitative comparative analysis, leaving no necessary and sufficient conditions. However, the qualitative comparative analysis identified feedback as a potentially important component of technical assistance, whereas resource sharing and frequent email were characteristics that seemed to reduce the likelihood of improved outcomes. Email and resource sharing were considered primarily general information rather than tailored technical assistance. Technical assistance may be used in programs and made adaptable to program needs. The inclusion and evaluation of technical assistance, especially tailored approaches, is warranted for environmental interventions, including ECE settings.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

Curriculum Evaluation in Online Education: The Case of Teacher Candidates Preparing Online for Public Personnel Selection Examination

ERIC Educational Resources Information Center

Karacaoglu, Ömer Cem

2018-01-01

The aim of the present study is to evaluate the efficiency of an online curriculum based on the views of lecturers and students enrolled in the program. The study is mainly based on survey method. In order to collect qualitative data, interviews forms developed by the researcher were used. The reliability and validity of the interview forms were…

Partnership Among Peers: Lessons Learned From the Development of a Community Organization–Academic Research Training Program

PubMed Central

Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J.; Borawski, Elaine A.

2017-01-01

Background Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization–academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. Methods The PEER program was developed and guided by a community–academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows’ pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. Objectives The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. Conclusion PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions. PMID:28230553

Moving from rhetoric to reality: adapting Housing First for homeless individuals with mental illness from ethno-racial groups.

PubMed

Stergiopoulos, Vicky; O'Campo, Patricia; Gozdzik, Agnes; Jeyaratnam, Jeyagobi; Corneau, Simon; Sarang, Aseefa; Hwang, Stephen W

2012-10-02

The literature on interventions addressing the intersection of homelessness, mental illness and race is scant. The At Home/Chez Soi research demonstration project is a pragmatic field trial investigating a Housing First intervention for homeless individuals with mental illness in five cities across Canada. A unique focus at the Toronto site has been the development and implementation of a Housing First Ethno-Racial Intensive Case Management (HF ER-ICM) arm of the trial serving 100 homeless individuals with mental illness from ethno-racial groups. The HF ER-ICM program combines the Housing First approach with an anti-racism/anti-oppression framework of practice. This paper presents the findings of an early implementation and fidelity evaluation of the HF ER-ICM program, supplemented by participant narrative interviews to inform our understanding of the HF ER-ICM program theory. Descriptive statistics are used to describe HF ER-ICM participant characteristics. Focus group interviews, key informant interviews and fidelity assessments were conducted between November 2010 and January 2011, as part of the program implementation evaluation. In-depth qualitative interviews with HF ER-ICM participants and control group members were conducted between March 2010 and June 2011. All qualitative data were analysed using grounded theory methodology. The target population had complex health and social service needs. The HF ER-ICM program enjoyed a high degree of fidelity to principles of both anti-racism/anti-oppression practice and Housing First and comprehensively addressed the housing, health and sociocultural needs of participants. Program providers reported congruence of these philosophies of practice, and program participants valued the program and its components. Adapting Housing First with anti-racism/anti-oppression principles offers a promising approach to serving the diverse needs of homeless people from ethno-racial groups and strengthening the service systems developed to support them. The use of fidelity and implementation evaluations can be helpful in supporting successful adaptations of programs and services.

Partnership Among Peers: Lessons Learned From the Development of a Community Organization-Academic Research Training Program.

PubMed

Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J; Borawski, Elaine A

2016-01-01

Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization-academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. The PEER program was developed and guided by a community-academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows' pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions.

Delivering digital health and well-being at scale: lessons learned during the implementation of the dallas program in the United Kingdom.

PubMed

Devlin, Alison M; McGee-Lennon, Marilyn; O'Donnell, Catherine A; Bouamrane, Matt-Mouley; Agbakoba, Ruth; O'Connor, Siobhan; Grieve, Eleanor; Finch, Tracy; Wyke, Sally; Watson, Nicholas; Browne, Susan; Mair, Frances S

2016-01-01

To identify implementation lessons from the United Kingdom Delivering Assisted Living Lifestyles at Scale (dallas) program-a large-scale, national technology program that aims to deliver a broad range of digital services and products to the public to promote health and well-being. Prospective, longitudinal qualitative research study investigating implementation processes. Qualitative data collected includes semi-structured e-Health Implementation Toolkit-led interviews at baseline/mid-point (n = 38), quarterly evaluation, quarterly technical and barrier and solutions reports, observational logs, quarterly evaluation alignment interviews with project leads, observational data collected during meetings, and ethnographic data from dallas events (n > 200 distinct pieces of qualitative data). Data analysis was guided by Normalization Process Theory, a sociological theory that aids conceptualization of implementation issues in complex healthcare settings. Five key challenges were identified: 1) The challenge of establishing and maintaining large heterogeneous, multi-agency partnerships to deliver new models of healthcare; 2) The need for resilience in the face of barriers and set-backs including the backdrop of continually changing external environments; 3) The inherent tension between embracing innovative co-design and achieving delivery at pace and at scale; 4) The effects of branding and marketing issues in consumer healthcare settings; and 5) The challenge of interoperability and information governance, when commercial proprietary models are dominant. The magnitude and ambition of the dallas program provides a unique opportunity to investigate the macro level implementation challenges faced when designing and delivering digital health and wellness services at scale. Flexibility, adaptability, and resilience are key implementation facilitators when shifting to new digitally enabled models of care. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative

PubMed Central

2011-01-01

Background With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. Methods An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice. An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. Results 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. Conclusions This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care. PMID:21871132

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative.

PubMed

Pulver, Lisa K; Wai, Angela; Maxwell, David J; Robertson, Marion B; Riddell, Steven

2011-08-29

With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice.An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care.

Patient Perspectives on a Text Messaging Program to Support Asthma Management: A Qualitative Study.

PubMed

Doyle, Reina; Albright, Karen; Hurley, Laura P; Chávez, Catia; Stowell, Melanie; Dircksen, Suzanne; Havranek, Edward P; Anderson, Mark

2018-05-01

This study investigated participants' acceptance of a short messaging service (SMS) intervention designed to support asthma management, including suggestions regarding program delivery and message content. Individual and group interviews were conducted with patients from a safety-net health care system in Denver, Colorado. Eligible participants were English or Spanish speakers between the ages of 13 and 40 years, with diagnosed persistent asthma. All individual and group interviews were digitally recorded, transcribed, translated from Spanish to English (where applicable), and analyzed for thematic content by experienced analysts using established qualitative content techniques. The qualitative software package ATLAS.ti was used for data analysis and management. This study included a total of 43 participants. In general, participants were receptive toward the SMS program and supported the use of tailored and interactive messages. Adolescents supported the idea of enhancing care by sending messages to a support person, such as a parent or guardian. However, adults were less receptive toward this idea. Participants also preferred directive educational messages and cues to action, while general messages reminding them of their asthma diagnosis were viewed less favorably. The results from this study will inform a randomized control trial evaluating the efficacy of the SMS intervention.

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

PubMed

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

Jump for the Sun II: can a Monthly Program Change Girls' and Women's Attitudes about Stem?

NASA Astrophysics Data System (ADS)

Crowe, Mary

The Environmental Institute of the Jump for the Sun II program was designed to change middle school girls' and teachers' attitudes about doing science and who does science and to increase interest in science, technology, engineering, and mathematics. The institute consisted of an intensive, 2-week summer congress followed by monthly sessions during the academic year. Female-friendly learning environments were created for middle school students and in-service educators, focusing on topics such as life expectancies, solid waste production, transportation gridlock, beach erosion, and biodiversity. In both 1998 and 1999, one group of participants completed the program, which was quantitatively and qualitatively evaluated. The quantitative results showed that the program did not improve girls' attitudes in any of the major categories under study; however, the posttest results indicated that in-service educators' attitudes improved significantly in three of the four categories (science experiences, perceptions of science and scientists, and science attitudes). The qualitative results indicated that the program positively affected some of the girls and in-service educators.

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

Building capacity for change: evaluation of an organisation-wide leadership development program.

PubMed

Schultz, Tim; Shoobridge, Jodie; Harvey, Gill; Carter, Libby; Kitson, Alison

2018-05-23

Objective. This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods. A mixed methods evaluation was conducted within the program's framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between 'pre' and 'post' periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results. Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion. Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership within healthcare, the failure to manage the 'people' element and engage employees hampers the success of that change. However, how to engage employees and enhance their resilience and self-efficacy (self-belief to proactively manage) during change has been little explored. Further, the concept of a learning organisation has been developed in private, non-healthcare fields and there is little known about it in other areas, such as healthcare, particularly during change. What does this paper add? The paper describes the evaluation of a 16-week change leadership development program (Leading 4 Change) for middle managers of a public health system undergoing significant reform. It assesses how the program engaged employees, and how and to what extent their workplace resilience, self-efficacy and perceptions of their workplace as a learning organisation changed after the program. Based on the present study, individual development of staff does not necessarily translate directly to better staff perceptions of organisational outcomes. What are the implications for practitioners? Despite being clearly engaged with Leading 4 Change, quantitative and qualitative measures suggested mixed effects of the program on participants. Participants' self-rated workplace resilience, ability to manage stress and self-efficacy increased after the program. However, there was no evidence that the effect of the program improved staff perceptions of their work as a learning organisation. For complex public sector healthcare organisations to become learning organisations, other organisational factors, in addition to staff development and training, require consideration.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

76 FR 24490 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-02

... related to disability and health; (4) conducts and supports both qualitative and quantitative research to... Director for Communications and its associated research and practice. Following the title and functional... advancement of science throughout the division, supports program evaluation, and ensures that research meets...

International Field Experiences Promote Professional Development for Sustainability Leaders

ERIC Educational Resources Information Center

Hull, R. Bruce; Kimmel, Courtney; Robertson, David P.; Mortimer, Michael

2016-01-01

Purpose: This paper aims to describe, explain and evaluate a graduate education program that provides international project experiences and builds competencies related to collaborative problem-solving, cultural capacity to work globally and sustainable development. Design/methodology/approach: Qualitative analysis of survey data from 28 students…

Compromise Programming in forest management

Treesearch

Boris A. Poff; Aregai Tecle; Daniel G. Neary; Brian Geils

2010-01-01

Multi-objective decision-making (MODM) is an appropriate approach for evaluating a forest management scenario involving multiple interests. Today's land managers must accommodate commercial as well as non-commercial objectives that may be expressed quantitatively and/or qualitatively, and respond to social, political, economic and cultural changes. The spatial and...

Flight test and evaluation of Omega navigation in a general aviation aircraft. Volume 1: Technical

NASA Technical Reports Server (NTRS)

Howell, J. D.; Hoffman, W. C.; Hwoschinsky, P. V.; Wischmeyer, C. E.

1975-01-01

A low cost flight research program was conducted to evaluate the performance of differential Omega navigation in a general aviation aircraft. The flight program consisted of two distinct parts corresponding to the two major objectives of the study. The Wallops Flight Program was conducted to obtain Omega signal and phase data in the Wallops Flight Center vicinity to provide preliminary technical information and experience in preparation for a comprehensive NASA/FAA flight test program of an experimental differential Omega system. The Northeast Corridor Flight Program was conducted to examine Omega operational suitability and performance on low altitude area navigation (RNAV) routes for city-center to city-center VTOL commercial operations in the Boston-New York-Washington corridor. The development, execution and conclusions of the flight research program are discribed. The results of the study provide both quantitative and qualitative data on the Omega Navigation System under actual operating conditions.

Evaluation of the implementation of an integrated primary care network for prevention and management of cardiometabolic risk in Montréal.

PubMed

Provost, Sylvie; Pineault, Raynald; Tousignant, Pierre; Hamel, Marjolaine; Da Silva, Roxane Borgès

2011-11-10

The goal of this project is to evaluate the implementation of an integrated and interdisciplinary program for prevention and management of cardiometabolic risk (PCMR). The intervention is based on the Chronic Care Model. The study will evaluate the implementation of the PCMR in 6 of the 12 health and social services centres (CSSS) in Montréal, and the effects of the PCMR on patients and the practice of their primary care physicians up to 40 months following implementation, as well as the sustainability of the program. Objectives are: 1-to evaluate the effects of the PCMR and their persistence on patients registered in the program and the practice of their primary care physicians, by implementation site and degree of exposure to the program; 2-to assess the degree of implementation of PCMR in each CSSS territory and identify related contextual factors; 3-to establish the relationships between the effects observed, the degree of PCMR implementation and the related contextual factors; 4-to assess the impact of the PCMR on strengthening local services networks. The evaluation will use a mixed design that includes two complementary research strategies. The first strategy is similar to a quasi-experimental "before-after" design, based on a quantitative approach; it will look at the program's effects and their variations among the six territories. The effects analysis will use data from a clinical database and from questionnaires completed by participating patients and physicians. Over 3000 patients will be recruited. The second strategy corresponds to a multiple case study approach, where each of the six CSSS constitutes a case. With this strategy, qualitative methods will set out the context of implementation using data from semi-structured interviews with program managers. The quantitative data will be analyzed using linear or multilevel models complemented with an interpretive approach to qualitative data analysis. Our study will identify contextual factors associated with the effectiveness, successful implementation and sustainability of such a program. The contextual information will enable us to extrapolate our results to other contexts with similar conditions. ClinicalTrials.gov: NCT01326130.

Implementation evaluation of the Telephone Lifestyle Coaching (TLC) program: organizational factors associated with successful implementation.

PubMed

Damschroder, Laura J; Reardon, Caitlin M; Sperber, Nina; Robinson, Claire H; Fickel, Jacqueline J; Oddone, Eugene Z

2017-06-01

The Telephone Lifestyle Coaching (TLC) program provided telephone-based coaching for six lifestyle behaviors to 5321 Veterans at 24 Veterans Health Administration (VHA) medical facilities. The purpose of the study was to conduct an evaluation of the TLC program to identify factors associated with successful implementation. A mixed-methods study design was used. Quantitative measures of organizational readiness for implementation and facility complexity were used to purposively select a subset of facilities for in-depth evaluation. Context assessments were conducted using interview transcripts. The Consolidated Framework for Implementation Research (CFIR) was used to guide qualitative data collection and analysis. Factors most strongly correlated with referral rates included having a skilled implementation leader who used effective multi-component strategies to engage primary care clinicians as well as general clinic structures that supported implementation. Evaluation findings pointed to recommendations for local and national leaders to help anticipate and mitigate potential barriers to successful implementation.

Using hazard maps to identify and eliminate workplace hazards: a union-led health and safety training program.

PubMed

Anderson, Joe; Collins, Michele; Devlin, John; Renner, Paul

2012-01-01

The Institute for Sustainable Work and Environment and the Utility Workers Union of America worked with a professional evaluator to design, implement, and evaluate the results of a union-led system of safety-based hazard identification program that trained workers to use hazard maps to identify workplace hazards and target them for elimination. The evaluation documented program implementation and impact using data collected from both qualitative interviews and an on-line survey from worker trainers, plant managers, and health and safety staff. Managers and workers reported that not only were many dangerous hazards eliminated as a result of hazard mapping, some of which were long-standing, difficult-to-resolve issues, but the evaluation also documented improved communication between union members and management that both workers and managers agreed resulted in better, more sustainable hazard elimination.

Status review of NASA programs for reducing aircraft gas turbine engine emissions

NASA Technical Reports Server (NTRS)

Rudey, R. A.

1976-01-01

The paper describes and discusses the results from some of the research and development programs for reducing aircraft gas turbine engine emissions. Although the paper concentrates on NASA programs only, work supported by other U.S. government agencies and industry has provided considerable data on low emission advanced technology for aircraft gas turbine engine combustors. The results from the two major NASA technology development programs, the ECCP (Experimental Clean Combustor Program) and the PRTP (Pollution Reduction Technology Program), are presented and compared with the requirements of the 1979 U.S. EPA standards. Emission reduction techniques currently being evaluated in these programs are described along with the results and a qualitative assessment of development difficulty.

Denuded Data! Grounded Theory Using the NUDIST Computer Analysis Program: In Researching the Challenge to Teacher Self-Efficacy Posed by Students with Learning Disabilities in Australian Education.

ERIC Educational Resources Information Center

Burroughs-Lange, Sue G.; Lange, John

This paper evaluates the effects of using the NUDIST (Non-numerical, Unstructured Data Indexing, Searching and Theorising) computer program to organize coded, qualitative data. The use of the software is discussed within the context of the study for which it was used: an Australian study that aimed to develop a theoretical understanding of the…

Faculty-led faculty development: evaluation and reflections on a distributed educational leadership model.

PubMed

Elzubeir, Margaret

2011-01-01

This report describes and explores the impact of a series of faculty-led faculty development programs underpinned by principles of distributed educational leadership. We aimed to prepare faculty for their roles as facilitators and assessors in a newly implemented problem-based (PBL) graduate entry medical program. We asked participants attending a series of faculty development programs to evaluate workshops attended using an in-house designed survey. Overall descriptive statistics for all workshops and qualitative feedback for PBL workshops alone were examined. It was concluded that clinical faculty who are not specialized in medical education can offer high-quality, well-accepted training for their peers. Faculty development, underpinned by a distributed leadership approach which supports learning organization tenets, imaginative, flexible and democratic approaches to developing and nurturing expertise at all levels of the organization, is likely to lead to improvements in medical education. Despite the limitations of the survey approach to evaluation of faculty development programs, the information provided is useful both as a basis for decision making and program improvement.

Monitoring and evaluation framework for hypertension programs. A collaboration between the Pan American Health Organization and World Hypertension League.

PubMed

Campbell, Norm R C; Ordunez, Pedro; DiPette, Donald J; Giraldo, Gloria P; Angell, Sonia Y; Jaffe, Marc G; Lackland, Dan; Martinez, Ramón; Valdez, Yamilé; Maldonado Figueredo, Javier I; Paccot, Melanie; Santana, Maria J; Whelton, Paul K

2018-06-01

The Pan American Health Organization (PAHO)-World Hypertension League (WHL) Hypertension Monitoring and Evaluation Framework is summarized. Standardized indicators are provided for monitoring and evaluating national or subnational hypertension control programs. Five core indicators from the World Health Organization hearts initiative and a single PAHO-WHL core indicator are recommended to be used in all hypertension control programs. In addition, hypertension control programs are encouraged to select from 14 optional qualitative and 33 quantitative indicators to facilitate progress towards enhanced hypertension control. The intention is for hypertension programs to select quantitative indicators based on the current surveillance mechanisms that are available and what is feasible and to use the framework process indicators as a guide to program management. Programs may wish to increase or refine the number of indicators they use over time. With adaption the indicators can also be implemented at a community or clinic level. The standardized indicators are being pilot tested in Cuba, Colombia, Chile, and Barbados. ©2018 Wiley Periodicals, Inc.

Assessing healthcare professionals' experiences of integrated care: do surveys tell the full story?

PubMed

Stephenson, Matthew D; Campbell, Jared M; Lisy, Karolina; Aromataris, Edoardo C

2017-09-01

Integrated care is the combination of different healthcare services with the goal to provide comprehensive, seamless, effective and efficient patient care. Assessing the experiences of healthcare professionals (HCPs) is an important aspect when evaluating integrated care strategies. The aim of this rapid review was to investigate if quantitative surveys used to assess HCPs' experiences with integrated care capture all the aspects highlighted as being important in qualitative research, with a view to informing future survey development. The review considered all types of health professionals in primary care, and hospital and specialist services, with a specific focus on the provision of integrated care aimed at improving the patient journey. PubMed, CINAHL and grey literature sources were searched for relevant surveys/program evaluations and qualitative research studies. Full text articles deemed to be of relevance to the review were appraised for methodological quality using abridged critical appraisal instruments from the Joanna Briggs Institute. Data were extracted from included studies using standardized data extraction templates. Findings from included studies were grouped into domains based on similarity of meaning. Similarities and differences in the domains covered in quantitative surveys and those identified as being important in qualitative research were explored. A total of 37 studies (19 quantitative surveys, 14 qualitative studies and four mixed-method studies) were included in the review. A range of healthcare professions participated in the included studies, the majority being primary care providers. Common domains identified from quantitative surveys and qualitative studies included Communication, Agreement on Clear Roles and Responsibilities, Facilities, Information Systems, and Coordination of Care and Access. Qualitative research highlighted domains identified by HCPs as being relevant to their experiences with integrated care that have not routinely being surveyed, including Workload, Clear Leadership/Decision-Making, Management, Flexibility of Integrated Care Model, Engagement, Usefulness of Integrated Care and Collaboration, and Positive Impact/Clinical Benefits/Practice Level Benefits. There were several domains identified from qualitative research that are not routinely included in quantitative surveys to assess health professionals' experiences of integrated care. In addition, the qualitative findings suggest that the experiences of HCPs are often impacted by deeper aspects than those measured by existing surveys. Incorporation of targeted items within these domains in the design of surveys should enhance the capture of data that are relevant to the experiences of HCPs with integrated care, which may assist in more comprehensive evaluation and subsequent improvement of integrated care programs.

Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

PubMed

Wand, Timothy; White, Kathryn; Patching, Joanna

2011-06-01

Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

Tai Chi: moving for better balance -- development of a community-based falls prevention program.

PubMed

Li, Fuzhong; Harmer, Peter; Mack, Karin A; Sleet, David; Fisher, K John; Kohn, Melvin A; Millet, Lisa M; Xu, Junheng; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-05-01

This study was designed to develop an evidence- and community based falls prevention program -- Tai Chi: Moving for Better Balance. A mixed qualitative and quantitative approach was used to develop a package of materials for program implementation and evaluation. The developmental work was conducted in 2 communities in the Pacific Northwest. Participants included a panel of experts, senior service program managers or activity coordinators, and older adults. Outcome measures involved program feasibility and satisfaction. Through an iterative process, a program package was developed. The package contained an implementation plan and class training materials (ie, instructor's manual, videotape, and user's guidebook). Pilot testing of program materials showed that the content was appropriate for the targeted users (community-living older adults) and providers (local senior service organizations). A feasibility survey indicated interest and support from users and providers for program implementation. A 2-week pilot evaluation showed that the program implementation was feasible and evidenced good class attendance, high participant satisfaction, and interest in continuing Tai Chi. The package of materials developed in this study provides a solid foundation for larger scale implementation and evaluation of the program in community settings.

Does Professional Development School Preparation Make a Difference? A Comparison of Three Teacher Candidate Studies

ERIC Educational Resources Information Center

Castle, Sharon; Fox, Rebecca K.; Fuhrman, Caroline

2009-01-01

The article compares three replication studies that explore potential differences between teacher candidates trained in professional development schools and those trained in a traditional program. Data sources included student teaching evaluations (analyzed quantitatively) and portfolio reflections, oral and written (analyzed qualitatively). The…

What Canadian Youth Tell Us about Disclosing Abuse

ERIC Educational Resources Information Center

Ungar, Michael; Tutty, Leslie M.; McConnell, Sheri; Barter, Ken; Fairholm, Judi

2009-01-01

Objective: To report findings from a study of anonymous disclosures of abuse experiences among a national sample of youth in Canada who participated in violence prevention programming. Methods: A qualitative analysis was done of a purposeful sample of 1,099 evaluation forms completed following Red Cross RespectED violence prevention programming…

The Memory Bridge Initiative on Service Learners

ERIC Educational Resources Information Center

Wescott, Amy; Healy, Tara C.

2011-01-01

This study evaluated the Memory Bridge Initiative (MBI), an educational, experiential program pairing high school students with older adults who have dementia. A qualitative, single group design with baseline and follow-up measures examined whether or not students would have a positive learning experience while gaining newfound appreciation and…

Oral Health Promotion in Schools: Rationale and Evaluation

ERIC Educational Resources Information Center

Kizito, Alex; Caitlin, Meredith; Wang, Yili; Kasangaki, Arabat; Macnab, Andrew J.

2014-01-01

Purpose: The purpose of this paper is to explain the rationale and potential for the WHO health promoting schools (HPS) to improve children's oral health, and describe validated quantitative methodologies and qualitative approaches to measure program impact. Design/Methodology/Approach: Critical discussion of the impact of poor oral health and…

Sweaty Palms! Virtual Reality Applied to Training.

ERIC Educational Resources Information Center

Treiber, Karin

A qualitative case study approach was used to identify the psychosocial effects of the high-fidelity, virtual reality simulation provided in the college-level air traffic control (ATC) training program offered at the Minnesota Air Traffic Control Training Center and to evaluate the applicability of virtual reality to academic/training situations.…

The CUNY Fatherhood Academy: A Qualitative Evaluation. Research Report

ERIC Educational Resources Information Center

McDaniel, Marla; Simms, Margaret C.; Monson, William; de Leon, Erwin

2015-01-01

Knowing the economic challenges young fathers without postsecondary education face in providing for their families, New York City's Young Men's Initiative launched a fatherhood program housed in LaGuardia Community College in spring 2012. The CUNY Fatherhood Academy (CFA) aims to connect young fathers to academic and employment opportunities while…

The CUNY Fatherhood Academy: A Qualitative Evaluation. Executive Summary

ERIC Educational Resources Information Center

McDaniel, Marla; Simms, Margaret C.; Monson, William; de Leon, Erwin

2015-01-01

Knowing the economic challenges young fathers without postsecondary education face in providing for their families, New York City's Young Men's Initiative launched a fatherhood program housed in LaGuardia Community College in spring 2012. The CUNY Fatherhood Academy (CFA) aims to connect young fathers to academic and employment opportunities while…

Learning through Accreditation: Faculty Reflections on the Experience of Program Evaluation

ERIC Educational Resources Information Center

Garrison, Sarah; Herring, Angel; Hinton, W. Jeff

2013-01-01

This qualitative study was conducted to explore the personal and professional experiences of family and consumer sciences educators (n = 3) who recently participated in the AAFCS accreditation process utilizing the 2010 Accreditation standards. Analysis of the transcribed semi-structured interview data yielded four overarching categories: (a)…

77 FR 5797 - Draft Toxicological Review of Vanadium Pentoxide: In Support of Summary Information on the...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-06

... Office of Research and Development. EPA is releasing this draft assessment for the purposes of public... health assessment program that evaluates quantitative and qualitative risk information on effects that..., EPA provides the highest quality science- based human health assessments to support the Agency's...

Building and critiquing qualitative research websites: a cyberspace project to connect undergraduate nursing students in Canada and the United States.

PubMed

Teel, Cynthia S; Shaw, Judith A

2005-01-01

This project had a dual purpose: 1) to facilitate student learning about qualitative research methods, and 2) to promote collegiality and professional development among senior nursing students in Canada and the United States through the use of distance technology. In each of three project years, students at St. Francis Xavier University (STFX) in Nova Scotia initiated the experience by working in small groups to develop websites about different methodological approaches in qualitative research. Site information included an overview of the selected approach, discussion of trustworthiness issues, citation of journal articles in which authors used the approach, additional references, and some personal information about the student developers. Also working in small groups, University of Kansas students identified and read related research articles, reviewed website information, and responded to the STFX groups about the usefulness of site information in increasing understanding of qualitative methods and using the information for evaluation of research. The experience promoted active use of qualitative research concepts and facilitated the development of skills in evaluating research article content and website content. Participation in the activity fostered positive perceptions about the value and use of research and helped students appreciate the similarities in courses, programs, and professional requirements and values among international peers.

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

SmartMom Text Messaging for Prenatal Education: A Qualitative Focus Group Study to Explore Canadian Women’s Perceptions

PubMed Central

Munro, Sarah; Hui, Amber; Salmons, Vanessa; Solomon, Carolyn; Gemmell, Emily; Torabi, Nahal

2017-01-01

Background We engaged Canadian women in the development of a prenatal education program delivered via one-way text messaging called SmartMom. SmartMom is the first peer-reviewed, evidence-based mHealth program for prenatal education in Canada and the first to be endorsed by the Society of Obstetricians and Gynaecologists of Canada. Objective To explore women’s preferences for a prenatal education program by text messaging. Methods We conducted a qualitative focus group study in three Canadian communities in the Northern Health Authority. Women completed a demographic questionnaire, participated in a guided discussion about their pregnancy information-seeking behavior, reviewed a printed copy of the SmartMom text messages, and then engaged in a moderated discussion about their perceptions of the usability of the SmartMom program. Open-ended questions explored women’s perceptions regarding the message content, acceptability of receiving information by text message, positive health behaviors they might engage in after receiving a message, modifiable program factors, and intention to use the program. Thematic analysis of transcribed audio recordings was undertaken and modifications were made to the SmartMom program based on these findings. Results A total of 40 women participated in seven focus groups in three rural northern communities. The vast majority had a mobile phone (39/40, 98%), used text messages “all the time” (28/40, 70%), and surfed the Internet on their phone (37/40, 93%). Participants perceived SmartMom to be highly acceptable and relevant. The text message modality reflected how participants currently sought pregnancy-related information and provided them with local information tailored to their gestational age, which they had not received through other pregnancy resources. Women recommended adding the opportunity to receive supplemental streams of messages tailored to their individual needs, for example, depression, pregnancy after previous cesarean, >35 years of age, new immigrants, and harm reduction for smoking and alcohol. Conclusions This formative qualitative evaluation provides evidence that a prenatal education program by text messaging, SmartMom, is acceptable to the end users. These findings support the usability of the SmartMom program at a population level and the development of an evaluation program exploring the effects of the text messages on adoption of health-promoting behaviors and maternal-child health outcomes. PMID:28174149

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

PubMed

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Examining occupational therapy education through faculty engagement in curriculum mapping and pedagogical reflection.

PubMed

MacNeil, Cheryl; Hand, Theresa

2014-01-01

This article discusses a 1-yr evaluation study of a master of science in occupational therapy program to examine curriculum content and pedagogical practices as a way to gauge program preparedness to move to a clinical doctorate. Faculty members participated in a multitiered qualitative study that included curriculum mapping, semistructured individual interviewing, and iterative group analysis. Findings indicate that curriculum mapping and authentic dialogue helped the program formulate a more streamlined and integrated curriculum with increased faculty collaboration. Curriculum mapping and collaborative pedagogical reflection are valuable evaluation strategies for examining preparedness to offer a clinical doctorate, enhancing a self-study process, and providing information for ongoing formative curriculum review. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Almost Psychiatry: The Impact of Teaching Child and Adolescent Mental Health Studies to Undergraduate College Students.

PubMed

Diamond, Ursula; Di Bartolo, Christina A; Badin, Emily; Shatkin, Jess P

2017-10-01

The Child and Adolescent Mental Health Studies (CAMS) program is housed in a Liberal Arts undergraduate college of a large research university. Psychiatrists, clinical psychologists, and social workers at the university's medical center teach the courses. The purpose of this study is to evaluate the extent to which CAMS encourages graduates of the program to pursue a career in child and adolescent mental health (CAMH). In 2015-2016, graduates of the CAMS program were invited to participate in a mixed methods study. In addition to statistical analyses, qualitative thematic analyses were performed to interpret free-text responses. Forty-five percent (314/702) of invited graduates completed the online survey. Interviews were conducted with 11% (34/314) of participants by study staff over the phone. Quantitative results suggested that 81% (149/185) of participants enrolled in educational programs after graduation due to an interest in CAMH. A significantly higher proportion of the total sample (t = 3.661, p < .001) reported that they changed their career goals while undergraduate students compared to those who did so after graduation. Results of qualitative interviews with 34 participants uncovered five key themes unique to CAMS that may explain the program's influence on graduates' career choices and career development: practitioners-as-instructors, instructor mentorship, novel course content, experiential learning opportunities, and career training and skills. Quantitative and qualitative results indicated that teaching college undergraduate students about CAMH encourages them to set career goals within the field. These findings suggest the utility of implementing similar programs at other undergraduate colleges.

Student Experiments on the Effects of Dam Removal on the Elwha River

NASA Astrophysics Data System (ADS)

Sandland, T. O.; Grack Nelson, A. L.

2006-12-01

The National Center for Earth Surface Dynamics (NCED) is an NSF funded Science and Technology Center devoted to developing a quantitative, predictive science of the ecological and physical processes that define and shape rivers and river networks. The Science Museum of Minnesota's (SMM) Earthscapes River Restoration classes provide k-12 students, teachers, and the public opportunities to explore NCED concepts and, like NCED scientists, move from a qualitative to a quantitative-based understanding of river systems. During a series of classes, students work with an experimental model of the Elwha River in Washington State to gain an understanding of the processes that define and shape river systems. Currently, two large dams on the Elwha are scheduled for removal to restore salmon habitat. Students design different dam removal scenarios to test and make qualitative observations describing and comparing how the modeled system evolves over time. In a following session, after discussing the ambiguity of the previous session's qualitative data, student research teams conduct a quantitative experiment to collect detailed measurements of the system. Finally, students interpret, critique, and compare the data the groups collected and ultimately develop and advocate a recommendation for the "ideal" dam removal scenario. SMM is currently conducting a formative evaluation of River Restoration classes to improve their educational effectiveness and guide development of an educator's manual. As of August 2006, pre- and post-surveys have been administered to 167 students to gauge student learning and engagement. The surveys have found the program successful in teaching students why scientists use river models and what processes and phenomena are at work in river systems. Most notable is the increase in student awareness of sediment in river systems. A post-visit survey was also administered to 20 teachers who used the models in their classrooms. This survey provided feedback about teachers' experience with the program and will help inform the development of a future educator's manual. All teachers found the program to be effective at providing opportunities for students to make qualitative observations and most (95%) found the program effective at providing students opportunities to make quantitative measurements. A full summary of evaluation results will be shared at the meeting.

The ambiguities of performance-based governance reforms in Italy: Reviving the fortunes of evaluation and performance measurement.

PubMed

Marra, Mita

2018-08-01

Over the past two decades, Italy's administrative reforms have institutionalized evaluation to improve program effectiveness, staff productivity, and results-driven accountability against waste and corruption. Across ministries, regional governments, universities, schools and environmental protection agencies, seemingly unexpected consequences have emerged out of the implementation of performance measurement and evaluation regimes within public organizations. Formal compliance to legally binding evaluation procedures, judicially-sanctioned managerial accountability and lack of cross-agency coordination coupled with long-standing cultural separations among evaluators are some of the ambiguities associated with a performance-based governance system within Italian public administration. Building upon the 'new governane theory,' and qualitative fieldwork, I explore the political consequences of evaluation and performance measurement for possible improvements. From a normative perspective, greater integration between program evaluation and performance measurement can support organizational learning and democratic accountability both at the central and local level. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Qualitative Evaluation of Student Learning and Skills Use in a School-Based Mindfulness and Yoga Program

PubMed Central

Mirabal-Beltran, Roxanne; Cluxton-Keller, Fallon; Gould, Laura Feagans; Greenberg, Mark T.; Mendelson, Tamar

2016-01-01

Previous studies on school-based mindfulness and yoga programs have focused primarily on quantitative measurement of program outcomes. This study used qualitative data to investigate program content and skills that students remembered and applied in their daily lives. Data were gathered following a 16-week mindfulness and yoga intervention delivered at three urban schools by a community non-profit organization. We conducted focus groups and interviews with nine classroom teachers who did not participate in the program and held six focus groups with 22 fifth and sixth grade program participants. This study addresses two primary research questions: (1) What skills did students learn, retain, and utilize outside the program? and (2) What changes did classroom teachers expect and observe among program recipients? Four major themes related to skill learning and application emerged as follows: (1) youths retained and utilized program skills involving breath work and poses; (2) knowledge about health benefits of these techniques promoted self-utilization and sharing of skills; (3) youths developed keener emotional appraisal that, coupled with new and improved emotional regulation skills, helped de-escalate negative emotions, promote calm, and reduce stress; and (4) youths and teachers reported realistic and optimistic expectations for future impact of acquired program skills. We discuss implications of these findings for guiding future research and practice. PMID:26918064

Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence.

PubMed

Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily

2017-10-01

Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.

Alumni Perspectives on Career Preparation during a Postdoctoral Training Program: A Qualitative Study

PubMed Central

Faupel-Badger, Jessica M.; Raue, Kimberley; Nelson, David E.; Tsakraklides, Sophia

2015-01-01

Published evaluations of career preparation of alumni from long-standing postdoctoral fellowship programs in the biomedical sciences are limited and often focus on quantitative analysis of data from extant publicly available sources. Qualitative methods provide the opportunity to gather robust information about specific program elements from structured postdoctoral training programs and the influence of this training on subsequent career paths of alumni. In-depth interviews with a subset of the National Cancer Institute’s Cancer Prevention Fellowship Program (CPFP) alumni (n = 27), representing more than 25 years of the program’s history and multiple career sectors, were conducted to assess alumni reflections on the training environment and career preparation during their time in the CPFP. NVivo software was used to analyze data and identify major themes. Four main themes emerged from these interviews, including: the value of structured training curriculum, mentorship, transdisciplinary environment, and professional identity. Even when reflecting on training that occurred one to two decades earlier, alumni were able to highlight specific components of a structured postdoctoral training program as influencing their research and career trajectories. These results may have relevance for those interested in assessing how postdoctoral training can influence fellows throughout their careers and understanding salient features of structured programs. PMID:25673353

Features of a Health-Oriented Education Program during Daily Commutes: A Qualitative Study.

PubMed

Ramezankhani, Ali; Heydarabadi, Akbar Babaei; Ghaffari, Mohtasham; Mehrabi, Yadollah; Kazemi, Sadegh

2016-06-01

Today, despite scientific advances, many people spend more time and distance between home and their workplaces because of various economic and population reasons. The aim of this study was to identify features of an appropriate health education program during commutes for factory staff at Ardakan county (Yazd province, Iran). This qualitative study was conducted via the phenomenological method in 2014. The population of this study was members of the staff of Ardakan Steel Company. Nineteen specialists and 11 members of the factory's staff were invited to participate in the study, and data were collected using semi-structured interviews. The interviews took 20 to 40 minutes, and their content was analyzed using content analysis. Extraction of codes and themes and their placement in this study showed that an educational program during commutes should have nine features to have the desired effectiveness, i.e., the program must be audience-oriented, repeatable, participatory, technology-based, combinational, supportive, and motivational and interesting. Also, the program should have environmental and organizational support, and it must be evaluated for its effectiveness. Considering appropriate features of a health education program in educational situations, especially interventions related to daily commutes, is very important because the effectiveness of such health-oriented educational programs must be ensured.

Using learning theory, interprofessional facilitation competencies, and behavioral indicators to evaluate facilitator training.

PubMed

LeGros, Theresa A; Amerongen, Helen M; Cooley, Janet H; Schloss, Ernest P

2015-01-01

Despite the increasing need for faculty and preceptors skilled in interprofessional facilitation (IPF), the relative novelty of the field poses a challenge to the development and evaluation of IPF programs. We use learning theory and IPF competencies with associated behavioral indicators to develop and evaluate six key messages in IPF training and experience. Our mixed methods approach included two phases: quantitative data collection with embedded qualitative data, followed by qualitative data collection in explanatory sequential fashion. This enabled triangulated analyses of both data types and of facilitation behaviors from facilitator and student perspectives. Results indicate the competency-based training was effective. Facilitators felt comfortable performing behaviors associated with IPF competencies; student observations of those behaviors supported facilitator self-reported performance. Overall, students perceived more facilitation opportunities than facilitators. Findings corroborate the importance of recruiting seasoned facilitators and establishing IPF guidelines that acknowledge variable team dynamics and help facilitators recognize teachable moments.

Organizational and training factors that promote team science: A qualitative analysis and application of theory to the National Institutes of Health's BIRCWH career development program.

PubMed

Guise, Jeanne-Marie; Winter, Susan; Fiore, Stephen M; Regensteiner, Judith G; Nagel, Joan

2017-04-01

Research organizations face challenges in creating infrastructures that cultivates and sustains interdisciplinary team science. The objective of this paper is to identify structural elements of organizations and training that promote team science. We qualitatively analyzed the National Institutes of Health's Building Interdisciplinary Research Careers in Women's Health, K12 using organizational psychology and team science theories to identify organizational design factors for successful team science and training. Seven key design elements support team science: (1) semiformal meta-organizational structure, (2) shared context and goals, (3) formal evaluation processes, (4) meetings to promote communication, (5) role clarity in mentoring, (6) building interpersonal competencies among faculty and trainees, and (7) designing promotion and tenure and other organizational processes to support interdisciplinary team science. This application of theory to a long-standing and successful program provides important foundational elements for programs and institutions to consider in promoting team science.

Implementation of a Complex Intervention to Support Leadership Development in Nursing Homes: A Multimethod Participatory Study.

PubMed

Dewar, Belinda; Barrie, Karen; Sharp, Cathy; Meyer, Julienne

2017-04-01

Leadership is key to quality improvement in nursing homes. This article reports on the initial analysis of the transformational My Home Life Leadership Support program for nursing home managers being implemented in Scotland. It analyses learning from a multimethod participatory descriptive study. Contribution analysis theory informed the evaluation. Evidence-Based Practice, Relationship-Centered Care, Appreciative Inquiry, and Caring Conversations informed the intervention to develop transformational leadership. Data generation methods included baseline and postintervention questionnaires to describe culture change within the study population, together with more in-depth qualitative data generated from group discussions throughout the leadership support program. Qualitative data analysis was an iterative collaborative process with participants to generate themes about the impact of the program on themselves and their practice. Data showed positive changes in managers' perceptions of their self-awareness, leadership communication and relationship skills, and development of positive cultures. This model offers lessons for those interested in ways to approach the emotional, educational, and cultural dynamics of change in other human service contexts.

Assessment of the Sustainability Capacity of a Coordinated Approach to Chronic Disease Prevention.

PubMed

Moreland-Russell, Sarah; Combs, Todd; Polk, LaShaun; Dexter, Sarah

This article outlines some factors that influenced the sustainability capacity of a coordinated approach to chronic disease prevention in state and territory health departments. This study involved a cross-sectional design and mixed-methods approach. Quantitative data were collected using the Program Sustainability Assessment Tool (PSAT), a 40-item multiple-choice instrument that assesses 8 domains of sustainability capacity (environmental support, funding stability, partnerships, organizational capacity, program evaluation, program adaptation, communications, and strategic planning). Qualitative data were collected via phone interviews. The PSAT was administered to staff and stakeholders from public health departments in 50 US states, District of Columbia, and Puerto Rico, who were involved in the implementation of coordinated chronic disease programs. Phone interviews were conducted with program coordinators in each state. Sustainability score patterns and state-level categorical results, as well as strengths and opportunities for improvement across the 8 program sustainability domains, were explored. On average, programs reported the strongest sustainability capacity in the domains of program adaptation, environmental support, and organizational capacity, while funding stability, strategic planning, and communications yielded lowest scores, indicating weakest capacity. Scores varied the most by state in environmental support and strategic planning. The PSAT results highlight the process through which states approached the sustainability of coordinated chronic disease initiatives. This process included an initial focus on program evaluation and partnerships with transfer of priority to long-term strategic planning, communications, and funding stability to further establish coordinated chronic disease efforts. Qualitative interviews provided further context to PSAT results, indicating that leadership, communications, partnerships, funding stability, and policy change were perceived as keys to success of the transition. Integrating these findings into future efforts may help those in transition establish greater sustainability capacity. The PSAT results and interviews provide insight into the capacity for sustainability for programs transitioning from traditional siloed programs to coordinated chronic disease programs.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic.

PubMed

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B

2018-03-01

The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

PubMed Central

2017-01-01

Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). Conclusions This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. PMID:28292738

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation.

PubMed

Vollmer Dahlke, Deborah; Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-02-10

This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of "How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?" The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1) were .893 for first cycle coding and .784 for the second cycle. In the brief quantitative survey based on a scale of 1 to 5 with 5 as high, the 22 respondents rated their level of awareness of the project with a mean 3.2 (CI 3.02-3.45) and project effectiveness with a mean of 4 (CI 3.72-4.27). This study contributes to understanding of the ACCESS AYA survivor community in central Texas and the health care professionals and advocates who aid them in their efforts to a new normal life and wellbeing in their survivorship. The results of the evaluation highlight the need to continue to build both survivor and professional resources to address the unique impact of cancer on AYA cancer survivors. ©Deborah Vollmer Dahlke, Kayla Fair, Yan Alicia Hong, Debra Kellstedt, Marcia G Ory. Originally published in JMIR Cancer (http://cancer.jmir.org), 10.02.2017.

Emerging Thought and Research on Student, Teacher, and Administrator Stress and Coping. Research on Stress and Coping in Education

ERIC Educational Resources Information Center

Gates, Gordon S., Ed.; Wolverton, Mimi, Ed.; Gmelch, Walter H., Ed.

2007-01-01

This collection of chapters presents research focused on emerging strategies, paradigms, and theories on the sources, experiences, and consequences of stress, coping, and prevention pertaining to students, teachers and administrators. Studies analyze data collected through action research, program evaluation, surveys, qualitative interviewing,…

Educational Game Design as Gateway for Operationalizing Computational Thinking Skills among Middle School Students

ERIC Educational Resources Information Center

Wu, Min Lun

2018-01-01

This qualitative case study reports descriptive findings of digital game-based learning involving 15 Taiwanese middle school students' use of computational thinking skills elicited through programmed activities in a game design workshop. Situated learning theory is utilized as framework to evaluate novice game designers' individual advancement in…

78 FR 61364 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-03

... order to gather qualitative information for analysis, the evaluation team will use semi-structured... are developing a new suite of systems to support the End Stage Renal Disease (ESRD) program. Due to... personnel have access to data. Personnel are given access to the ESRD systems through the creation of user...

Sewing for a Cause: Implementing and Evaluating Service-Learning in a Clothing Construction Course

ERIC Educational Resources Information Center

Freeman, Charles; Kobia, Caroline

2016-01-01

The purpose of this exploratory investigation is to examine the use of a pedagogical framework to guide the development of a successful service-learning project within a technical program (clothing construction) as determined by increased student engagement and qualitative feedback. This investigation uses student reflection comparisons to assess…

Bringing Digital Storytelling to the Elementary Classroom: Video Production for Preservice Teachers

ERIC Educational Resources Information Center

Shelton, Catharyn C.; Archambault, Leanna M.; Hale, Annie E.

2017-01-01

This study presents and evaluates a 7-week learning experience embedded in a required content-area course in a teacher preparation program, in which 31 preservice elementary teachers produced digital storytelling videos and considered how this approach may apply to their future classrooms. Qualitative and quantitative data from preservice…

Identifying the Potential Organizational Impact of an Educational Peer Review Program

ERIC Educational Resources Information Center

Toth, Kate E.; McKey, Colleen A.

2010-01-01

The literature on educational peer review (EPR) has focused on evaluating EPR's impact on faculty and/or student learning outcomes; no literature exists on the potential organizational impact. A qualitative (case study) research design explored perceptions of 17 faculty and 10 administrators within a school of nursing in an Ontario university…

An Evaluation of Management Training and Coaching

ERIC Educational Resources Information Center

Berg, Morten Emil; Karlsen, Jan Terje

2012-01-01

Purpose: The focus of this paper is on management training and development. The purpose has been to address how coaching can be applied to learn about leadership tools and what effect this has on management behaviour and development. Design/methodology/approach: This is a qualitative case study of a management development program. The empirical…

School-Based Health Promotion Intervention: Parent and School Staff Perspectives

ERIC Educational Resources Information Center

Patino-Fernandez, Anna M.; Hernandez, Jennifer; Villa, Manuela; Delamater, Alan

2013-01-01

Background: The prevalence of childhood obesity is high, particularly among minority youth. The objective of this article was to evaluate parent and school staff perspectives of childhood health and weight qualitatively to guide the development of a school-based obesity prevention program for minority youth. Methods: Hispanic parents (N?=?9) of…

A Preliminary Qualitative Evaluation of the Virginia Gold Quality Improvement Program

ERIC Educational Resources Information Center

Craver, Gerald A.; Burkett, Amy K.

2012-01-01

Certified nursing assistants (CNAs) perform an important role in the long-term care system because they provide the majority of paid care to nursing facility residents. Unfortunately, annual CNA turnover often exceeds 100 percent nationally. Many factors account for this, including stressful working conditions, low pay, and limited benefits. The…

ESTE Project Brief: Environmental and Sustainable Technology Evaluations (ESTE): Verification of Qualitative Spot Test Kits for Lead in Paint

EPA Science Inventory

On April 22, 2008, EPA issued the final Lead; Renovation, Repair, and Painting (RRP) Program Rule. The rule addresses lead-based paint hazards created by renovation, repair, and painting activities that disturb lead-based paint in target housing and child-occupied facilities. Und...

A Model for Competency Assessment of the Faculty in Islamic Azad University

ERIC Educational Resources Information Center

Mashinchi, Aliasghar; Hashemi, Seyed Ahmad; Khani, Kamran Mohammad

2017-01-01

Today country success in economic, social, political, cultural tendencies etc. … is approved to be the hostages and pawns of coherent and dynamic didactic system. The education and didactic programs for qualification improvement and dynamism need to quantitatively and qualitatively evaluation and scrutiny. Current study started with the goal of…

Enhancing Palpation Skills through the Use of Stereognosis Drills

ERIC Educational Resources Information Center

Lawrance, Scott E.; Voll, Craig A.; Jochum, Jessica Emlich

2016-01-01

Context: Musculoskeletal palpation is taught in our athletic training programs as part of the injury evaluation process. However, as palpation skills are taught, the focus is oftentimes on accuracy of surface-anatomy landmarks instead of the ability to discriminate qualitative information such as tissue tone, spasm, or pain response from the soft…

Exercise and Quality of Life in Women with Multiple Sclerosis

ERIC Educational Resources Information Center

Giacobbi, Peter R., Jr.; Dietrich, Frederick; Larson, Rebecca; White, Lesley J.

2012-01-01

The purpose of this study was to evaluate perceptions of quality of life after a 4-month progressive resistance training program for individuals with multiple sclerosis (MS). A second purpose was to examine participants' views about factors that facilitated or impeded exercise behavior. Qualitative interviews were conducted with eight females…

Examination of a Successful and Active Science Club: A Case Study

ERIC Educational Resources Information Center

Behrendt, Marc

2017-01-01

This qualitative evaluative study explores the views of two science club advisor/educators of an active 122-member rural high school science club program that is thriving in spite of increasingly busy student schedules, decreasing school budgets, and a demanding standardized curriculum. It is essential to understand the teacher-advisors'…

Fellows' Perceptions of a Mandatory Reflective Electronic Portfolio in a Geriatric Medicine Fellowship Program

ERIC Educational Resources Information Center

Ruiz, Jorge G.; Qadri, Syeda S.; Karides, Marina; Castillo, Carmen; Milanez, Marcos; Roos, Bernard A.

2009-01-01

Electronic portfolios (ePortfolios) can be useful for evaluating and documenting mastery of competencies. We investigated geriatric medicine fellows' perceptions of an ePortfolio. We conducted surveys and focus groups followed by quantitative and qualitative data analysis. Our study revealed that fellows considered the ePortfolio acceptable and…

34 CFR 263.6 - How does the Secretary evaluate applications for the Professional Development program?

Code of Federal Regulations, 2011 CFR

2011-07-01

... research and effective practices on how to improve teaching and learning to support student proficiency in...-based research and effective practice; (2) The extent to which the training or professional development... will produce both quantitative and qualitative data to the extent possible. (Approved by the Office of...

34 CFR 263.6 - How does the Secretary evaluate applications for the Professional Development program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... research and effective practices on how to improve teaching and learning to support student proficiency in...-based research and effective practice; (2) The extent to which the training or professional development... will produce both quantitative and qualitative data to the extent possible. (Approved by the Office of...

34 CFR 263.6 - How does the Secretary evaluate applications for the Professional Development program?

Code of Federal Regulations, 2014 CFR

2014-07-01

... research and effective practices on how to improve teaching and learning to support student proficiency in...-based research and effective practice; (2) The extent to which the training or professional development... will produce both quantitative and qualitative data to the extent possible. (Approved by the Office of...

34 CFR 263.6 - How does the Secretary evaluate applications for the Professional Development program?

Code of Federal Regulations, 2012 CFR

2012-07-01

... research and effective practices on how to improve teaching and learning to support student proficiency in...-based research and effective practice; (2) The extent to which the training or professional development... will produce both quantitative and qualitative data to the extent possible. (Approved by the Office of...

34 CFR 263.6 - How does the Secretary evaluate applications for the Professional Development program?

Code of Federal Regulations, 2013 CFR

2013-07-01

... research and effective practices on how to improve teaching and learning to support student proficiency in...-based research and effective practice; (2) The extent to which the training or professional development... will produce both quantitative and qualitative data to the extent possible. (Approved by the Office of...

Reflective Practice: Using Focus Groups to Determine Family Priorities and Guide Social Pragmatic Program Development

ERIC Educational Resources Information Center

Theadore, Geraldine; Laurent, Amy; Kovarsky, Dana; Weiss, Amy L.

2011-01-01

Reflective practice requires that professionals carefully examine and integrate multiple sources of information when designing intervention and evaluating its effectiveness. This article describes the use of focus group discussion as a form of qualitative research for understanding parents' perspectives of a university-based intervention program…

77 FR 7576 - Draft Toxicological Review of 1,4-Dioxane: In Support of Summary Information on the Integrated...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-13

... Center for Environmental Assessment (NCEA) within the EPA Office of Research and Development. EPA is... Research and Development, Research Triangle Park, NC 27711; telephone: (919) 541- 1964; facsimile: (919... EPA's IRIS is a human health assessment program that evaluates quantitative and qualitative risk...

75 FR 7477 - Draft Toxicological Review of Inorganic Arsenic: In Support of the Summary Information on the...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-19

... Environmental Assessment (NCEA) within the EPA's Office of Research and Development (ORD). The Toxicological Review of Inorganic Arsenic was submitted to the EPA's Science Advisory Board (SAB) for external peer... IRIS IRIS is a human health assessment program that evaluates quantitative and qualitative risk...

An Effective Model for Improving Global Health Nursing Competence.

PubMed

Kang, Sun-Joo

2016-01-01

This paper proposed an effective model for improving global health nursing competence among undergraduate students. A descriptive case study was conducted by evaluation of four implemented programs by the author. All programs were conducted with students majoring in nursing and healthcare, where the researcher was a program director, professor, or facilitator. These programs were analyzed in terms of students' needs assessment, program design, and implementation and evaluation factors. The concept and composition of global nursing competence, identified within previous studies, were deemed appropriate in all of our programs. Program composition varied from curricular to extracurricular domains. During the implementation phase, some of the programs included non-Korean students to improve cultural diversity and overcome language barriers. Qualitative and quantitative surveys were conducted to assess program efficacy. Data triangulation from students' reflective journals was examined. Additionally, students' awareness regarding changes within global health nursing, improved critical thinking, cultural understanding, and global leadership skills were investigated pre- and post-program implementation. The importance of identifying students' needs regarding global nursing competence when developing appropriate curricula is discussed.

Evaluating Practice-Based Learning.

PubMed

Logue, Nancy C

2017-03-01

Practice-based learning is an essential aspect of nursing education, and evaluating this form of learning is vital in determining whether students have the competence required to enter nursing practice. However, limited knowledge exists about the influences that shape how competence development is recognized in nursing programs. The purpose of this study was to explore the evaluation of practice-based learning from the students' standpoint. A qualitative design based on institutional ethnography was used to investigate evaluation of practice-based learning with students, preceptors, and faculty in a preceptorship practicum. The findings revealed how work associated with evaluation was organized by coexisting and often disparate influences within a nursing program and the workplaces where learning took place. The implications and recommendations of the inquiry are intended to encourage dialogue and action among stakeholders from education and practice to improve evaluation practices in preparing new members of the nursing profession. [J Nurs Educ. 2017;56(3):131-138.]. Copyright 2017, SLACK Incorporated.

Senior Medical Student Mock Interview Program in Pediatrics.

PubMed

Multerer, Sara; Carothers, Becky; Patel, Pradip D; Ziegler, Craig; Rowland, Michael; Davis, Deborah Winders

2016-02-01

Residency interviews play an integral part in medical residency placement. We aimed to develop and evaluate a mock interview program for fourth-year medical students interested in a pediatric specialty. A mock interview program for fourth-year medical students interested in pediatrics was developed and implemented. Preinterview quantitative data and postinterview qualitative data were collected. Fifty-nine students completed the program across three consecutive academic years. Preinterview surveys were completed regarding comfort and confidence levels specific to aspects of the interview process. Descriptive analyses were used. In addition, a focus group was held with nine of the participating students to obtain qualitative data via a paper blog process. Themes in student responses were identified through constant comparative analysis. Before the mock interview, students were most uncomfortable with introductory and closing remarks and their confidence levels varied by topic. A thematic analysis of focus group data identified five themes (preparation, stress reduction, interview process familiarity, confidence of skills, and receiving feedback) for which the mock interviews were most helpful. Implementation of a mock interview program was feasible and acceptable for senior medical students and may improve comfort and confidence levels in the residency interview process. Further longitudinal research is needed.

Challenges in the rural family doctor system in Iran in 2013-14: a qualitative approach.

PubMed

Nejatzadegan, Zohreh; Ebrahimipour, Hossien; Hooshmand, Elaheh; Tabatabaee, Seyed Saeed; Esmaili, Habibollah; vafaeeNajar, Ali

2016-08-01

Family doctor is a medical specialization that provides families and people of all ages, genders and diseases with comprehensive ongoing health services. The present study wasconducted to describe challenges in the rural family physician program from the perspective of family physician program directors and family doctors in Iran using a qualitative approach. We conducted interviews with 13 family physician program directors and 8 family doctors selected through purposive snowball sampling. The initial in-depth unstructured interviews were reviewed and transformed into semi-structured ones. The data obtained were analyzed in ATLAS.ti using the conceptual framework method. Nine main concepts (comprehensive planning, medical insurance system, compensation for services, performance evaluation, welfare facilities, recruiting and retaining a workforce, information system, culture-building and financing) and 27 subgroups emerged from the analysis of the data. The main challenges in the family physician program include cultural, economic and environmental factors and work conditions. The implementation of this program can be improved through building a community culture and exercising minor and major modifications. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Assessment of cultural competence in Texas nursing faculty.

PubMed

Marzilli, Collen

2016-10-01

Cultural competence [CC] is an essential component of nursing education and nursing practice yet there is a gap in the research evaluating CC in faculty and how to practically develop this skillset for faculty members. To explore CC in faculty as evaluated with the Nurses' Cultural Competence Scale [NCCS] and apply the findings to the Purnell Model of Cultural Competence [PMCC] to guide professional development opportunities for faculty members. This was a concurrent mixed-methods study. Faculty members teaching in Texas nursing programs were recruited for the study. Quantitative data was collected using an online survey tool and qualitative data was collected over the phone. 89 Texas faculty members completed the quantitative strand and a subset of 10 faculty members completed the qualitative strand. Descriptive statistics were used to examine the quantitative data and Strauss and Corbin's methodology guided the evaluation of the qualitative data. These two strands were used to support the results. Faculty in Texas are moderately culturally competent. The qualitative findings support the application of the PMCC to the areas identified by the NCCS. The PMCC may be applied to the application of culture and values in nursing professional education as supported by the NCCS. Recommendations are to include the PMCC as a structure for the creation of professional development opportunities for faculty. Copyright © 2016 Elsevier Ltd. All rights reserved.

Considering Student Voices: Examining the Experiences of Underrepresented Students in Intervention Programs

PubMed Central

Gibau, Gina Sanchez

2015-01-01

Qualitative studies that examine the experiences of underrepresented minority students in science, technology, engineering, and mathematics fields are comparatively few. This study explores the self-reported experiences of underrepresented graduate students in the biomedical sciences of a large, midwestern, urban university. Document analysis of interview transcripts from program evaluations capture firsthand accounts of student experiences and reveal the need for a critical examination of current intervention programs designed to reverse the trend of underrepresentation in the biomedical sciences. Findings point to themes aligned around the benefits and challenges of program components, issues of social adjustment, the utility of supportive relationships, and environmental impacts. PMID:26163562

Evaluation of a pilot promotora program for Latino forest workers in southern Oregon.

PubMed

Bush, Diane E; Wilmsen, Carl; Sasaki, Timothy; Barton-Antonio, Dinorah; Steege, Andrea L; Chang, Charlotte

2014-07-01

Forest work, an occupation with some of the highest injury and illness rates, is conducted primarily by Latino immigrant workers. This study evaluates a pilot program where promotoras (lay community health educators) provided occupational health and safety trainings for Latino forest workers. Evaluation methods included a focus group, post-tests, and qualitative feedback. Community capacity to address working conditions increased through (i) increased leadership and community access to information and resources; and (ii) increased worker awareness of workplace health and safety rights and resources. Fear of retaliation remains a barrier to workers taking action; nevertheless, the promotoras supported several workers in addressing-specific workplace issues. For working conditions to significantly improve, major structural influences need to be addressed. A long-term, organizationally supported promotora program can play a key role in linking and supporting change at the individual, interpersonal and community levels, contributing to and supporting structural change. © 2014 Wiley Periodicals, Inc.

A longitudinal medical Spanish program at one US medical school.

PubMed

Reuland, Daniel S; Frasier, Pamela Y; Slatt, Lisa M; Alemán, Marco A

2008-07-01

Policymakers have recommended recruiting or training (or both) more US physicians who can provide care in Spanish. Few longitudinal medical Spanish programs have been described and evaluated. This study aims to describe development and evaluation of the preclinical phase of a 4-y program designed to graduate physicians who can provide language-concordant care in Spanish. Study was done in one public medical school in southeastern USA. The program targeted intermediate/advanced Spanish speakers. Standardized fluency assessments were used to determine eligibility and evaluate participants' progress. Curriculum included didactic coursework, simulated patients, socio-cultural seminars, clinical skills rotations at sites serving Latinos, service-learning, and international immersion. For the first two cohorts (n = 45) qualitative evaluation identified program improvement opportunities and found participants believed the program helped them maintain their Spanish skills. Mean interim (2-y) speaking proficiency scores were unchanged from baseline: 9.0 versus 8.7 at baseline on 12-point scale (p = 0.15). Mean interim listening comprehension scores (second cohort only, n = 25) increased from a baseline of 77 to 86% (p = 0.003). Proportions "passing" the listening comprehension test increased from 72 to 92% (p = 0.06). We describe development of a longitudinal Spanish program within a medical school. Participation was associated with improved Spanish listening comprehension and no change in speaking proficiency.

Client satisfaction with the nutrition education component of the California WIC program.

PubMed

Nestor, B; McKenzie, J; Hasan, N; AbuSabha, R; Achterberg, C

2001-01-01

Past evaluation research has documented improved nutritional outcomes resulting from participation in the Special Supplemental Nutrition Program for Women, Infants and Children (WIC). However, these evaluations have not examined the program from the clients' perspective, nor have they examined the independent effect of the nutrition education component. The purpose of this study was to quantitatively and qualitatively examine client satisfaction with the nutrition education component of the California WIC program. The methodology consisted of two phases. During phase I of the study (the quantitative component), participants completed Client Satisfaction Surveys immediately following attendance of one nutrition class. During phase II (the qualitative component), four focus groups were conducted. All subjects were participants in the California WIC program. Client Satisfaction Surveys were completed by 2138 participants, and the focus groups included 29 participants. Results from both phases of the study indicated that client satisfaction with the nutrition education component of the California WIC program was high. Between 80% and 95% of participants responded positively to five satisfaction questions, and focus group participants unanimously agreed that the nutrition education was an essential component of the program. Hispanic participants were more likely than non-Hispanic Caucasians, Asians, or African Americans to respond positively to three of the five satisfaction questions. For two of the questions, the frequency of positive responses increased as age increased and decreased as education level increased. A small segment of clients reported some dissatisfaction by responding negatively to one or more of the satisfaction questions (4% to 20% of respondents). Some suggestions for improvement were made by survey respondents. Identification of some WIC participants who are not completely satisfied with the nutrition education that they have received, paired with differences in satisfaction across demographic variables, suggests the need for a personalized approach to WIC nutrition education.

Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.

Building on a YMCA's health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_.

PubMed

Bush, Paula Louise; García Bengoechea, Enrique

2016-08-01

School-based physical activity programs are only effective for increasing adolescents' school-based physical activity. To increase out-of-school-time physical activity, complementary community programs are warranted. Partnerships between universities and community organizations may help build the capacity of these organizations to provide sustainable programs. To understand capacity building processes and outcomes, we partnered with a YMCA to build on their adolescent physical activity promotion capacity. Together, we designed and implemented means to evaluate the YMCA teen program to inform program planning. For this qualitative case study, emails and interviews and meetings transcripts were collected over 2.5 years and analyzed using inductive and deductive thematic analysis. Findings illustrate that the YMCA's workforce and organizational development capacities (e.g., evaluation and health promotion capacity and competence) were increased through our partnership, resource allocation, and leadership. We responded to YMCA partners' perceived needs, yet guided them beyond those needs, successfully combining our complementary objectives, knowledge, and skills to generate an integrated program vision, rationale, and evaluation results. This provided YMCA partners with validation, reminders, and awareness. In turn, this contributed to programming and evaluation practice changes. In light of extant capacity building literature, we discuss how our partnership increased the YMCA's capacity to promote healthy adolescent programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of a Passive Nature Viewing Program Set to Music.

PubMed

Cadman, Sally J

2014-09-01

Research has revealed that passive nature viewing (viewing nature scenes without actually being in nature) has many health benefits but little is known about the best method of offering this complementary modality. The purpose of this pilot program was to evaluate the impact of a passive nature viewing program set to music on stress reduction in adults living in the community. A pre- and postsurvey design along with weekly recordings of stress and relaxation levels were used to evaluate the effect of this passive nature viewing program on stress reduction. Participants watched one of three preselected nature scenes for 5 minutes a day over 1 month and rated their stress and relaxation levels weekly on a 100-mm Visual Analogue Scale before and after viewing the nature DVD. Quantitative analysis were not performed because of the less number of subjects (n = 10) completing the study. Qualitative analysis found five key categories that have an impact on program use: (a) technology, (b) personal preferences, (c) time, (d) immersion, and (e) use of the program. Holistic nurses may consider integrating patient preferences and immersion strategies in the design of future passive nature viewing programs to reduce attrition and improve success. © The Author(s) 2013.

Transana Qualitative Video and Audio Analysis Software as a Tool for Teaching Intellectual Assessment Skills to Graduate Psychology Students

ERIC Educational Resources Information Center

Rush, S. Craig

2014-01-01

This article draws on the author's experience using qualitative video and audio analysis, most notably through use of the Transana qualitative video and audio analysis software program, as an alternative method for teaching IQ administration skills to students in a graduate psychology program. Qualitative video and audio analysis may be useful for…

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

PubMed

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were summarized using descriptive statistics. An inductive approach was used to identify themes in the qualitative data related to the evaluation questions. The findings demonstrated the program was implemented as intended, and that there was a need for the program, with six clients on the 10-month pilot. The findings also indicated achievement of program-level outcomes and progress toward system-level outcomes. Clients/families and healthcare providers were satisfied with the program and perceived it to be meeting its objectives. The program model was also perceived to be transferrable to other First Nations communities. The results demonstrate how a rural First Nations community can build capacity and develop a palliative care program tailored to their unique culture and context that builds upon and is integrated into existing services. The Wiisokotaatiwin Program allowed community members to receive their palliative care at home, improved client experience and enhanced service integration. This article provides a First Nations specific model for a palliative care program that overcomes jurisdictional issues at the local level, and a methodology for developing and evaluating community-based palliative care programs in rural First Nations communities. The article demonstrates how local, federal and provincial healthcare providers and organizations collaborated to build capacity, fund and deliver community-based palliative care. The described process of developing the program has applicability in other First Nations (Indigenous) communities and for healthcare decisionmakers.

Moving from rhetoric to reality: adapting Housing First for homeless individuals with mental illness from ethno-racial groups

PubMed Central

2012-01-01

Background The literature on interventions addressing the intersection of homelessness, mental illness and race is scant. The At Home/Chez Soi research demonstration project is a pragmatic field trial investigating a Housing First intervention for homeless individuals with mental illness in five cities across Canada. A unique focus at the Toronto site has been the development and implementation of a Housing First Ethno-Racial Intensive Case Management (HF ER-ICM) arm of the trial serving 100 homeless individuals with mental illness from ethno-racial groups. The HF ER-ICM program combines the Housing First approach with an anti-racism/anti-oppression framework of practice. This paper presents the findings of an early implementation and fidelity evaluation of the HF ER-ICM program, supplemented by participant narrative interviews to inform our understanding of the HF ER-ICM program theory. Methods Descriptive statistics are used to describe HF ER-ICM participant characteristics. Focus group interviews, key informant interviews and fidelity assessments were conducted between November 2010 and January 2011, as part of the program implementation evaluation. In-depth qualitative interviews with HF ER-ICM participants and control group members were conducted between March 2010 and June 2011. All qualitative data were analysed using grounded theory methodology. Results The target population had complex health and social service needs. The HF ER-ICM program enjoyed a high degree of fidelity to principles of both anti-racism/anti-oppression practice and Housing First and comprehensively addressed the housing, health and sociocultural needs of participants. Program providers reported congruence of these philosophies of practice, and program participants valued the program and its components. Conclusions Adapting Housing First with anti-racism/anti-oppression principles offers a promising approach to serving the diverse needs of homeless people from ethno-racial groups and strengthening the service systems developed to support them. The use of fidelity and implementation evaluations can be helpful in supporting successful adaptations of programs and services. Trial registration Current Controlled Trials ISRCTN42520374 PMID:23031406

Research to support optimization of prescription drug monitoring programs.

PubMed

Doyle, Sheri; Leichtling, Gillian; Hildebran, Christi; Reilly, Cynthia

2017-11-01

Research is needed to evaluate the impact of prescription drug monitoring programs (PDMPs). This paper describes research priorities for PDMPs that were initially discussed at a 2015 meeting of PDMP administrators, researchers, public health officials, and other stakeholders. Meeting participants defined the current landscape of PDMP research and identified research gaps. Research priorities were grouped by theme. Prescription drug monitoring program research priorities were identified for 3 key areas: individual patient health outcomes, prescriber use and decision making, and population-level outcomes. Research areas for individual patient outcomes include examining drug-use thresholds that best predict risk for overdose or substance use disorder and unintended consequences of PDMP use. Proposed research on prescriber PDMP use include evaluating how enhancements to the content and format of PDMP reports informs clinical decision making and optimal clinician actions in response to a concerning PDMP report. Finally, research topics related to population-level outcomes include measuring the impact of PDMP policies on the incidence of substance misuse and harms and assessing the return on investment for these databases. The clinical, public health, and economic impacts of PDMPs must be evaluated, using both quantitative and qualitative methods. In addition to assessing patient outcomes, qualitative research should examine how clinicians use and interpret PDMP information. Research should also examine the impact of PDMP features and policies on prescriber utilization. Comparative analyses across states with differing PDMP policies should be conducted to inform best practices. Copyright © 2017 John Wiley & Sons, Ltd.

Enhancing positive attitudes towards disability: evaluation of an integrated physiotherapy program.

PubMed

Morgan, Prue Elizabeth; Lo, Kristin

2013-02-01

This study explored whether attitudes towards disability in second year undergraduate physiotherapy students could be enhanced by an on-campus integrated curriculum program. A pre-post design was used. Year 2 (pre-clinical) students participated in a 12-week program focused on optimising attitudes towards people with acquired or developmental neurological disability. The Discomfort subscale of the Interaction with Disabled Persons scale, rated on a six-point Likert scale, was applied prior to and at completion of the 12-week program, and compared to year 4 students, just prior to graduation. Qualitative data from year 2 reflective narratives was also gathered. Forty-seven second year and 45 fourth year physiotherapy students participated. The difference in Discomfort subscale scores between weeks 1 and 12 of year 2 was statistically significant (p = 0.0016). The difference in Discomfort subscale scores between year 2 week 1 and year 4 students was also statistically significant (p = 0.040). There was no significant difference in attitudes between students at the end of year 2 and the end of year 4 (p = 0.703). Qualitative data supported the development of more positive attitudes towards neurological disability across the 12 week year 2 pre-clinical program. Student attitudes towards people with acquired and/or developmental neurological disabilities can be enhanced through an on campus integrated curriculum program.

[Development and Effects of a Cognitive-behavioral Therapy Based Program in Reducing Internalized Stigma in Patients with Schizophrenia].

PubMed

Kim, Mi Young; Jun, Seong Sook

2016-06-01

This study was done to develop a internalized stigma reducing program based on cognitive-behavioral therapy and appropriate for patients with schizophrenia and to evaluate its effectiveness. The study design was a mixed method research. Qualitative study, 13 patients with schizophrenia who had experience in overcoming stigma were purposively chosen for interviews and data were analyzed using Giorgi method. Quantitative study, 64 patients with schizophrenia (experimental group=32, control group=32) were recruited. The cognitive-behavioral therapy-based program for reducing internalized stigma in patients with schizophrenia was provided for 8 weeks (12 sessions). Data were collected from June. 20, 2013 to Feb. 14, 2014. Quantitative data were analyzed using χ²-test, t-test, repeated measures ANOVA with the SPSS program. Qualitative results, from the experience of coping with stigma in patients with schizophrenia seventeen themes and five themes-clusters were drawn up. Quantitative results showed that internalized stigma, self-esteem, mental health recovery and quality of life were significantly better in the experimental group compared to the control group. Study findings indicate that this program for reducing internalized stigma in patients with schizophrenia is effective and can be recommended as a rehabilitation program intervention to help patients with schizophrenia to cope with internalized stigma.

Latina food patterns in the United States: a qualitative metasynthesis.

PubMed

Gerchow, Lauren; Tagliaferro, Barbara; Squires, Allison; Nicholson, Joey; Savarimuthu, Stella M; Gutnick, Damara; Jay, Melanie

2014-01-01

Obesity disproportionately affects Latinas living in the United States, and cultural food patterns contribute to this health concern. The aim of this study was to synthesize the qualitative results of research regarding Latina food patterns in order to (a) identify common patterns across Latino culture and within Latino subcultures and (b) inform future research by determining gaps in the literature. A systematic search of three databases produced 13 studies (15 manuscripts) that met the inclusion criteria for review. The Critical Appraisal Skills Program tool and the recommendations of Squires for evaluating translation methods in qualitative research were applied to appraise study quality. Authors coded through directed content analysis and an adaptation of the Joanna Briggs Institute Qualitative Assessment and Review Instrument coding template to extract themes. Coding focused on food patterns, obesity, population breakdown, immigration, acculturation, and barriers and facilitators to healthy eating. Other themes and categories emerged from this process to complement this approach. Major findings included the following: (a) Immigration driven changes in scheduling, food choice, socioeconomic status, and family dynamics shape the complex psychology behind healthy food choices for Latina women; (b) in Latina populations, barriers and facilitators to healthy lifestyle choices around food are complex; and (c) there is a clear need to differentiate Latino populations by country of origin in future qualitative studies on eating behavior. Healthcare providers need to recognize the complex influences behind eating behaviors among immigrant Latinas in order to design effective behavior change and goal-setting programs to support healthy lifestyles.

Delivering digital health and well-being at scale: lessons learned during the implementation of the dallas program in the United Kingdom

PubMed Central

Devlin, Alison M; McGee-Lennon, Marilyn; O’Donnell, Catherine A; Bouamrane, Matt-Mouley; Agbakoba, Ruth; O’Connor, Siobhan; Grieve, Eleanor; Finch, Tracy; Wyke, Sally; Watson, Nicholas; Browne, Susan

2016-01-01

Objective To identify implementation lessons from the United Kingdom Delivering Assisted Living Lifestyles at Scale (dallas) program—a large-scale, national technology program that aims to deliver a broad range of digital services and products to the public to promote health and well-being. Materials and Methods Prospective, longitudinal qualitative research study investigating implementation processes. Qualitative data collected includes semi-structured e-Health Implementation Toolkit–led interviews at baseline/mid-point (n = 38), quarterly evaluation, quarterly technical and barrier and solutions reports, observational logs, quarterly evaluation alignment interviews with project leads, observational data collected during meetings, and ethnographic data from dallas events (n > 200 distinct pieces of qualitative data). Data analysis was guided by Normalization Process Theory, a sociological theory that aids conceptualization of implementation issues in complex healthcare settings. Results Five key challenges were identified: 1) The challenge of establishing and maintaining large heterogeneous, multi-agency partnerships to deliver new models of healthcare; 2) The need for resilience in the face of barriers and set-backs including the backdrop of continually changing external environments; 3) The inherent tension between embracing innovative co-design and achieving delivery at pace and at scale; 4) The effects of branding and marketing issues in consumer healthcare settings; and 5) The challenge of interoperability and information governance, when commercial proprietary models are dominant. Conclusions The magnitude and ambition of the dallas program provides a unique opportunity to investigate the macro level implementation challenges faced when designing and delivering digital health and wellness services at scale. Flexibility, adaptability, and resilience are key implementation facilitators when shifting to new digitally enabled models of care. PMID:26254480

Evaluation of educational program in the Master of Medical Education by Eisner's educational connoisseurship and criticism model.

PubMed

Khanipoor, Fariba; Amini, Mitra; Bazrafcan, Laila

2017-01-01

To be more successful in medical education and identify the strengths and weaknesses of the curriculum in this field, assessment of the students' views, graduates, professors, and experts is essential. The aim of this qualitative assessment was to identify the strengths and weaknesses of the medical education curriculum. This research is a qualitative study using the Eisner's educational connoisseurship and criticism model that was conducted in Shiraz Medical Sciences University in 2014. In this research, graduate medical education curriculum was criticized by a team of educational experts. Fifteen professors in the first stage of the focus group meeting addressed the three stages of educational criticism. In the second stage, several interviews were conducted with the above-mentioned people. In the third phase, the implementation of video recordings from the focus group meeting was performed in written form. In the fourth stage, conventional content analysis was used to analyze the qualitative data. This curriculum has advantages and disadvantages in the constituent elements of the program. Its weaknesses include lack of written a guide for practical courses, lack of consideration of joint practical exercise to make integrate between lessons, lack of sufficient attention to aspects of practical and functional knowledge in this field, lack of attention to performance evaluation and development, and lack of routine review of the curriculum. On the other hand, the strengths of this study include the suitability of this field for professors and its positive impact on professors and students performance in the classroom. As medical education is partly an emerging field in Iran and considering the weaknesses, reviewing the curriculum based on the main part of program, the outcomes, curriculum content, teaching strategies, student assessment, and course management are recommended.

Evaluation of educational program in the Master of Medical Education by Eisner's educational connoisseurship and criticism model

PubMed Central

Khanipoor, Fariba; Amini, Mitra; Bazrafcan, Laila

2017-01-01

INTRODUCTION: To be more successful in medical education and identify the strengths and weaknesses of the curriculum in this field, assessment of the students’ views, graduates, professors, and experts is essential. The aim of this qualitative assessment was to identify the strengths and weaknesses of the medical education curriculum. SUBJECTS AND METHODS: This research is a qualitative study using the Eisner's educational connoisseurship and criticism model that was conducted in Shiraz Medical Sciences University in 2014. In this research, graduate medical education curriculum was criticized by a team of educational experts. Fifteen professors in the first stage of the focus group meeting addressed the three stages of educational criticism. In the second stage, several interviews were conducted with the above-mentioned people. In the third phase, the implementation of video recordings from the focus group meeting was performed in written form. In the fourth stage, conventional content analysis was used to analyze the qualitative data. RESULTS: This curriculum has advantages and disadvantages in the constituent elements of the program. Its weaknesses include lack of written a guide for practical courses, lack of consideration of joint practical exercise to make integrate between lessons, lack of sufficient attention to aspects of practical and functional knowledge in this field, lack of attention to performance evaluation and development, and lack of routine review of the curriculum. On the other hand, the strengths of this study include the suitability of this field for professors and its positive impact on professors and students performance in the classroom. CONCLUSION: As medical education is partly an emerging field in Iran and considering the weaknesses, reviewing the curriculum based on the main part of program, the outcomes, curriculum content, teaching strategies, student assessment, and course management are recommended. PMID:28616422

Can workers with chronic back pain shift from pain elimination to function restore at work? Qualitative evaluation of an innovative work related multidisciplinary programme.

PubMed

Buijs, Peter C; Lambeek, Ludeke C; Koppenrade, Vera; Hooftman, Wendela E; Anema, Johannes R

2009-01-01

Workers with chronic low back pain (LBP) mean a heavy human and social-economic burden. Their medical histories often include different treatments without attention to work-relatedness or communication with occupational health providers, leaving them passive and medicalized in (outpatient) health care. So we developed and implemented an innovative, patient-activating alternative: the multidisciplinary outpatient care (MOC) programme, including work(place) intervention and graded activity. It aims at function restore (instead of pain elimination), return to work (RTW) and coordinated communication. To qualitatively explore how patients and health care providers perceive the programme effectiveness and which factors influence its implementation. In-depth, semi structured interview with patients and focus groups of health care providers are used, all recorded, transformed into verbatim transcript and analysed. This qualitative study shows that although patients' expectations were low at the start of the program, and despite long LBP histories, including many different therapies, (primarily) directed at pain reduction, the MOC programme was successful in changing patients' goal setting from pain oriented towards function restore and RTW. The programme was therefore perceived as applicable and effective. Patient compliance was influenced by barriers - despair, supervisory and subordinate resistance at work, waiting period, medicalisation in health care - and facilitators: disciplinary motivation, protocolled communication, information supply, tailor-made exercises. For some patients the barriers were too high. Several improvement suggestions were given. This qualitative study shows that generally, patients and professionals perceived the multidisciplinary outpatient care programme as applicable and effective. After incorporating improvement suggestions this program seems promising for further, broader application and hypothesis testing. For those, negatively evaluating the programme, alternatives should be explored.

Scale-out of a community-based behavioral intervention for childhood obesity: pilot implementation evaluation.

PubMed

Heerman, William J; Schludnt, David; Harris, Dawn; Teeters, Leah; Apple, Rachel; Barkin, Shari L

2018-04-13

Expanding the use of evidence-based behavioral interventions in community settings has met with limited success in various health outcomes as fidelity and dose of clinical interventions are often diluted when translated to communities. We conducted a pilot implementation study to examine adoption of the rigorously evaluated Healthier Families Program by Parks and Recreation centers in 3 cities across the country (MI, GA, NV) with diverse socio-cultural environments. Using the RE-AIM framework, we evaluated the program both quantitatively (pre/post surveys of health behavior change; attendance & fidelity) and qualitatively (interviews with Parks and Recreation staff and participants following the program). The 3 partner sites recruited a total of 26 parent-child pairs. Among the 24 participants who completed pre/post surveys, 62.5% were 25-34 years old, and average child age was 3.6 (SD 0.7) years. The distribution of self-reported race/ethnicity was 54% non-Hispanic White, 38% non-Hispanic Black, and 8% Latino. Qualitative interviews with participants demonstrated increased use of the built environment for physical activity and continued use of key strategies for health behavior change. Three of five (60%) collaborating sites proceeded with implementation of the program. The average attendance for the 12-week program was 7.6 (SD 3.9) sessions, with 71% attending > 50% of sessions. Average fidelity for the 12 weekly sessions was 25.2 (SD 1.2; possible range 9-27). All 3 partner sites continued offering the program after grant funding was complete. This pilot is among the first attempts to scale-out an evidence-based childhood obesity intervention in community Parks and Recreation centers. While this pilot was not intended to confirm the efficacy of the original trial on Body Mass Index (BMI) reduction, the effective and sustained behavior change among a geographically and ethnically diverse population with high attendance and fidelity demonstrates an effective approach on which to base future large-scale implementation efforts to reduce childhood obesity in community settings.

Views of Family Medicine Trainees of a Teaching Hospital in Riyadh regarding their Hospital Rotations: A Qualitative Study.

PubMed

Alquaiz, Aljohara M; Abdulghani, Hamza M; Karim, Syed Irfan; Qureshi, Riaz

2013-01-01

To explore Family Medicine Trainees views regarding the hospital component of their Family Medicine (FM) training program. This is a qualitative focus group discussion based study. Thirteen trainees, eight from final year of FM training program and five from third year of the same program participated in the study. The structure for discussion included a previously distributed and completed questionnaire that included three sections. The first section was evaluation of the satisfaction of trainees with the different hospital specialties rotations. The second section related to reasons for rating the different rotations as excellent and very good. The third section related to deficiencies in training for those rotations which received a score of 3-5. The items in the questionnaire were utilized in the focus group discussion. Two facilitators who were investigators facilitated the discussion. The data was qualitatively analyzed to identify emergent themes and subthemes that described the trainees' views. The trainees highlighted the following views: Teaching in the hospital component is not relevant to the needs of Family Medicine trainees. Duration of the hospital posts should be reviewed. Emphasis should be on out-patient clinics rather than in-patient. More emphasis must be given to procedural skills, minor surgery and teaching in clinical contexts. Hospital training component of the Family Medicine training program should be reviewed, as the structure and its implementation doesn't reflect the views of trainees regarding its relevance to their day to day practice.

Girls and science: A qualitative study on factors related to success and failure in science

NASA Astrophysics Data System (ADS)

Johnson, Paula Denise

This qualitative study sought to determine how girls perceived factors that contribute to their success in science programs designed to maximize their achievement. The sample consisted of 20 students in 9th and 12th grades attending a school of choice. Respondents were interviewed using a structured interview protocol. The National Council for Research on Women study (Thom, 2001) found that girls are more successful in math and science programs that incorporate a cooperative, hands-on approach than in programs that stress competition and individual learning. This finding was supported by this study among 20 high school girls in a school whose mission is to improve the access of girls who study and choose careers in STEM (science, technology, engineering, and mathematics) disciplines. Related studies on the subject of the underrepresentation of girls and women in science and related disciplines raise the question why so few girls choose STEM careers. Qualitative inductive analysis was used to discover critical themes that emerged from the data. The initial results were presented within the context of the following five themes: (1) learning styles, (2) long-term goals, (3) subject matter, (4) classroom climate/environment, and (5) evaluation. After further analysis, the researcher found that factors cited by the girls as contributing to their success in science programs specifically designed to maximize their achievement were: (a) cooperative learning, (b) a custom-tailored curriculum, and (c) positive influences of mentors.

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Evaluation of a health sciences internship for Latino and Native American library students.

PubMed

Keselman, Alla; Quasem, Sanjana; Kelly, Janice E; Dutcher, Gale A

2016-10-01

This paper presents a qualitative evaluation of a graduate-level internship for Latino and Native American library science students or students who are interested in serving those populations. The authors analyzed semi-structured interviews with thirteen internship program graduates or participants. The analysis suggests that the program increased participants' interest in health sciences librarianship and led to improved career opportunities, both in health sciences libraries and other libraries with health information programming. It also highlights specific factors that are likely to contribute to the strength of career pipeline programs aiming to bring Latino and Native American students and students who are interested in serving those communities into health librarianship. Exposing graduate-level interns to a broad range of health sciences librarianship tasks, including outreach to Latino and Native American communities and formal mentorship, is likely to maximize interns' interests in both health sciences librarianship and service to these communities.

Perspectives on the changing healthcare system: teaching systems-based practice to medical residents

PubMed Central

Martinez, Johanna; Phillips, Erica; Fein, Oliver

2013-01-01

Purpose The Accreditation Council for Graduate Medical Education restructured its accreditation system to be based on educational outcomes in six core competencies. Systems-based practice is one of the six core competencies. The purpose of this report is to describe Weill Cornell Medical College's Internal Medicine Residency program curriculum for systems-based practice (SBP) and its evaluation process. Methods To examine potential outcomes of the POCHS curriculum, an evaluation was conducted, examining participants': (1) knowledge gain; (2) course ratings; and (3) qualitative feedback. Results On average, there was a 19 percentage point increase in knowledge test scores for all three cohorts. The course was rated overall highly, receiving an average of 4.6 on a 1–5 scale. Lastly, the qualitative comments supported that the material is needed and valued. Conclusion The course, entitled Perspectives on the Changing Healthcare System (POCHS) and its evaluation process support that systems-based practice is crucial to residency education. The course is designed not only to educate residents about the current health care system but also to enable them to think critically about the risk and benefits of the changes. POCHS provides a framework for teaching and assessing this competency and can serve as a template for other residency programs looking to create or restructure their SBP curriculum. PMID:24001523

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing students’ clinical competencies seems necessary. PMID:24554959

IMAGINE-ing interprofessional education: program evaluation of a novel inner city health educational experience

PubMed Central

Hu, Tina; Cox, Kelly Anne; Nyhof-Young, Joyce

2017-01-01

Background Poverty is a key determinant of health that leads to poor health outcomes. Although most healthcare providers will work with patients experiencing poverty, surveys among healthcare students have reported a curriculum gap in this area. This study aims to introduce and evaluate a novel, student-run interprofessional inner city health educational program that combines both practical and didactic educational components. Methods Students participating in the program answered pre- and post-program surveys. Wilcoxon signed-rank tests and descriptive thematic analysis were used for quantitative and qualitative data, respectively. Results A total of 28 out of 35 participants responded (response rate: 80%). Student knowledge about issues facing underserved populations and resources for underserved populations significantly increased after program participation. Student comfort working with underserved populations also significantly increased after program participation. Valued program elements included workshops, shadowing, and a focus on marginalized populations. Conclusion Interprofessional inner city health educational programs are beneficial for students to learn about poverty intervention and resources, and may represent a strategy to address a gap in the healthcare professional curriculum. PMID:28344718

The Use of Online Focus Groups to Design an Online Food Safety Education Intervention

ERIC Educational Resources Information Center

Mayer, Ashley Bramlett; Harrison, Judy A.

2012-01-01

In the development of an online food safety education intervention for college students, online focus groups were used to determine the appropriate format and messages. Focus groups are often used in qualitative research and formative evaluation of public health programs, yet traditional focus groups can be both difficult and expensive to…

Potential Changes in Prospective Chemistry Teachers' Beliefs about Teaching and Learning--A Cross-Level Study

ERIC Educational Resources Information Center

Markic, Silvija; Eilks, Ingo

2013-01-01

This paper presents a cross-level study of German student teachers' beliefs about teaching and learning chemistry. It covers different stages of their teacher training program. The study is based upon drawings of teaching situations, which were analyzed using an evaluation pattern developed using grounded theory. The qualitative scales analyze…

Fostering "Connectedness to Nature" through U.S. Fish and Wildlife Service Education and Outreach Programming: A Qualitative Evaluation

ERIC Educational Resources Information Center

Theimer, Stefan; Ernst, Julie

2012-01-01

Despite a recent increased emphasis on emotional connections to nature and their relationship to stewardship and health outcomes in the environmental education and other literature, there is a lack of understanding of what qualities of nature experiences actually influence emotional connections to nature, otherwise known as environmental…

Evaluating the Viability of Mobile Learning to Enhance Management Training

ERIC Educational Resources Information Center

Macdonald, Iain; Chiu, Jason

2011-01-01

A qualitative research project was conducted to test the viability of augmenting an e-learning program for workplace learners using mobile content delivered through smart phones. Ten learners taking a six week web-based e-learning course were given smart phones which enabled them to access approximately 70% of the course content, in addition to…

Use of Online Assessment Tools by Instructional Designers-by-Assignment: Necessary Features and Functionalities

ERIC Educational Resources Information Center

Halloran, Jo-Ann

2013-01-01

Government entities set criteria for institutions that have teacher educator programs to use online assessment tools to show continuous ongoing evaluation, and use data from the tools to guide the improvement of courses. The purpose of this qualitative, multi-case study was to discover how Instructional Designers-by-Assignment (IDBA) are using…

Patterns and Impacts of Short-Term Cross-Cultural Experience in Science and Mathematics Teaching: Benefits, Value, and Experience

ERIC Educational Resources Information Center

Kanyaprasith, Kamonwan; Finley, Fred N.; Phonphok, Nason

2015-01-01

This study evaluates a cross-cultural experience in science and mathematics teaching in Thailand--an internship program. In this study, qualitative data sources including semi-structured interviews, classroom observations, and pre-post questionnaire were collected from five groups of participants, which were: (a) administrators; (b) Thai…

Student and Teacher Perspectives on Channel One: A Qualitative Study of Participants in Massachusetts and Florida Schools.

ERIC Educational Resources Information Center

Barrett, Janice M.

A study of Channel One, the 10 minutes of television news programs and 2 minutes of commercials in classrooms, described the opinions and evaluative comments of participant teachers, librarians, administrators, and students. Individual interviews and focus group discussions were conducted at eight secondary schools (four in Florida and four in…

Library Services for Users of Personal Digital Assistants: A Needs Assessment and Program Evaluation

ERIC Educational Resources Information Center

Carney, Stephen; Koufogiannakis, Denise; Ryan, Pam

2007-01-01

Research was undertaken to guide development of services for personal digital assistant (PDA) users at the University of Alberta Libraries. A variety of qualitative methods were used to assess user satisfaction with current PDA services and identify potential PDA services for the libraries and resources. The research and needs assessment results…

Explicating Metatheory for Mixed Methods Research in Educational Leadership: An Application of Habermas's "Theory of Communicative Action"

ERIC Educational Resources Information Center

Whiteman, Rodney S.

2015-01-01

Purpose: Mixed methods research can provide a fruitful line of inquiry for educational leadership, program evaluation, and policy analysis; however, mixed methods research requires a metatheory that allows for mixing what have traditionally been considered incompatible qualitative and quantitative inquiry. The purpose of this paper is to apply…

Optimizing Implementation of Obesity Prevention Programs: A Qualitative Investigation Within a Large-Scale Randomized Controlled Trial.

PubMed

Kozica, Samantha L; Teede, Helena J; Harrison, Cheryce L; Klein, Ruth; Lombard, Catherine B

2016-01-01

The prevalence of obesity in rural and remote areas is elevated in comparison to urban populations, highlighting the need for interventions targeting obesity prevention in these settings. Implementing evidence-based obesity prevention programs is challenging. This study aimed to investigate factors influencing the implementation of obesity prevention programs, including adoption, program delivery, community uptake, and continuation, specifically within rural settings. Nested within a large-scale randomized controlled trial, a qualitative exploratory approach was adopted, with purposive sampling techniques utilized, to recruit stakeholders from 41 small rural towns in Australia. In-depth semistructured interviews were conducted with clinical health professionals, health service managers, and local government employees. Open coding was completed independently by 2 investigators and thematic analysis undertaken. In-depth interviews revealed that obesity prevention programs were valued by the rural workforce. Program implementation is influenced by interrelated factors across: (1) contextual factors and (2) organizational capacity. Key recommendations to manage the challenges of implementing evidence-based programs focused on reducing program delivery costs, aided by the provision of a suite of implementation and evaluation resources. Informing the scale-up of future prevention programs, stakeholders highlighted the need to build local rural capacity through developing supportive university partnerships, generating local program ownership and promoting active feedback to all program partners. We demonstrate that the rural workforce places a high value on obesity prevention programs. Our results inform the future scale-up of obesity prevention programs, providing an improved understanding of strategies to optimize implementation of evidence-based prevention programs. © 2015 National Rural Health Association.

Assumption-aware tools and agency; an interrogation of the primary artifacts of the program evaluation and design profession in working with complex evaluands and complex contexts.

PubMed

Morrow, Nathan; Nkwake, Apollo M

2016-12-01

Like artisans in a professional guild, we evaluators create tools to suit our ever evolving practice. The tools we use as evaluators are the primary artifacts of our profession, reflect our practice and embody an amalgamation of paradigms and assumptions. With the increasing shifts in evaluation purposes from judging program worth to understanding how programs work, the evaluator's role is changing to that of facilitating stakeholders in a learning process. This involves clarifying purposes and choices, as well as unearthing critical assumptions. In such a role, evaluators become major tool-users and begin to innovate with small refinements or produce completely new tools to fit a specific challenge or context. We interrogate the form and function of 12 tools used by evaluators when working with complex evaluands and complex contexts. The form is described in terms of traditional qualitative techniques and particular characteristics of the elements, use and presentation of each tool. Then the function of each tool is analyzed with respect to articulating assumptions and affecting the agency of evaluators and stakeholders in complex contexts. Copyright © 2016 Elsevier Ltd. All rights reserved.

Advancing Care Within an Adult Mental Health Day Hospital: Program Re-Design and Evaluation.

PubMed

Taube-Schiff, Marlene; Mehak, Adrienne; Marangos, Sandy; Kalim, Anastasia; Ungar, Thomas

2017-11-13

Day hospital mental health programs provide alternate care to individuals of high acuity that do not require an inpatient psychiatric stay. Ensuring provision of best practice within these programs is essential for patient stabilization and recovery. However, there is scant literature to review when creating such a program. This paper provides an overview of the steps an acute care hospital took when designing and implementing new programming within a day hospital program. Qualitative data was collected following initial program rollout. This data helped to inform the ongoing modification of groups offered, group scheduling and content, as well as ensuring patient satisfaction and adequate skill delivery during the rollout period and beyond. The goal of this paper is to inform health service delivery for other programs when attempting to build or re-design a day hospital program.

Manned Versus Unmanned Risk and Complexity Considerations for Future Midsized X-Planes

NASA Technical Reports Server (NTRS)

Lechniak, Jason A.; Melton, John E.

2017-01-01

The objective of this work was to identify and estimate complexity and risks associated with the development and testing of new low-cost medium-scale X-plane aircraft primarily focused on air transport operations. Piloting modes that were evaluated for this task were manned, remotely piloted, and unmanned flight research programs. This analysis was conducted early in the data collection period for X-plane concept vehicles before preliminary designs were complete. Over 50 different aircraft and system topics were used to evaluate the three piloting control modes. Expert group evaluations from a diverse set of pilots, engineers, and other experts at Aeronautics Research Mission Directorate centers within the National Aeronautics and Space Administration provided qualitative reasoning on the many issues surrounding the decisions regarding piloting modes. The group evaluations were numerically rated to evaluate each topic quantitatively and were used to provide independent criteria for vehicle complexity and risk. An Edwards Air Force Base instruction document was identified that emerged as a source of the effects found in our qualitative and quantitative data. The study showed that a manned aircraft was the best choice to align with test activities for transport aircraft flight research from a low-complexity and low-risk perspective. The study concluded that a manned aircraft option would minimize the risk and complexity to improve flight-test efficiency and bound the cost of the flight-test portion of the program. Several key findings and discriminators between the three modes are discussed in detail.

SmartMom Text Messaging for Prenatal Education: A Qualitative Focus Group Study to Explore Canadian Women's Perceptions.

PubMed

Munro, Sarah; Hui, Amber; Salmons, Vanessa; Solomon, Carolyn; Gemmell, Emily; Torabi, Nahal; Janssen, Patricia A

2017-02-07

We engaged Canadian women in the development of a prenatal education program delivered via one-way text messaging called SmartMom. SmartMom is the first peer-reviewed, evidence-based mHealth program for prenatal education in Canada and the first to be endorsed by the Society of Obstetricians and Gynaecologists of Canada. To explore women's preferences for a prenatal education program by text messaging. We conducted a qualitative focus group study in three Canadian communities in the Northern Health Authority. Women completed a demographic questionnaire, participated in a guided discussion about their pregnancy information-seeking behavior, reviewed a printed copy of the SmartMom text messages, and then engaged in a moderated discussion about their perceptions of the usability of the SmartMom program. Open-ended questions explored women's perceptions regarding the message content, acceptability of receiving information by text message, positive health behaviors they might engage in after receiving a message, modifiable program factors, and intention to use the program. Thematic analysis of transcribed audio recordings was undertaken and modifications were made to the SmartMom program based on these findings. A total of 40 women participated in seven focus groups in three rural northern communities. The vast majority had a mobile phone (39/40, 98%), used text messages "all the time" (28/40, 70%), and surfed the Internet on their phone (37/40, 93%). Participants perceived SmartMom to be highly acceptable and relevant. The text message modality reflected how participants currently sought pregnancy-related information and provided them with local information tailored to their gestational age, which they had not received through other pregnancy resources. Women recommended adding the opportunity to receive supplemental streams of messages tailored to their individual needs, for example, depression, pregnancy after previous cesarean, >35 years of age, new immigrants, and harm reduction for smoking and alcohol. This formative qualitative evaluation provides evidence that a prenatal education program by text messaging, SmartMom, is acceptable to the end users. These findings support the usability of the SmartMom program at a population level and the development of an evaluation program exploring the effects of the text messages on adoption of health-promoting behaviors and maternal-child health outcomes. ©Sarah Munro, Amber Hui, Vanessa Salmons, Carolyn Solomon, Emily Gemmell, Nahal Torabi, Patricia A Janssen. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 07.02.2017.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic

PubMed Central

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B.

2016-01-01

Background: The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. Objectives: A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. Study Design/Methods: This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. Results: The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. Conclusions: This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies. PMID:29444602

What Works to Reduce Unnecessary Care for Bronchiolitis? A Qualitative Analysis of a National Collaborative.

PubMed

Ralston, Shawn L; Atwood, Emily Carson; Garber, Matthew D; Holmes, Alison Volpe

2017-03-01

Unnecessary care is well established as a quality problem affecting acute viral bronchiolitis, one of the most common pediatric illnesses. Although there is an extensive quality improvement literature on the disease, published work primarily reflects the experience of freestanding children's hospitals. We sought to better understand the specific barriers and drivers for successful quality improvement in community and nonfreestanding children's facilities. We undertook a mixed methods study to identify correlates of success in a bronchiolitis quality improvement collaborative of community hospitals and children's hospitals within adult hospitals. We assessed site demographic characteristics, compliance with project interventions, and team engagement for association with end of project performance. We then used performance quartiles on a composite assessment of project measures (use of bronchodilators and steroids) to design a purposive sample of sites approached for qualitative interviews. Team engagement was the only factor quantitatively associated with better performance in the overall cohort. Fifteen sites, from the total cohort of 21, completed qualitative interviews. Qualitative themes around team engagement, including the presence of buy-in for successful sites and the inability to engage colleagues at unsuccessful sites, were important differentiating factors between top and bottom performance quartiles. Regardless of performance quartile, most programs cited intrainstitutional competition for limited resources to do quality improvement work as a specific barrier for pediatrics. The ability to overcome such barriers and specifically garner information technology (IT) resources also differentiated the top and bottom performance quartiles. Team engagement showed a consistent association with success across our quantitative and qualitative evaluations. Competition for limited resources in this cohort of nonfreestanding children's programs, particularly those in hospital IT, was a key qualitative theme. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Qualitative and quantitative outcomes of audience response systems as an educational tool in a plastic surgery residency program.

PubMed

Arneja, Jugpal S; Narasimhan, Kailash; Bouwman, David; Bridge, Patrick D

2009-12-01

In-training evaluations in graduate medical education have typically been challenging. Although the majority of standardized examination delivery methods have become computer-based, in-training examinations generally remain pencil-paper-based, if they are performed at all. Audience response systems present a novel way to stimulate and evaluate the resident-learner. The purpose of this study was to assess the outcomes of audience response systems testing as compared with traditional testing in a plastic surgery residency program. A prospective 1-year pilot study of 10 plastic surgery residents was performed using audience response systems-delivered testing for the first half of the academic year and traditional pencil-paper testing for the second half. Examination content was based on monthly "Core Quest" curriculum conferences. Quantitative outcome measures included comparison of pretest and posttest and cumulative test scores of both formats. Qualitative outcomes from the individual participants were obtained by questionnaire. When using the audience response systems format, pretest and posttest mean scores were 67.5 and 82.5 percent, respectively; using traditional pencil-paper format, scores were 56.5 percent and 79.5 percent. A comparison of the cumulative mean audience response systems score (85.0 percent) and traditional pencil-paper score (75.0 percent) revealed statistically significantly higher scores with audience response systems (p = 0.01). Qualitative outcomes revealed increased conference enthusiasm, greater enjoyment of testing, and no user difficulties with the audience response systems technology. The audience response systems modality of in-training evaluation captures participant interest and reinforces material more effectively than traditional pencil-paper testing does. The advantages include a more interactive learning environment, stimulation of class participation, immediate feedback to residents, and immediate tabulation of results for the educator. Disadvantages include start-up costs and lead-time preparation.

Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist.

PubMed

Banna, Jinan C; Vera Becerra, Luz E; Kaiser, Lucia L; Townsend, Marilyn S

2010-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture's food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Using Qualitative Methods to Improve Questionnaires for Spanish Speakers: Assessing Face Validity of a Food Behavior Checklist

PubMed Central

BANNA, JINAN C.; VERA BECERRA, LUZ E.; KAISER, LUCIA L.; TOWNSEND, MARILYN S.

2015-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture’s food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. PMID:20102831

Developing a Research Program Using Qualitative and Quantitative Approaches.

ERIC Educational Resources Information Center

Beck, Cheryl Tatano

1997-01-01

A research program on postpartum depression is used to illustrate the use of both qualitative and quantitative approaches. The direction of a research program is thus not limited by the type of methods in which a researcher has expertise. (SK)

Outcomes assessment of dental hygiene clinical teaching workshops.

PubMed

Wallace, Juanita S; Infante, Taline D

2008-10-01

Faculty development courses related to acquiring clinical teaching skills in the health professions are limited. Consequently, the Department of Dental Hygiene at the University of Texas Health Science Center at San Antonio conducted a series of clinical teaching workshops to address clinical teaching methodology. The goal of these workshops was to promote a problem-solving learning atmosphere for dental hygiene faculty to acquire and share sound clinical teaching strategies. To determine the value of the annual workshops on clinical teaching and evaluation, a web-based qualitative program assessment was developed using software by Survey Tracker. Four open-ended questions were designed to elicit perceptions regarding what significant changes in teaching strategies were achieved, what barriers or challenges were encountered in making these changes, and what strategies were used to overcome the barriers. The assessment was sent to dental hygiene educators representing thirty-eight dental hygiene programs who had participated in two or more of these workshops. Twenty-eight programs provided collective responses to the questions, and the narrative data were analyzed, using a qualitative methodology. Responses revealed that programs had made productive changes to their clinical education curricula and the information gained from the workshops had a positive effect on clinical teaching.

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

Evaluation of the 2012 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference: Six Month Impact on Science, Program, and Policy

PubMed Central

Goodman, David A.; Howlette, Travis; Kroelinger, Charlan D.; Law, Mark; Phillips, Donna; Jones, Jessica; Brantley, Mary D.; Fitzgerald, Maureen

2015-01-01

The 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference took place in December 2012, covering MCH science, program, and policy issues. Assessing the impact of the Conference on attendees’ work 6 months post-Conference provides information critical to understanding the impact and the use of new partnerships, knowledge, and skills gained during the Conference. Evaluation assessments, which included collection of quantitative and qualitative data, were administered at two time points: at Conference registration and 6 months post-Conference. The evaluation files were merged using computer IP address, linking responses from each assessment. Percentages of attendees reporting Conference impacts were calculated from quantitative data, and common themes and supporting examples were identified from qualitative data. Online registration was completed by 650 individuals. Of registrants, 30 % responded to the 6 month post-Conference assessment. Between registration and 6 month post-Conference evaluation, the distribution of respondents did not significantly differ by organizational affiliation. In the 6 months following the Conference, 65 % of respondents reported pursuing a networking interaction; 96 % shared knowledge from the Conference with coworkers and others in their agency; and 74 % utilized knowledge from the Conference to translate data into public health action. The Conference produced far-reaching impacts among Conference attendees. The Conference served as a platform for networking, knowledge sharing, and attaining skills that advance the work of attendees, with the potential of impacting organizational and workforce capacity. Increasing capacity could improve MCH programs, policies, and services, ultimately impacting the health of women, infants, and children. PMID:25107597

Evaluation of the 2012 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference: six month impact on science, program, and policy.

PubMed

Arellano, Danielle E; Goodman, David A; Howlette, Travis; Kroelinger, Charlan D; Law, Mark; Phillips, Donna; Jones, Jessica; Brantley, Mary D; Fitzgerald, Maureen

2014-09-01

The 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference took place in December 2012, covering MCH science, program, and policy issues. Assessing the impact of the Conference on attendees' work 6 months post-Conference provides information critical to understanding the impact and the use of new partnerships, knowledge, and skills gained during the Conference. Evaluation assessments, which included collection of quantitative and qualitative data, were administered at two time points: at Conference registration and 6 months post-Conference. The evaluation files were merged using computer IP address, linking responses from each assessment. Percentages of attendees reporting Conference impacts were calculated from quantitative data, and common themes and supporting examples were identified from qualitative data. Online registration was completed by 650 individuals. Of registrants, 30 % responded to the 6 month post-Conference assessment. Between registration and 6 month post-Conference evaluation, the distribution of respondents did not significantly differ by organizational affiliation. In the 6 months following the Conference, 65 % of respondents reported pursuing a networking interaction; 96 % shared knowledge from the Conference with co-workers and others in their agency; and 74 % utilized knowledge from the Conference to translate data into public health action. The Conference produced far-reaching impacts among Conference attendees. The Conference served as a platform for networking, knowledge sharing, and attaining skills that advance the work of attendees, with the potential of impacting organizational and workforce capacity. Increasing capacity could improve MCH programs, policies, and services, ultimately impacting the health of women, infants, and children.

Perceptions of ESL Program Management in Canadian Higher Education: A Qualitative Case Study

ERIC Educational Resources Information Center

Eaton, Sarah Elaine

2017-01-01

ESL programs at post-secondary institutions must often generate revenue in addition to teaching students English. Institutions often impose explicit expectations on these programs to generate profit, creating unique challenges for those who administer them. This qualitative case study investigated challenges faced by ESL program directors at one…

Processes and outcomes of the veterans health administration safe patient handling program: study protocol.

PubMed

Rugs, Deborah; Toyinbo, Peter; Patel, Nitin; Powell-Cope, Gail; Hahm, Bridget; Elnitsky, Christine; Besterman-Dahan, Karen; Campbell, Robert; Sutton, Bryce

2013-11-18

Health care workers, such as nurses, nursing aides, orderlies, and attendants, who manually move patients, are consistently listed in the top professions for musculoskeletal injuries (MSIs) by the Bureau of Labor Statistics. These MSIs are typically caused by high-risk patient caregiving activities. In 2008, a safe patient handling (SPH) program was implemented in all 153 Veterans Administration Medical Centers (VAMCs) throughout the United States to reduce patient handling injuries. The goal of the present study is to evaluate the effects associated with the national implementation of a comprehensive SPH program. The primary objectives of the research were to determine the effectiveness of the SPH program in improving direct care nursing outcomes and to provide a context for understanding variations in program results across sites over time. Secondary objectives of the present research were to evaluate the effectiveness of the program in reducing direct and indirect costs associated with patient handling, to explore the potential mediating and moderating mechanisms, and to identify unintended consequences of implementing the program. This 3-year longitudinal study used mixed methods of data collection at 6- to 9-month intervals. The analyses will include data from surveys, administrative databases, individual and focus group interviews, and nonparticipant observations. For this study, a 3-tiered measurement plan was used. For Tier 1, the unit of analysis was the facility, the data source was the facility coordinator or administrative data, and all 153 VAMCs participated. For Tier 2, frontline caregivers and program peer leaders at 17 facilities each completed different surveys. For Tier 3, six facilities completed qualitative site visits, which included individual interviews, focus groups, and nonparticipant observations. Multiple regression models were proposed to test the effects of SPH components on nursing outcomes related to patient handling. Content analysis and constant comparative analysis were proposed for qualitative data analysis to understand the context of implementation and to triangulate quantitative data. All three tiers of data for this study have been collected. We are now in the analyses and writing phase of the project, with the possibility for extraction of additional administrative data. The focus of this paper is to describe the SPH program, its evaluation study design, and its data collection procedures. This study evaluates the effects associated with the national implementation of a comprehensive SPH program that was implemented in all 153 VAMCs throughout the United States to reduce patient handling injuries. To our knowledge, this is the largest evaluation of an SPH program in the United States. A major strength of this observational study design is that all VAMCs implemented the program and were included in Tier 1 of the study; therefore, population sampling bias is not a concern. Although the design lacks a comparison group for testing program effects, this longitudinal field study design allows for capturing program dose-response effects within a naturalistic context. Implementation of the VA-wide SPH program afforded the opportunity for rigorous evaluation in a naturalistic context. Findings will guide VA operations for policy and decision making about resources, and will be useful for health care, in general, outside of the VA, in implementation and impact of an SPH program.

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

PubMed

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Impact of the Family Health Program on gastroenteritis in children in Bahia, Northeast Brazil: an analysis of primary care-sensitive conditions

PubMed Central

Monahan, Laura J.; Calip, Gregory S.; Novo, Patricia; Sherstinsky, Mark; Casiano, Mildred; Mota, Eduardo; Dourado, Inês

2013-01-01

In seeking to provide universal health care through its primary care-oriented Family Health Program, Brazil has attempted to reduce hospitalization rates for preventable illnesses such as childhood gastroenteritis. We measured rates of Primary Care-sensitive Hospitalizations and evaluated the impact of the Family Health Program on pediatric gastroenteritis trends in high-poverty Northeast Brazil. We analyzed aggregated municipal-level data in time-series between years 1999-2007 from the Brazilian health system payer database and performed qualitative, in-depth key informant interviews with public health experts in municipalities in Bahia. Data were sampled for Bahia’s Salvador microregion, a population of approximately 14 million. Gastroenteritis hospitalization rates among children aged less than five years were evaluated. Declining hospitalization rates were associated with increasing coverage by the PSF (P=0.02). After multivariate adjustment for garbage collection, sanitation, and water supply, evidence of this association was no longer significant (P=0.28). Qualitative analysis confirmed these findings with a framework of health determinants, proximal causes, and health system effects. The PSF, with other public health efforts, was associated with decreasing gastroenteritis hospitalizations in children. Incentives for providers and more patient-centered health delivery may contribute to strengthening the PSF’s role in improving primary health care outcomes in Brazil. PMID:23932060

Statins and Voriconazole Induce Programmed Cell Death in Acanthamoeba castellanii

PubMed Central

López-Arencibia, Atteneri; Sifaoui, Ines; Reyes-Batlle, María; Valladares, Basilio; Martínez-Carretero, Enrique; Piñero, José E.; Maciver, Sutherland K.; Lorenzo-Morales, Jacob

2015-01-01

Members of the genus Acanthamoeba are facultative pathogens of humans, causing a sight-threatening keratitis and a life-threatening encephalitis. In order to treat those infections properly, it is necessary to target the treatment not only to the trophozoite but also to the cyst. Furthermore, it may be advantageous to avoid parasite killing by necrosis, which may induce local inflammation. We must also avoid toxicity of host tissue. Many drugs which target eukaryotes are known to induce programmed cell death (PCD), but this process is poorly characterized in Acanthamoeba. Here, we study the processes of programmed cell death in Acanthamoeba, induced by several drugs, such as statins and voriconazole. We tested atorvastatin, fluvastatin, simvastatin, and voriconazole at the 50% inhibitory concentrations (IC50s) and IC90s that we have previously established. In order to evaluate this phenomenon, we investigated the DNA fragmentation, one of the main characteristics of PCD, with quantitative and qualitative techniques. Also, the changes related to phosphatidylserine exposure on the external cell membrane and cell permeability were studied. Finally, because caspases are key to PCD pathways, caspase activity was evaluated in Acanthamoeba. All the drugs assayed in this study induced PCD in Acanthamoeba. To the best of our knowledge, this is the first study where PCD induced by drugs is described quantitatively and qualitatively in Acanthamoeba. PMID:25733513

Multiple perspectives on groupwork with children of battered women.

PubMed

Peled, E; Edleson, J L

1992-01-01

As this century ends there continues to be little public attention devoted to child witnesses of woman abuse and few social programs exist to meet their needs. This article presents the findings of a qualitative evaluation of a group program for children of battered women. Interviews were conducted with 16 mothers, 5 fathers, 9 group leaders, and 30 children who participated in 8 groups. Data also included observations of one complete group process (10 groups and 3 family sessions). Both intended and unintended results are presented and recommendations for practice are discussed.

How has problem based learning fared in Pakistan?

PubMed

Mahmud, Waqas; Hyder, Omar

2012-10-01

To conduct a systematic review of primary research in undergraduate medical education in Pakistan in order to evaluate PBL programs, examine outcomes and competencies influenced by PBL, and compare them with conventional learning (lecture based learning, LBL). Qualitative content analysis. Rawalpindi Medical College, Rawalpindi, from June 2010 - February 2011. Literature was searched using online resources. Studies evaluating outcomes influenced by PBL, or comparing PBL with lecture based learning (LBL) were selected. Due to heterogeneity, a qualitative content analysis was performed in which studies were classified according to the methods of assessment; results were then summarized by outcome and frequencies were calculated. Eleven studies were included. Apart from knowledge acquisition, students gave high ratings to PBL in selected outcomes, alone, and in comparison with LBL. There was a disagreement among results of studies that evaluated knowledge acquisition alone. Based on student perceptions, PBL has many advantages. However, the results of this review are limited due to heterogeneity and methodological weakness of studies, specially the studies that compared exam scores to assess knowledge acquisition.

Qualitative Evaluation of a Physical Activity Health Promotion Programme for People with Intellectual Disabilities in a Group Home Setting

ERIC Educational Resources Information Center

Dixon-Ibarra, A.; Driver, S.; Nery-Hurwit, M.; VanVolkenburg, H.

2018-01-01

Background: There is a lack of health promotion programming designed to change the physical activity environment of the group home setting. The Menu-Choice programme assists staff in creating physical activity goals alongside residents with intellectual disabilities and provides strategies to incorporate activity into the group home schedule. The…

Achieving Dramatic School Improvement: An Exploratory Study. A Cross-Site Analysis from the Evaluation of Comprehensive School Reform Program Implementation and Outcomes Study

ERIC Educational Resources Information Center

Aladjem, Daniel K.; Birman, Beatrice F.; Orland, Martin; Harr-Robins, Jenifer; Heredia, Alberto; Parrish, Thomas B.; Ruffini, Stephen J.

2010-01-01

This exploratory study describes approaches to improving schools through retrospective, in-depth qualitative case studies. To select schools to be examined, the authors sought to identify Comprehensive School Reform (CSR) schools demonstrating two distinctive patterns of improved student achievement between 2000 and 2005, rapid-improvement (i.e.,…

Small Groups, Significant Impact: A Review of Peer-Led Team Learning Research with Implications for STEM Education Researchers and Faculty

ERIC Educational Resources Information Center

Wilson, Sarah Beth; Varma-Nelson, Pratibha

2016-01-01

Peer-led team learning (PLTL) research has expanded from its roots in program evaluation of student success measures in Workshop Chemistry to a spectrum of research questions and qualitative, quantitative, and mixed methods study approaches. In order to develop recommendations for PLTL research and propose best practices for faculty who will…

Development of a theory-based (PEN-3 and Health Belief Model), culturally relevant intervention on cervical cancer prevention among Latina immigrants using intervention mapping.

PubMed

Scarinci, Isabel C; Bandura, Lisa; Hidalgo, Bertha; Cherrington, Andrea

2012-01-01

The development of efficacious theory-based, culturally relevant interventions to promote cervical cancer prevention among underserved populations is crucial to the elimination of cancer disparities. The purpose of this article is to describe the development of a theory-based, culturally relevant intervention focusing on primary (sexual risk reduction) and secondary (Pap smear) prevention of cervical cancer among Latina immigrants using intervention mapping (IM). The PEN-3 and Health Belief Model provided theoretical guidance for the intervention development and implementation. IM provides a logical five-step framework in intervention development: delineating proximal program objectives, selecting theory-based intervention methods and strategies, developing a program plan, planning for adoption in implementation, and creating evaluation plans and instruments. We first conducted an extensive literature review and qualitatively examined the sociocultural factors associated with primary and secondary prevention of cervical cancer. We then proceeded to quantitatively validate the qualitative findings, which led to development matrices linking the theoretical constructs with intervention objectives and strategies as well as evaluation. IM was a helpful tool in the development of a theory-based, culturally relevant intervention addressing primary and secondary prevention among Latina immigrants.

Development of a Theory-Based (PEN-3 and Health Belief Model), Culturally Relevant Intervention on Cervical Cancer Prevention Among Latina Immigrants Using Intervention Mapping

PubMed Central

Scarinci, Isabel C.; Bandura, Lisa; Hidalgo, Bertha; Cherrington, Andrea

2014-01-01

The development of efficacious theory-based, culturally relevant interventions to promote cervical cancer prevention among underserved populations is crucial to the elimination of cancer disparities. The purpose of this article is to describe the development of a theory-based, culturally relevant intervention focusing on primary (sexual risk reduction) and secondary (Pap smear) prevention of cervical cancer among Latina immigrants using intervention mapping (IM). The PEN-3 and Health Belief Model provided theoretical guidance for the intervention development and implementation. IM provides a logical five-step framework in intervention development: delineating proximal program objectives, selecting theory-based intervention methods and strategies, developing a program plan, planning for adoption in implementation, and creating evaluation plans and instruments. We first conducted an extensive literature review and qualitatively examined the socio-cultural factors associated with primary and secondary prevention of cervical cancer. We then proceeded to quantitatively validate the qualitative findings, which led to development matrices linking the theoretical constructs with intervention objectives and strategies as well as evaluation. IM was a helpful tool in the development of a theory-based, culturally relevant intervention addressing primary and secondary prevention among Latina immigrants. PMID:21422254

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

PubMed

Badran, Hani; Pluye, Pierre; Grad, Roland

2017-03-14

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. ©Hani Badran, Pierre Pluye, Roland Grad. Originally published in JMIR Medical Education (http://mededu.jmir.org), 14.03.2017.

Evaluation of two CD-ROMs from a series on cell biology.

PubMed

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation.

Evaluation of Two CD-ROMs from a Series on Cell Biology

PubMed Central

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation. PMID:14673491

Feasibility study of a family-focused intervention to improve outcomes for children with FASD.

PubMed

Reid, Natasha; Dawe, Sharon; Harnett, Paul; Shelton, Doug; Hutton, Lauren; O'Callaghan, Frances

2017-08-01

Growing evidence shows that children with fetal alcohol spectrum disorder (FASD) can benefit from interventions, and specifically interventions focused on improving self-regulation. However, novel ways of improving outcomes for children with FASD need further investigation so that programs target not only the individual child but also the family context, which includes the parent-child relationship. The current study aimed to evaluate the feasibility of an adapted version of the Parents under Pressure (PuP) program that addresses self-regulatory processes, through improving the parent-child relationship and the use of mindfulness-based strategies for both children and parents. This was a mixed methods study. Feasibility was examined by evaluating recruitment, data collection/outcome measures, and intervention procedures. The study used a phenomenological approach to obtain qualitative information from caregivers and a single-case experimental design to evaluate the preliminary participant responses to the intervention. Two out of three families completed treatment. The recruitment and intervention procedures were found to be suitable for and acceptable to the families involved. Some concerns were identified regarding the outcome measures that would need to be addressed in future research. Quantitative and qualitative outcomes were positive. The results provide preliminary support for the feasibility of an adapted version of the PuP program. Thus, offering a potential multi-component option, that aims to improve self-regulatory skills for children with FASD, through focusing on improving the parent-child relationship and incorporating mindfulness-based techniques for both parents and children. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Qualitative Evaluation of Engagement and Attrition in a Nurse Home Visiting Program: From the Participant and Provider Perspective.

PubMed

Beasley, Lana O; Ridings, Leigh E; Smith, Tyler J; Shields, Jennifer D; Silovsky, Jane F; Beasley, William; Bard, David

2018-05-01

Beginning parenting programs in the prenatal and early postnatal periods have a large potential for impact on later child and maternal outcomes. Home-based parenting programs, such as the Nurse Family Partnership (NFP), have been established to help address this need. Program reach and impact is dependent on successful engagement of expecting mothers with significant risks; however, NFP attrition rates remain high. The current study qualitatively examined engagement and attrition from the perspectives of NFP nurses and mothers in order to identify mechanisms that enhance service engagement. Semi-structured interviews were conducted in focus groups composed of either engaged (27 total mothers) or unengaged (15 total mothers) mothers from the NFP program. NFP nurses (25 total nurses) were recruited for individual semi-structured interviews. Results suggest that understanding engagement in the NFP program requires addressing both initial and sustained engagement. Themes associated with enhanced initial engagement include nurse characteristics (e.g., flexible, supportive, caring) and establishment of a solid nurse-family relationship founded on these characteristics. Factors impacting sustained engagement include nurse characteristics, provision of educational materials on child development, individualized services for families, and available family support. Identified barriers to completing services include competing demands and lack of support. Findings of this study have direct relevance for workforce planning, including hiring and training through integrating results regarding effective nurse characteristics. Additional program supports to enhance parent engagement may be implemented across home-based parenting programs in light of the current study's findings.

Advancing the study of violence against women using mixed methods: integrating qualitative methods into a quantitative research program.

PubMed

Testa, Maria; Livingston, Jennifer A; VanZile-Tamsen, Carol

2011-02-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women's sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Universal Free School Breakfast: A Qualitative Process Evaluation According to the Perspectives of Senior Stakeholders.

PubMed

Harvey-Golding, Louise; Donkin, Lynn Margaret; Defeyter, Margaret Anne

2016-01-01

In the last decade, the provision of school breakfast has increased significantly in the UK. However, there is an absence of knowledge regarding senior stakeholder views on the processes and potential outcomes on different groups, within the communities served by school breakfast programs. The purpose of this study was to examine the views and experiences of senior level stakeholders and thereby provide an original qualitative contribution to the research. A sample of senior level stakeholders was recruited, including senior officers, directors, and elected members, from within a Local Authority (LA) involved in the leadership, implementation and delivery of a council-wide universal free school breakfast (UFSB) program, and from the senior staff body of mainstream primary and special schools, participating in the program. A grounded theory analysis of the data collected identified issues encountered in the implementation and delivery, and views on the funding and future of a USFB program, in addition to perceived outcomes for children, parents, families, schools, and the wider community. The results refer to both positive and negative issues and implications associated with the program, according to the perspectives of senior level stakeholders. Perceived positive outcomes included benefits to children, families, schools, and the community. For instance, alleviating hunger, improving health outcomes, and conferring financial benefits, with the potential to cumulate in overall improvements in educational, social, and behavioral outcomes. Reported negative implications included the absence of an effective communication strategy in implementing the USFB program; in addition to concerns about the impacts of "double-breakfasting" on obesity levels among children, particularly in less deprived communities. Findings were validated using theoretical sampling and saturation, triangulation methods, member checks, and inter-rater reliability measures. In presenting these findings, this paper provides a unique qualitative insight into the processes, issues and outcomes of a council-wide UFSB program within a socioeconomically deprived community, according to the perceptions of senior level stakeholders.

The importance of matching the evaluation population to the intervention population: Using Medicaid data to reach hard-to-reach intervention populations.

PubMed

Askelson, Natoshia M; Golembiewski, Elizabeth H; Baquero, Barbara; Momany, Elizabeth T; Friberg, Julia; Montgomery, Doris

2017-02-01

Subject recruitment is a challenge for researchers and evaluators, particularly with populations that are traditionally hard to reach and involve in research, such as low-income and minority groups. However, when the evaluation sample does not reflect a program's intended audience, the discrepancy may lead to evaluation results that are not valid for that audience. We conducted evaluation activities for a state Supplemental Nutrition Assistance Program-Education (SNAP-Ed) intervention that promotes consumption of fruits and vegetables (F&V) in low-income areas. Previous program evaluations efforts had failed to obtain a sufficient proportion of individuals identified as low-income based on their participation in SNAP. We used state Medicaid data as a means of identifying low-income families to recruit for a telephone survey (n=311) and an in-depth qualitative interview (n=30) that we designed for the program being evaluated. We chose to focus on the dynamics of parent-child communication around F&V because we considered this previously unevaluated component of the intervention vital to understanding program effectiveness. Our results indicated that the Medicaid database provided an appropriate sample and that parents reported frequent F&V requests from their children. Parents also reported that they would positively respond to requests in many different settings, such as grocery stores (92.6%), restaurants (88.1%), and fast food restaurants (80.4%). Copyright © 2016 Elsevier Ltd. All rights reserved.

A Qualitative Examination of Challenges Influencing Doctoral Students in an Online Doctoral Program

ERIC Educational Resources Information Center

Deshpande, Anant

2016-01-01

The main purpose of the study was to investigate the challenges faced by students in completion of an online doctoral program at the University of Liverpool, Online Doctoral Business Administration program. We analyse the responses of 91 doctoral students in an online DBA program. Based on the exploratory qualitative study themes were developed…

A health equity critique of social marketing: where interventions have impact but insufficient reach.

PubMed

Langford, Rebecca; Panter-Brick, Catherine

2013-04-01

Health interventions increasingly rely on formative qualitative research and social marketing techniques to effect behavioural change. Few studies, however, incorporate qualitative research into the process of program evaluation to understand both impact and reach: namely, to what extent behaviour change interventions work, for whom, in what contexts, and why. We reflect on the success of a community-based hygiene intervention conducted in the slums of Kathmandu, Nepal, evaluating both maternal behaviour and infant health. We recruited all available mother-infant pairs (n = 88), and allocated them to control and intervention groups. Formative qualitative research on hand-washing practices included structured observations of 75 mothers, 3 focus groups, and 26 in-depth interviews. Our intervention was led by Community Motivators, intensively promoting hand-washing-with-soap at key junctures of food and faeces contamination. The 6-month evaluation period included hand-washing and morbidity rates, participant observation, systematic records of fortnightly community meetings, and follow-up interviews with 12 mothers. While quantitative measures demonstrated improvement in hand-washing rates and a 40% reduction in child diarrhoea, the qualitative data highlighted important equity issues in reaching the ultra-poor. We argue that a social marketing approach is inherently limited: focussing on individual agency, rather than structural conditions constraining behaviour, can unwittingly exacerbate health inequity. This contributes to a prevention paradox whereby those with the greatest need of a health intervention are least likely to benefit, finding hand-washing in the slums to be irrelevant or futile. Thus social marketing is best deployed within a range of interventions that address the structural as well as the behavioural and cognitive drivers of behaviour change. We conclude that critiques of social marketing have not paid sufficient attention to issues of health equity, and demonstrate how this can be addressed with qualitative data, embedded in both the formative and evaluative phases of a health intervention. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Formative Evaluation of Two Evidence-Based Psychotherapies for PTSD In VA Residential Treatment Programs

PubMed Central

Cook, Joan M.; O’Donnell, Casey; Dinnen, Stephanie; Bernardy, Nancy; Rosenheck, Robert; Desai, Rani

2013-01-01

Thirty-eight U.S. Department of Veterans Affairs (VA) residential treatment programs for posttraumatic stress disorder (PTSD) participated in a formative evaluation of their programmatic services, including evidenced-based treatments (EBTs), between July 2008 and March 2011. Face-to-face qualitative interviews were conducted with over 250 staff by an independent psychologist along with on-site participant observations. This evaluation coincided with a national VA dissemination initiative to train providers in two EBTs for PTSD, Prolonged Exposure (PE) and Cognitive Processing Therapy (CPT). A substantial proportion of eligible (based on professional background) residential treatment providers received training in PE (37.4%) or CPT (64.2%), with 9.5% completing case consultation or becoming national trainers in each therapy respectively. In semi-structured interviews, providers reported that their clinical programs had adopted these EBTs at varying levels ranging from no adoption to every patient receiving the full protocol. Suggestions for improving the adoption of PE and CPT are noted, including distilling manualized treatments to essential common elements. PMID:23417875

Developing the leadership skills of new graduates to influence practice environments: a novice nurse leadership program.

PubMed

Dyess, Susan; Sherman, Rose

2011-01-01

The authors of the recently published Institute of Medicine on the Future of Nursing report emphasized the importance of preparing nurses to lead change to advance health care in the United States. Other scholars linked practice environments to safe quality care. In order for nurses to fully actualize this role in practice environments, they need to possess leadership skills sets that identify and respond to challenges faced. New nurses are no exception. This article presents a program with a 5-year track record that is designed to support transition and enhance the skill sets of leadership for new nurses in their first year of practice. Qualitative and quantitative evaluation measurements at baseline and postprogram provided data for evaluation of the first 4 cohorts in the program. Evaluative outcomes presented indicate that new nurses gained leadership and translational research skills that contributed to their ability to influence practice environments. Nonetheless, practice environments continue to need improvement and ongoing leadership from all levels of nursing must be upheld.

Community-based HIV education and prevention workers respond to a changing environment.

PubMed

Guenter, Dale; Majumdar, Basanti; Willms, Dennis; Travers, Robb; Browne, Gina; Robinson, Greg

2005-01-01

The purpose of this study was to understand the culture, values, skills and activities of staff involved in education and prevention activities in community-based AIDS Service Organizations (ASOs) in Ontario, Canada, and to understand the role of evaluation research in their prevention programming. In this qualitative study, 33 staff members from 11 ASOs participated in semi-structured interviews that were analyzed using the grounded theory approach. ASO staff experience tension between a historical grassroots organizational culture characterized by responsiveness and relevance and a more recent culture of professionalization. Target populations have changed from being primarily gay men to an almost unlimited variety of communities. Program emphasis has shifted from education and knowledge dissemination to a broadly based mandate of health promotion, community development, and harm reduction. Integration of evidence of effectiveness, social-behavioral theory, or systematic evaluation is uncommon. Understanding these points of tension is important for the nursing profession when it is engaged with ASOs in programming or evaluation research.

A process evaluation of a social cognitive theory-based childhood obesity prevention intervention: the Comics for Health program.

PubMed

Branscum, Paul; Sharma, Manoj; Wang, Lihshing Leigh; Wilson, Bradley; Rojas-Guyler, Liliana

2013-03-01

Process evaluations are an often overlooked yet essential component of health promotion interventions. This study reports the results of a comprehensive process evaluation for the "Comics for Health" program, a childhood obesity prevention intervention implemented at 12 after-school programs. Qualitative and quantitative process data were collected using surveys, field notes, and open-item questionnaires, which assessed program fidelity, dose delivered, dose received, reach, recruitment, and context. Triangulation of methods was also employed to better understand how the program was implemented and received by the facilitator, staff members, and children in the program. Results indicated that program implementation had an almost perfect rate of fidelity with most lessons recording 100% tasks completed. Lessons were implemented in their intended order and lasted approximately 30 minutes as planned. After-school staff members reported that the program was well received by children, and this program should be replicated in the future. Attendance records showed that a majority of the children attended each lesson on the initial day of delivery (70.4%) and informal make-up lessons were implemented to compensate for the other children. Finally, several known sources of contamination were found such as past and concurrent exposure to similar health promotion interventions, which could potentially influence study outcomes. These findings will be used to help explain the results of this intervention and make recommendations for future intervention efforts.

[Design, implementation and evaluation of a health education program for the elderly].

PubMed

Pino, Margarita; Ricoy, Maria Carmen; Portela, Julio

2010-09-01

The objective was to design, implement and evaluate a health education program, using the analysis of the habits that harm the health of people over 65 years old. An evaluative research was carried out from a multiple case study in the North-West area of Spain, combining both the quantitative and the qualitative approach. A questionnaire and interview were used as tools for data collection. The elderly take a lot of medicines and also treat themselves. A small group smoke and drink alcohol. Over 25% have sedentary habits and their average body mass rate was 30.55. The implementation of the programme has significantly influenced their quality of life. Elderly people have deep rooted unhealthy habits. The achievement of educational contents improved their quality of life. However, they are reluctant to assume new habits, even though they are healthy.

Technology acceptance and quality of life of the elderly in a telecare program.

PubMed

Chou, Chun-Chen; Chang, Chi-Ping; Lee, Ting-Ting; Chou, Hsueh-Fen; Mills, Mary Etta

2013-07-01

As information and communication technology applied to telecare has become a trend in elder care services, evaluation of the program is vital for further program design and development. This study evaluated the variables influencing the use of a telecare service program by the elderly. A questionnaire survey was used to explore the relationship between quality of life and technology acceptance of a telecare program in Taiwan. In addition, open-ended questions were used to elicit qualitative information regarding the experience of technology use. The results revealed that elderly persons with better social welfare status and health condition, who used the device frequently, had higher quality of life and accepted technology use. The correlation results also indicated that elderly persons who perceived telecare as useful in solving health problems, had the intention to use the program, and were willing to continue use, also had a better perception toward quality of life regarding their interpersonal relationships and living environment. Nonetheless, cost may be an issue that will impede their willingness to use the technology in care service.

Flight test summary of modified fuel systems

NASA Technical Reports Server (NTRS)

Barrett, B. G.

1976-01-01

Two different aircraft designs, each with two modified fuel control systems, were evaluated. Each aircraft was evaluated in a given series of defined ground and flight conditions while quantitative and qualitative observations were made. During this program, some ten flights were completed, and a total of about 13 hours of engine run time was accumulated by the two airplanes. The results of these evaluations with emphasis on the operational and safety aspects were analyzed. Ground tests of the engine alone were not able to predict acceptable limiting lean mixture settings for the flight envelopes of the Cessna Models 150 and T337.

Understanding of evaluation capacity building in practice: a case study of a national medical education organization.

PubMed

Sarti, Aimee J; Sutherland, Stephanie; Landriault, Angele; DesRosier, Kirk; Brien, Susan; Cardinal, Pierre

2017-01-01

Evaluation capacity building (ECB) is a topic of great interest to many organizations as they face increasing demands for accountability and evidence-based practices. ECB is about building the knowledge, skills, and attitudes of organizational members, the sustainability of rigorous evaluative practices, and providing the resources and motivations to engage in ongoing evaluative work. There exists a solid foundation of theoretical research on ECB, however, understanding what ECB looks like in practice is relatively thin. Our purpose was to investigate what ECB looks like firsthand within a national medical educational organization. The context for this study was the Acute Critical Events Simulation (ACES) organization in Canada, which has successfully evolved into a national educational program, driven by physicians. We conducted an exploratory qualitative study to better understand and describe ECB in practice. In doing so, interviews were conducted with program leaders and instructors so as to gain a richer understanding of evaluative processes and practices. A total of 21 individuals participated in the semistructured interviews. Themes from our qualitative data analysis included the following: evaluation knowledge, skills, and attitudes, use of evaluation findings, shared evaluation beliefs and commitment, evaluation frameworks and processes, and resources dedicated to evaluation. The national ACES organization was a useful case study to explore ECB in practice. The ECB literature provided a solid foundation to understand the purpose and nuances of ECB. This study added to the paucity of studies focused on examining ECB in practice. The most important lesson learned was that the organization must have leadership who are intrinsically motivated to employ and use evaluation data to drive ongoing improvements within the organization. Leaders who are intrinsically motivated will employ risk taking when evaluation practices and processes may be somewhat unfamiliar. Creating and maintaining a culture of data use and ongoing inquiry have enabled national ACES to achieve a sustainable evaluation practice.

Teaching medical students how to teach: a national survey of students-as-teachers programs in U.S. medical schools.

PubMed

Soriano, Rainier P; Blatt, Benjamin; Coplit, Lisa; CichoskiKelly, Eileen; Kosowicz, Lynn; Newman, Linnie; Pasquale, Susan J; Pretorius, Richard; Rosen, Jonathan M; Saks, Norma S; Greenberg, Larrie

2010-11-01

A number of U.S. medical schools started offering formal students-as-teachers (SAT) training programs to assist medical students in their roles as future teachers. The authors report results of a national survey of such programs in the United States. In 2008, a 23-item survey was sent to 130 MD-granting U.S. schools. Responses to selective choice questions were quantitatively analyzed. Open-ended questions about benefits and barriers to SAT programs were given qualitative analyses. Ninety-nine U.S. schools responded. All used their medical students as teachers, but only 44% offered a formal SAT program. Most (95%) offered formal programs in the senior year. Common teaching strategies included small-group work, lectures, role-playing, and direct observation. Common learning content areas were small-group facilitation, feedback, adult learning principles, and clinical skills teaching. Assessment methods included evaluations from student-learners (72%) and direct observation/videotaping (59%). From the qualitative analysis, benefit themes included development of future physician-educators, enhancement of learning, and teaching assistance for faculty. Obstacles were competition with other educational demands, difficulty in faculty recruitment/retention, and difficulty in convincing others of program value. Formal SAT programs exist for 43 of 99 U.S. medical school respondents. Such programs should be instituted in all schools that use their students as teachers. National teaching competencies, best curriculum methods, and best methods to conduct skills reinforcement need to be determined. Finally, the SAT programs' impacts on patient care, on selection decisions of residency directors, and on residents' teaching effectiveness are areas for future research.

Changes in medicine course curricula in Brazil encouraged by the Program for the Promotion of Medical School Curricula (PROMED)

PubMed Central

Souza, Patrícia Alves de; Zeferino, Angélica Maria Bicudo; Ros, Marco Da Aurélio

2008-01-01

Background The Program for the Promotion of Changes in Medical School Curricula (PROMED) was developed by the Brazilian Ministries of Health and Education. The objective of this program was to finance the implementation of changes to the curricula of medical schools directed towards the Brazilian national healthcare system (SUS). This paper reports research carried out together with the coordinators responsible for the PROMED of each medical school approved, in which interviews were used to evaluate whether this financial support succeeded in stimulating changes. The aim of this study was to evaluate the impact of this program three years after implementation in the universities that received funding. Methods The 19 course coordinators of the medical schools in which the PROMED project was implemented were interviewed using a questionnaire containing 12 questions for qualitative analysis. This paper focuses partially on the reports of the results of this qualitative analysis. Laurence Bardin's. Results The universities interviewed were found to have some common concerns: the decoupling of basic and professional training difficulties in achieving proximity to the network of services; insufficient funding; and the emphasis of most teachers being on teaching hospitals and specialization. These findings indicate that the direction of curriculum reform (PROMED) is toward providing a targeted training for this system. Conclusion The interviewees were aware that this program would trigger future changes in all aspects of healthcare and represents an ongoing challenge to the academic field. PROMED provided the momentum for change in the nature of medical training in Brazil and was seen as powerful enough to override other processes and as a basis for guidance regarding the methodology, pedagogical approach and scenarios of practical experience. PMID:19038043

A qualitative evaluation of scalpel skill teaching of podiatry students.

PubMed

Causby, Ryan S; McDonnell, Michelle N; Reed, Lloyd; Fryer, Caroline E; Hillier, Susan L

2017-01-01

Degrees in health disciplines need a balance of theoretical knowledge and sufficient clinical practice to meet registration requirements, in particular those requiring specialist skills such as the use of scalpels and other small instruments, such as podiatry. However, despite this requirement there is a scarcity of literature and research to inform teaching of these particular manual clinical skills. Therefore, the aims of this study were to determine the current approaches being used to teach manual skills, in particular scalpel skills, in university podiatry programs in Australia and New Zealand, and to explore what issues, challenges and innovations exist. A qualitative study, consisting of semi-structured interviews with staff at eight university podiatry programs in Australia and New Zealand was undertaken to determine how these skills are taught and evaluated, and how poor performers are managed. A conventional content analysis technique was used to analyse and code interview data, with the resultant categories reported. Approaches to teaching manual clinical skills, in particular scalpel skills, appear to be consistent between university programs in Australia and New Zealand in utilising didactic-style content, demonstration, physical practice on inanimate objects and real skin, and often the use of supplementary audio-visual material. The main reported differences between programs were in methods and processes of practice, with controversy regarding the use of inanimate objects versus real skin for practice. Despite a lack of research and literature surrounding this topic, the approach to teaching is relatively consistent between programs with greatest disparity being the structure and duration of practice. Key issues for teaching staff in teaching manual skills were students' clinical exposure, motivation, levels of anxiety and dexterity.

Persistence of elementary programming skills

NASA Astrophysics Data System (ADS)

Bennedsen, Jens; Caspersen, Michael E.

2012-06-01

Programming is recognised as one of seven grand challenges in computing education and attracts much attention in computing education research. Most research in the area concerns teaching methods, educational technology and student understanding/misconceptions. Typically, evaluation of learning outcome takes place during or immediately following the educational activity. In this research, we conduct a qualitative investigation of sustainability of programming competence by studying the effect of recalling programming competence long time after the educational activity has taken place. Our population consists of 10 students who have taken an introductory object-oriented programming course 3, 15 or 27 months prior to our study. None of the students have been exposed to programming in the intervening period. As expected, our research shows that syntactical issues in general hinder immediate programming productivity, but more interestingly it also indicate that a tiny retraining activity and simple guidelines is enough to recall programming competence and overcome syntactical issues.

MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES.

PubMed

Semple, Randye J; Droutman, Vita; Reid, Brittany Ann

2017-01-01

Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment , and Wellness and Resilience Program . We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations.

MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES

PubMed Central

Semple, Randye J.; Droutman, Vita; Reid, Brittany Ann

2016-01-01

Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment, and Wellness and Resilience Program. We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations. PMID:28458403

ADVANCING THE STUDY OF VIOLENCE AGAINST WOMEN USING MIXED METHODS: INTEGRATING QUALITATIVE METHODS INTO A QUANTITATIVE RESEARCH PROGRAM

PubMed Central

Testa, Maria; Livingston, Jennifer A.; VanZile-Tamsen, Carol

2011-01-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women’s sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided. PMID:21307032

A Qualitative Study of College-Based Peace Education Programs

ERIC Educational Resources Information Center

Boudreau, Will

2017-01-01

The purpose of this exploratory research study was to examine the perceptions of seven northeast United States, college-based, Peace Education program directors regarding their respective programs' characteristics and the challenges they face. This qualitative study was designed to fill a gap in the literature by examining the perceptions of…

Listen to the children: kids' impressions of Who Do You Tell ™.

PubMed

Tutty, Leslie M

2014-01-01

School-based programs have been the central strategy to educate children about the serious nature of child sexual abuse in the hope of prevention or early intervention. Virtually all evaluations have been quantitative, seldom allowing children to directly comment on their experiences. This article presents the results of qualitative research with 116 students (51 boys and 65 girls) ranging from age 6 to 12 who had participated in the Who Do You Tell child sexual abuse education program. Ten focus groups were conducted with students in separate grades, from kindergarten through sixth grade, two to three months after program participation. The core themes that emerged from the focus group interviews are presented, as are implications for child sexual abuse prevention programs.

Attitudes about AIDS education and condom availability among parents of high school students in New York City: a focus group approach.

PubMed

Rafferty, Y; Radosh, A

1997-02-01

This paper describes parents' views of the New York City Public High School's AIDS Education and Condom Availability Program. It presents findings from 12 focus groups with 81 parents of students at six representative high schools. Focus groups were conducted as part of an independent, comprehensive 3-year evaluation of the program, consisting of both qualitative and quantitative components. Participants were mostly supportive of the program, citing intense concern about AIDS among adolescents, fear that teenagers do not adequately perceive themselves as being vulnerable, and personal experiences with infected relatives and friends. Implications of these findings for program development are discussed and recommendations for social policy changes are presented.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

Innovation in values based public health nursing student selection: A qualitative evaluation of candidate and selection panel member perspectives.

PubMed

McGraw, Caroline; Abbott, Stephen; Brook, Judy

2018-02-19

Values based recruitment emerges from the premise that a high degree of value congruence, or the extent to which an individual's values are similar to those of the health organization in which they work, leads to organizational effectiveness. The aim of this evaluation was to explore how candidates and selection panel members experienced and perceived innovative methods of values based public health nursing student selection. The evaluation was framed by a qualitative exploratory design involving semi-structured interviews and a group exercise. Data were thematically analyzed. Eight semi-structured interviews were conducted with selection panel members. Twenty-two successful candidates took part in a group exercise. The use of photo elicitation interviews and situational judgment questions in the context of selection to a university-run public health nursing educational program was explored. While candidates were ambivalent about the use of photo elicitation interviews, with some misunderstanding the task, selection panel members saw the benefits for improving candidate expression and reducing gaming and deception. Situational interview questions were endorsed by candidates and selection panel members due to their fidelity to real-life problems and the ability of panel members to discern value congruence from candidates' responses. Both techniques offered innovative solutions to candidate selection for entry to the public health nursing education program. © 2018 Wiley Periodicals, Inc.

Corporate Mentors and Undergraduate Students: A Qualitative Study of the Advancing Women in Construction Mentorship Program

ERIC Educational Resources Information Center

Eicher, Matthew

2013-01-01

In a conscious effort to combat the low enrollment of women in construction management, a program was created to retain women through a mentorship program--Advancing Women in Construction. A qualitative analysis, facilitated through a grounded theory approach, sought to understand if the program was indeed successful, and what value did the…

Effects of a self-management education program on self-efficacy in patients with COPD: a mixed-methods sequential explanatory designed study.

PubMed

Ng, Wai I; Smith, Graeme Drummond

2017-01-01

Self-management education programs (SMEPs) are potentially effective in the symptomatic management of COPD. Little is presently known about the effectiveness of these programs in Chinese COPD patients. The objective of this study was to evaluate the effectiveness of a specifically designed SMEP on levels of self-efficacy in Chinese patients with COPD. Based on the Medical Research Council framework for evaluating complex interventions, an exploratory phase randomized controlled trial was employed to examine the effects of an SMEP. Self-efficacy was the primary outcome using the COPD Self-efficacy Scale, measured at baseline and 6 months after the program. Qualitative data were sequentially collected from these patients via three focus groups to supplement the quantitative findings. The experimental group displayed significant improvement in their general self-efficacy ( Z =-2.44, P =0.015) and specifically in confronting 1) physical exertion ( Z =-2.57, P =0.01), 2) weather/environment effects ( Z =-2.63, P <0.001) and 3) intense emotions ( Z =-2.54, P =0.01). Three themes emerged from the focus groups: greater disease control, improved psychosocial well-being and perceived incapability and individuality. The connection of the quantitative and qualitative data demonstrated that individual perceptual constancy of patients could be a determining factor modulating the effectiveness of this type of intervention. These findings highlight the potential putative benefits of an SMEP in Chinese patients with COPD. Further attention should be given to cultural considerations when developing this type of intervention in Chinese populations with COPD and other chronic diseases.

NVivo 8 and consistency in data analysis: reflecting on the use of a qualitative data analysis program.

PubMed

Bergin, Michael

2011-01-01

Qualitative data analysis is a complex process and demands clear thinking on the part of the analyst. However, a number of deficiencies may obstruct the research analyst during the process, leading to inconsistencies occurring. This paper is a reflection on the use of a qualitative data analysis program, NVivo 8, and its usefulness in identifying consistency and inconsistency during the coding process. The author was conducting a large-scale study of providers and users of mental health services in Ireland. He used NVivo 8 to store, code and analyse the data and this paper reflects some of his observations during the study. The demands placed on the analyst in trying to balance the mechanics of working through a qualitative data analysis program, while simultaneously remaining conscious of the value of all sources are highlighted. NVivo 8 as a qualitative data analysis program is a challenging but valuable means for advancing the robustness of qualitative research. Pitfalls can be avoided during analysis by running queries as the analyst progresses from tree node to tree node rather than leaving it to a stage whereby data analysis is well advanced.

[Parental death in childhood: the state of theoretical knowledge and clinical challenges in the future].

PubMed

Mentec, Margaux; Flahault, Cécile

2015-03-01

Although children's psychological adaptation to parental cancer is a wide field for psycho-oncological research, few empirical studies target children bereavement specifically following parental cancer. In this paper, our purpose is to make a state of art about literature concerning parental death. Literature dealing with grief concerns psychopathological consequences of parental loss and most recently post-traumatic growth. Although references about support programs have emerged, few of these programs have been scientifically evaluated. This review underlines that more studies are needed with prospective quantitative and qualitative studies, in order to describe more precisely children bereavement process and long term effects of bereavement. Psychological support for other family members and evaluation of support programs seem to be critical to improve children adaptation to parental death. Copyright © 2015 Société Française du Cancer. Published by Elsevier Masson SAS. All rights reserved.

PRACA Enhancement Pilot Study Report: Engineering for Complex Systems Program (formerly Design for Safety), DFS-IC-0006

NASA Technical Reports Server (NTRS)

Korsmeyer, David; Schreiner, John

2002-01-01

This technology evaluation report documents the findings and recommendations of the Engineering for Complex Systems Program (formerly Design for Safety) PRACA Enhancement Pilot Study of the Space Shuttle Program's (SSP's) Problem Reporting and Corrective Action (PRACA) System. A team at NASA Ames Research Center (ARC) performed this Study. This Study was initiated as a follow-on to the NASA chartered Shuttle Independent Assessment Team (SIAT) review (performed in the Fall of 1999) which identified deficiencies in the current PRACA implementation. The Pilot Study was launched with an initial qualitative assessment and technical review performed during January 2000 with the quantitative formal Study (the subject of this report) started in March 2000. The goal of the PRACA Enhancement Pilot Study is to evaluate and quantify the technical aspects of the SSP PRACA systems and recommend enhancements to address deficiencies and in preparation for future system upgrades.

A qualitative assessment of program characteristics for preventing secondary conditions in individuals with fetal alcohol spectrum disorders.

PubMed

Patrenko, Christie L M; Tahir, Naira; Mahoney, Erin C; Chin, Nancy P

2014-01-01

Fetal alcohol spectrum disorders (FASD) are a major public health problem that affects 2 to 5 percent of the population. Individuals with FASD are at high risk for secondary conditions, such as mental health problems, school disruptions, and trouble with the law. Evidence-based intervention programs are needed to prevent and treat secondary conditions in this population. The purpose of this study was to identify intervention program characteristics for preventing secondary conditions in individuals with FASD from the perspectives of parents and service providers. This qualitative study utilized a phenomenological approach to identify program characteristics for preventing secondary conditions. Twenty-five parents of children (ages 3 to 33) with FASD and 18 service providers participated in focus groups or individual interviews. Data was systematically analyzed using a framework approach. Themes did not differ by participant type. Participants emphasized five primary characteristics of intervention programs for individuals with FASD. Programs need to 1) be available to individuals across the lifespan, 2) have a prevention focus, 3) be individualized, 4) be comprehensive, and 5) be coordinated across systems and developmental stages. Participants discussed a variety of specific intervention strategies for each developmental stage and setting. Program characteristics identified in this study are consistent with a positive behavior support framework. This framework is discussed in the context of research on existing interventions for individuals with FASD, and recommendations for future intervention development and evaluation are highlighted.

Evaluation of a Community-Based Program That Integrates Joyful Movement Into Fall Prevention for Older Adults

PubMed Central

Carlucci, Celeste; Kardachi, Julie; Bradley, Sara M.; Prager, Jason; Wyka, Katarzyna

2018-01-01

Background: Despite the development of evidence-based fall-prevention programs, there remains a need for programming that will engage older adults in real-world settings. Objective: This study aimed to evaluate a community-based group program that integrates joyful movement into fall prevention. The curriculum emphasizes a positive experience of movement, cultivating a healthy body image, and retraining of biomechanics. Design: Program evaluation was conducted using a one-group pre–post test study design. Key outcomes were functional balance and confidence. Qualitative feedback was gathered at the final class sessions. Results: Two hundred fifteen older adults enrolled at four sites over the period from 2010 to 2014. Among 86 participants who provided feedback, most credited the program for an increased sense of optimism and/or confidence (70%), and better walking ability (50%). Among 102 participants who completed both initial and final assessments, there was evidence of significant improvements on the Functional Reach Test (d = .60, p < .001) and Modified Falls Efficacy Scale (d = .17, p < .001). Conclusion: A joyful movement curriculum is acceptable to older participants, and they show improvements in functional balance and confidence. Future research should examine whether the positive changes encouraged by joyful movement lead to lasting reductions in fall risk and additional health benefits. PMID:29796405

Evaluation of a health sciences internship for Latino and Native American library students

PubMed Central

Keselman, Alla; Quasem, Sanjana; Kelly, Janice E.; Dutcher, Gale A.

2016-01-01

Purpose This paper presents a qualitative evaluation of a graduate-level internship for Latino and Native American library science students or students who are interested in serving those populations. Methods The authors analyzed semi-structured interviews with thirteen internship program graduates or participants. Results The analysis suggests that the program increased participants' interest in health sciences librarianship and led to improved career opportunities, both in health sciences libraries and other libraries with health information programming. It also highlights specific factors that are likely to contribute to the strength of career pipeline programs aiming to bring Latino and Native American students and students who are interested in serving those communities into health librarianship. Conclusions Exposing graduate-level interns to a broad range of health sciences librarianship tasks, including outreach to Latino and Native American communities and formal mentorship, is likely to maximize interns' interests in both health sciences librarianship and service to these communities. PMID:27822159

Does Implementation Follow Design? A Case Study of a Workplace Health Promotion Program Using the 4-S Program Design and the PIPE Impact Metric Evaluation Models.

PubMed

Äikäs, Antti Hermanni; Pronk, Nicolaas P; Hirvensalo, Mirja Hannele; Absetz, Pilvikki

2017-08-01

The aim of this study was to describe the content of a multiyear market-based workplace health promotion (WHP) program and to evaluate design and implementation processes in a real-world setting. Data was collected from the databases of the employer and the service provider. It was classified using the 4-S (Size, Scope, Scalability, and Sustainability) and PIPE Impact Metric (Penetration, Implementation) models. Data analysis utilized both qualitative and quantitative methods. Program design covered well the evidence-informed best practices except for clear path toward sustainability, cooperation with occupational health care, and support from middle-management supervisors. The penetration rate among participants was high (99%) and majority (81%) of services were implemented as designed. Study findings indicate that WHP market would benefit the use of evidence-based design principles and tendentious decisions to anticipate a long-term implementation process already during the planning phase.

Does Implementation Follow Design? A Case Study of a Workplace Health Promotion Program Using the 4-S Program Design and the PIPE Impact Metric Evaluation Models

PubMed Central

Äikäs, Antti Hermanni; Pronk, Nicolaas P.; Hirvensalo, Mirja Hannele; Absetz, Pilvikki

2017-01-01

Objective: The aim of this study was to describe the content of a multiyear market-based workplace health promotion (WHP) program and to evaluate design and implementation processes in a real-world setting. Methods: Data was collected from the databases of the employer and the service provider. It was classified using the 4-S (Size, Scope, Scalability, and Sustainability) and PIPE Impact Metric (Penetration, Implementation) models. Data analysis utilized both qualitative and quantitative methods. Results: Program design covered well the evidence-informed best practices except for clear path toward sustainability, cooperation with occupational health care, and support from middle-management supervisors. The penetration rate among participants was high (99%) and majority (81%) of services were implemented as designed. Conclusion: Study findings indicate that WHP market would benefit the use of evidence-based design principles and tendentious decisions to anticipate a long-term implementation process already during the planning phase. PMID:28665839

A Sample Application for Use of Biography in Social Studies; Science, Technology and Social Change Course

ERIC Educational Resources Information Center

Er, Harun

2017-01-01

The aim of this study is to evaluate the opinions of social studies teacher candidates on use of biography in science, technology and social change course given in the undergraduate program of social studies education. In this regard, convergent parallel design as a mixed research pattern was used to make use of both qualitative and quantitative…

Integrating the 6+1 Writing Traits Model with Cross-Age Tutoring: An Investigation of Elementary Students' Writing Development

ERIC Educational Resources Information Center

Paquette, Kelli R.

2009-01-01

A mixed methodological approach was used to examine the effect of a cross-age tutoring writing program among second- and fourth-grade students in a rural elementary school in Delaware. Pre-test and post-test writing prompts were administered and evaluated using the 6+1 traits writing assessment rubric. Students were assessed qualitatively through…

An Early Natural Auditory-Oral Intervention Approach for Children with Hearing Loss: A Qualitative Study

ERIC Educational Resources Information Center

Turan, Zerrin

2010-01-01

This study aims to examine the session goals and their realization during the session flow for a child with a hearing loss and his mother in an early intervention program. The study was designed as a case study. Video recordings of the intervention sessions, reflective journals, session plans, and the plan evaluations were used to collect and…

Factors that affect implementation of web-based faculty evaluation forms: residents' perspectives from a developing country.

PubMed

Ibrahim, S H; Ali, S K; Sadaf, S

2010-08-01

A web-based evaluation system for residents to provide feedback on faculty was piloted in four training programs at the Aga Khan University prior to institution-wide implementation. Of the four programs, less than 50% of forms were submitted by residents of three programs while more than 70% of forms were submitted by the residents of one program. This study was conducted to identify reasons for the varying participation rates of the four programs with a view to improving the system. A qualitative approach was employed using focus group discussions (FGDs). Volunteers were invited and three groups of eight to ten residents each were formed. Participants for FGDs were selected from all residency years. FGDs were used to identify residents' perceptions regarding the web-based faculty evaluation system and to identify residents' problems and concerns with completing the web-based faculty evaluating forms. Technical issues in completing and submitting the forms online were identified to be the main deterrents to completing the evaluation forms. Non-accessibility of a resource person for resolving technical problems with the software and the burden of taking time out to complete the forms were considered as limiting factors by many residents. Residents recommended a focused orientation session to the new system within the departments. Residents' confidence and support are key to promoting adequate participation in web-based evaluations. Focused orientation sessions, reinforcement, reminders, assurances of confidentiality, and removal of technical glitches should help to improve resident participation.

Preparing pharmacists to deliver a targeted service in hypertension management: evaluation of an interprofessional training program.

PubMed

Bajorek, Beata V; Lemay, Kate S; Magin, Parker J; Roberts, Christopher; Krass, Ines; Armour, Carol L

2015-09-28

Non-adherence to medicines by patients and suboptimal prescribing by clinicians underpin poor blood pressure (BP) control in hypertension. In this study, a training program was designed to enable community pharmacists to deliver a service in hypertension management targeting therapeutic adjustments and medication adherence. A comprehensive evaluation of the training program was undertaken. Tailored training comprising a self-directed pre-work manual, practical workshop (using real patients), and practice scenarios, was developed and delivered by an inter-professional team (pharmacists, GPs). Supported by practical and written assessment, the training focused on the principles of BP management, BP measurement skills, and adherence strategies. Pharmacists' experience of the training (expectations, content, format, relevance) was evaluated quantitatively and qualitatively. Immediate feedback was obtained via a questionnaire comprising Likert scales (1 = "very well" to 7 = "poor") and open-ended questions. Further in-depth qualitative evaluation was undertaken via semi-structured interviews several months post-training (and post service implementation). Seventeen pharmacists were recruited, trained and assessed as competent. All were highly satisfied with the training; other than the 'amount of information provided' (median score = 5, "just right"), all aspects of training attained the most positive score of '1'. Pharmacists most valued the integrated team-based approach, GP involvement, and inclusion of real patients, as well as the pre-reading manual, BP measurement workshop, and case studies (simulation). Post-implementation the interviews highlighted that comprehensive training increased pharmacists' confidence in providing the service, however, training of other pharmacy staff and patient recruitment strategies were highlighted as a need in future. Structured, multi-modal training involving simulated and inter-professional learning is effective in preparing selected community pharmacists for the implementation of new services in the context of hypertension management. This training could be further enhanced to prepare pharmacists for the challenges encountered in implementing and evaluating services in practice.

Process evaluation of the Living Green, Healthy and Thrifty (LiGHT) web-based child obesity management program: combining health promotion with ecology and economy.

PubMed

Jogova, Maria; Song, Joshua Eun-Soo; Campbell, Audrey Clare; Warbuton, Darren; Warshawski, Tom; Chanoine, Jean-Pierre

2013-04-01

To conduct a process evaluation of the Living Green, Healthy and Thrifty (LiGHT) program, a novel virtual child obesity management program that combines health promotion with ecology and economy (Phase 1). We carried out a mixed methods process evaluation involving qualitative and quantitative data collection in 3 phases: among 3 child-parent units, (group 1) that informed program development; 9 child-parent units (group 2) that tested the draft program and further aided program refinement; and 17 child-parent units (group 3) for a 4-week pilot of the program. In the program pilot, we assessed participants' knowledge and readiness to change pre- and postintervention and explored perceptions of the program. Participants generally felt that the online format for program delivery was convenient and accessible, the content was practical, and the integration of health-environment-economy was well received. Many parents also appreciated the involvement of the family. However, the lack of visual appeal and overabundance of text was identified as a challenge, and children/youth in particular requested assurance that their personal information (e.g. weight) was not seen by their parents. The online method of program delivery holds the unique challenge of requiring special efforts to create a sense of personal connection and community. The presence of a "Way-finder" to assist participants and discussion boards/forums are potential solutions. The LiGHT online weight management program offers an accessible, convenient weight management resource that children and families appreciate for its availability, broader educational scope, and practicality. Outcome evaluation of LiGHT will be carried out in Phase 2 of the project. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

Evaluating public health resources: what happens when funding disappears?

PubMed

Freedman, Ariela M; Kuester, Sarah A; Jernigan, Jan

2013-11-14

Although various factors affect the sustainability of public health programs, funding levels can influence many aspects of program continuity. Program evaluation in public health typically does not assess the progress of initiatives after discontinuation of funding. The objective of this study was to describe the effect of funding loss following expiration of a 5-year federal grant awarded to state health departments for development of statewide obesity prevention partnerships. The study used qualitative methods involving semistructured key informant interviews with state health departments. Data were analyzed using thematic analysis for effect of funding loss on staffing, programs, partnerships, and implementation of state plans. Many of the programs that continued to run after the grant expired operated at reduced capacity, either reaching fewer people or conducting fewer program activities for the same population. Although many states were able to leverage funding from other sources, this shift in funding source often resulted in priorities changing to meet new funding requirements. Evaluation capacity suffered in all states. Nearly all states reported losing infrastructure and capacity to communicate widely with partners. All states reported a severe or complete loss of their ability to provide training and technical assistance to partners. Despite these reduced capacities, states reported several key resources that facilitated continued work on the state plan. Decisions regarding continuation of funding are often dependent on budget constraints, evidence of success, and perceived ability to succeed in the future. Evaluating public health funding decisions may help guide development of best practice strategies for supporting long-term program success.

Area Health Education Center (AHEC) programs for rural and underrepresented minority students in the Alabama Black Belt.

PubMed

Patel, Ashruta; Knox, Regina J; Logan, Alicia; Summerville, Katie

2017-01-01

This paper evaluated the implementation West Central Alabama Area Health Education Center programs for high school students in grades 9-12 through participant-reported evaluations and feedback during the  September 1st, 2013 to August 31st, 2014 fiscal year. The programs targeted racial/ethnic minorities and/or rural individuals interested in pursuing a career as a healthcare provider in medically underserved counties of Alabama. Students participated in enrichment activities related to prospective health careers that included: successful college preparedness, knowledge about health careers, and the types of primary care health professions that are needed in underserved Alabama communities. The curriculum studied 593 (ACT preparation: n  = 172, AHEC 101: n  = 56, FAFSA: n  = 109, Health Career Exploration: n  = 159, College Career Readiness: n  = 67, Dixie Scholars NERD: n  = 30) baseline measures for the programs to evaluate effectiveness when rated by participants both quantitatively and qualitatively. Interactive activities with video incorporation, hands-on experiences, and group discussions paired with student motivation and interest in specific health career-related activities provided the highest program ratings. It is important to use a variety of successful program strategies when forming healthcare workforce development interventions. Student evaluations can help adapt methods for future program implementation to ultimately achieve strategies for health professional recruitment, training, and retention in areas that lack access to quality healthcare.

A Qualitative Exploration of Community-Based Organization Programs, Resources, and Training to Promote Adolescent Sexual Health

ERIC Educational Resources Information Center

McCarthy, Molly A.; Fisher, Christopher M.; Zhou, Junmin; Zhu, He; Pelster, Aja Kneip; Schober, Daniel J.; Baldwin, Kathleen; Fortenberry, J. Dennis; Goldsworthy, Richard

2015-01-01

Youth development professionals (YDPs) working at community-based organizations (CBOs) can promote adolescent sexual health through programs. This study explored the programs and resources that youth access at CBOs and training YDPs receive. Twenty-one semi-structured interviews were conducted with YDPs. Qualitative content analyses were conducted…

Counseling Skills Pre-Practicum Training at Guidance and Counseling Undergraduate Programs: A Qualitative Investigation

ERIC Educational Resources Information Center

Aladag, Mine

2013-01-01

This study was aimed to describe counseling skills pre-practicum training at guidance and counseling undergraduate programs in Turkey. A descriptive study was conducted based upon qualitative data. The research group of this study consisted of 11 guidance and counseling undergraduate programs voluntarily participate into study. The Survey Form…

Building Successful Home Visitor-Mother Relationships and Reaching Program Goals in Two Early Head Start Programs: A Qualitative Look at Contributing Factors

ERIC Educational Resources Information Center

Brookes, Sheila J.; Summers, Jean Ann; Thornburg, Kathy R.; Ispa, Jean M.; Lane, Valeri J.

2006-01-01

This paper presents the results of two qualitative studies, conducted independently in two Early Head Start programs, exploring the reasons given by mothers and home visitors for family success or lack of success in achieving program goals and for engagement in the mother-home visitor relationship. Several patterns pertaining to family issues and…

[Nutritional self-care promotion in community-dwelling older people: a protocol of mixed method research].

PubMed

Raffaele, Barbara; Matarese, Maria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

To describe a research protocol designed to promote nutritional self-care in older people. The aims of the research are: a) to evaluate the effectiveness of a nutritional education intervention in changing knowledge, attitudes, and behaviors; b) to describe the nutritional self-care ability and activities; c) to identify the promoting factors and barriers that influence the changes in nutritional knowledge, behaviors and attitudes in home-dwelling older people. Sequential explanatory mixed method design. The study will enroll 50 people aged 65 years and over. In the first quantitative phase, a pre-test and post-test design will be used to deliver a nutritional intervention aimed to change knowledge, behaviors and attitudes toward nutrition. Using the quantitative study results, the qualitative study phase will be conducted by interviews in sub-groups of older people. In a third phase, the quantitative and qualitative study results will be integrated. Quantitative data will be analyzed using descriptive and inferential statistics and qualitative data will be analyzed through content analysis. The study will provide new knowledge on nutritional self-care in home-dwelling older adults and the factors promoting nutritional self-care. Nutritional self-care promotion is of pivotal importance for the nursing care provided to home-dwelling older people. Educational programs aimed at the maintenance of proper nutrition in the older adults may reduce malnutrition and the related diseases. Nutrition educational programs should be based on knowledge derived from research to tailor individualized nutritional interventions and to realize effective educational programs.

[Development and Evaluation of a Self-Reflection Program for Intensive Care Unit Nurses Who Have Experienced the Death of Pediatric Patients].

PubMed

Kang, Hyun Ju; Bang, Kyung Sook

2017-06-01

This study aims to develop a self-reflection program for nurses who have experienced the death of pediatric patients in the intensive care unit and to evaluate its effectiveness. The self-reflection program was developed by means of the following four steps: establishment of the goal through investigation of an initial request, drawing up the program, preliminary research, and implementation and improvement of the program. The study employed a methodological triangulation to evaluate the effectiveness of the program. Participants were 38 nurses who had experienced the death of pediatric patients (experimental group=15, control group=23); they were recruited using convenience sampling. The self-reflection program was provided over 6 weeks (6 sessions). Data were collected from April to August, 2014 and analyzed using t-tests and content analysis. The quantitative results showed that changes in personal growth (t=-6.33, p<.001) and burnout scores (z=-2.76, p=.005) were better in the experimental group compared to the control group. The qualitative results exhibited two themes, namely "personal growth" and "professional growth", and ten sub-themes. The self-reflection program developed by this study was effective in helping nurses who had experienced the death of pediatric patients to achieve personal growth through self-reflection, and it was confirmed that the program can be applied in a realistic clinical nursing setting. Furthermore, it can be recommended as an intervention program for clinical nurses. © 2017 Korean Society of Nursing Science

Biennial Report of Progress under and Compliance with the Master Plan for Vocational Education and an Evaluation of Vocational Education Programs, as Reported by the State Board of Education. Submitted to the Governor, Lieutenant Governor, Speaker of the House, Seventy-First Texas Legislature, and the Texas Council on Vocational Education, 1987-1988.

ERIC Educational Resources Information Center

Texas Education Agency, Austin.

This biennial report presents: (1) information regarding progress under and compliance with the master plan for vocational education in Texas during the school years 1986-87 and 1987-88 and information regarding activities conducted during the 1988-89 school year where appropriate; and (2) quantitative and qualitative evaluative information on…

Commentary: Writing and evaluating qualitative research reports

USDA-ARS?s Scientific Manuscript database

An overview of qualitative methods is provided, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals ...

The tailored activity program (TAP) to address behavioral disturbances in frontotemporal dementia: a feasibility and pilot study.

PubMed

O'Connor, Claire M; Clemson, Lindy; Brodaty, Henry; Low, Lee-Fay; Jeon, Yun-Hee; Gitlin, Laura N; Piguet, Olivier; Mioshi, Eneida

2017-10-15

To explore the feasibility of implementing the Tailored Activity Program with a cohort of people with frontotemporal dementia and their carers (dyads). The Tailored Activity Program is an occupational therapy based intervention that involves working collaboratively with family carers and prescribes personalized activities for behavioral management in people with dementia. Twenty dyads randomized into the study (Tailored Activity Program: n = 9; Control: n = 11) were assessed at baseline and 4-months. Qualitative analyzes evaluated feasibility and acceptability of the program for the frontotemporal dementia cohort, and quantitative analyzes (linear mixed model analyzes, Spearman's rho correlations) measured the impact of the program on the dyads. The Tailored Activity Program was an acceptable intervention for the frontotemporal dementia dyads. Qualitative analyses identified five themes: "carer perceived benefits", "carer readiness to change", "strategies used by carer to engage person with dementia", "barriers to the Tailored Activity Program uptake/implementation", and "person with dementia engagement". Quantitative outcomes showed an overall reduction of behavioral symptoms (F 18.34  = 8.073, p = 0.011) and maintenance of functional performance in the person with dementia (F 18.03  = 0.375, p = 0.548). This study demonstrates the potential for using an activity-based intervention such as the Tailored Activity Program in frontotemporal dementia. Service providers should recognize that while people with frontotemporal dementia present with challenging issues, tailored therapies may support their function and reduce their behavioral symptoms. Implications for rehabilitation The Tailored Activity Program is an occupational therapy based intervention that involves prescribing personalized activities for behavioral management in dementia. The Tailored Activity Program is an acceptable and feasible intervention approach to address some of the unique behavioral and functional impairments inherent in frontotemporal dementia.

Impact of the ‘Artful Moments’ Intervention on Persons with Dementia and Their Care Partners: a Pilot Study

PubMed Central

Hazzan, Afeez Abiola; Humphrey, Janis; Kilgour-Walsh, Laurie; Moros, Katherine L.; Murray, Carmen; Stanners, Shannon; Montemuro, Maureen; Giangregorio, Aidan; Papaioannou, Alexandra

2016-01-01

Background Engaging with art can be valuable for persons living with dementia. ‘Artful Moments’ was a collaborative project undertaken by the Art Gallery of Hamilton and the Behavioural Health Program at Hamilton Health Sciences that sought to develop and implement a program of arts-based activities for persons in the middle-to-late stages of dementia who exhibit behavioural symptoms and for their accompanying care partners. Methods This pilot study employed a qualitative descriptive design. Eight participants were observed during multiple art sessions to evaluate their level of engagement in the program. Care partners also completed a questionnaire describing their experience. Qualitative content analysis was used to identify themes. Results For program participants, factors that promoted continued interest and engagement in art included: care partner involvement, group activities, opportunities to share opinions, validation of their personhood, and increased engagement over time. Care partners observed improvements in participants’ creativity, communication, relationship forming, and task accomplishment, and some reported reduced stress. Conclusions ‘Artful Moments’ promoted engagement and expression in persons in the middle-to-late stages of dementia, as well as having benefits for their care partners. Limitations of the study included a small convenience sample drawn from one hospital setting. PMID:27403209

MIXED-METHODS EVALUATION OF PARTICIPANT RECRUITMENT AND RETENTION IN THE MOM POWER PARENTING INTERVENTION PROGRAM.

PubMed

Mucka, Lilia E; Dayton, Carolyn J; Lawler, Jamie; Kirk, Rosalind; Alfafara, Emily; Schuster, Melisa M; Miller, Nicole; Ribaudo, Julie; Rosenblum, Katherine Lisa; Muzik, Maria

2017-07-01

Parenting group success begins with attendance. Using archival pilot data from 99 mothers who enrolled in the Mom Power (MP) parenting intervention, this study sought to understand the factors that influenced participant engagement and retention. MP is a group-based, early intervention program grounded in attachment theory that utilizes motivational interviewing as a core component to enhance program engagement. Study aims were to qualitatively describe the reasons why mothers were interested in participating in the program, including what they hoped to gain from the experience, and to quantitatively examine the extent to which attendance was associated with demographic, experiential, and psychosocial factors. The qualitative analysis of intake interviews revealed that mothers expected the MP intervention to provide a warm environment for themselves and their children as well as to support and enhance their parenting, and 95% revealed their hopes that the intervention would help them grow and develop as women. Attendance rates were relatively high, with 62% of mothers missing less than one group session. Quantitative analyses using multiple regression to test associations of demographic, experiential, and psychosocial factors with attendance rates were not significant. Results suggest that motivational interviewing may be an important component in promoting participant engagement efforts in parenting interventions. © 2017 Michigan Association for Infant Mental Health.

A qualitative study of programs for parents with serious mental illness and their children: building practice-based evidence.

PubMed

Nicholson, Joanne; Hinden, Beth R; Biebel, Kathleen; Henry, Alexis D; Katz-Leavy, Judith

2007-10-01

The rationale for the development of effective programs for parents with serious mental illness and their children is compelling. Using qualitative methods and a grounded theory approach with data obtained in site visits, seven existing programs for parents with mental illness and their children in the United States are described and compared across core components: target population, theory and assumptions, funding, community and agency contexts, essential services and intervention strategies, moderators, and outcomes. The diversity across programs is strongly complemented by shared characteristics, the identification of which provides the foundation for future testing and the development of an evidence base. Challenges in program implementation and sustainability are identified. Qualitative methods are useful, particularly when studying existing programs, in taking steps toward building the evidence base for effective programs for parents with serious mental illness and their children.

A Qualitative Exploration of Implementation Factors in a School-Based Mindfulness and Yoga Program: Lessons Learned from Students and Teachers

PubMed Central

Dariotis, Jacinda K.; Mirabal-Beltran, Roxanne; Cluxton-Keller, Fallon; Gould, Laura Feagans; Greenberg, Mark T.; Mendelson, Tamar

2016-01-01

Identifying factors relevant for successful implementation of school-based interventions is essential to ensure that programs are provided in an effective and engaging manner. The perspectives of two key stakeholders critical for identifying implementation barriers and facilitators – students and their classroom teachers – merit attention in this context and have rarely been explored using qualitative methods. This study reports qualitative perspectives of fifth and sixth grade participants and their teachers of a 16-week school-based mindfulness and yoga program in three public schools serving low-income urban communities. Four themes related to program implementation barriers and facilitators emerged: program delivery factors, program buy-in, implementer communication with teachers, and instructor qualities. Feedback from students and teachers is discussed in the context of informing implementation, adaptation, and future development of school-based mindfulness and yoga programming in urban settings. PMID:28670007

A Qualitative Exploration of Implementation Factors in a School-Based Mindfulness and Yoga Program: Lessons Learned from Students and Teachers.

PubMed

Dariotis, Jacinda K; Mirabal-Beltran, Roxanne; Cluxton-Keller, Fallon; Gould, Laura Feagans; Greenberg, Mark T; Mendelson, Tamar

2017-01-01

Identifying factors relevant for successful implementation of school-based interventions is essential to ensure that programs are provided in an effective and engaging manner. The perspectives of two key stakeholders critical for identifying implementation barriers and facilitators - students and their classroom teachers - merit attention in this context and have rarely been explored using qualitative methods. This study reports qualitative perspectives of fifth and sixth grade participants and their teachers of a 16-week school-based mindfulness and yoga program in three public schools serving low-income urban communities. Four themes related to program implementation barriers and facilitators emerged: program delivery factors, program buy-in, implementer communication with teachers, and instructor qualities. Feedback from students and teachers is discussed in the context of informing implementation, adaptation, and future development of school-based mindfulness and yoga programming in urban settings.

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

This paper explores the variety of qualitative methods available, in the context of a larger quantitative-qualitative debate in the field of educational evaluation. Each approach is reviewed in terms of the work of its major proponents. The dominant forms of qualitative evaluation include: (1) ethnography; (2) naturalistic inquiry; (3) generic…

Evaluating the comparative effectiveness of different demand side interventions to increase maternal health service utilization and practice of birth spacing in South Kivu, Democratic Republic of Congo: an innovative, mixed methods approach.

PubMed

Dumbaugh, Mari; Bapolisi, Wyvine; van de Weerd, Jennie; Zabiti, Michel; Mommers, Paula; Balaluka, Ghislain Bisimwa; Merten, Sonja

2017-07-03

In this protocol we describe a mixed methods study in the province of South Kivu, Democratic Republic of Congo evaluating the effectiveness of different demand side strategies to increase maternal health service utilization and the practice of birth spacing. Conditional service subsidization, conditional cash transfers and non-monetary incentives aim to encourage women to use maternal health services and practice birth spacing in two different health districts. Our methodology will comparatively evaluate the effectiveness of different approaches against each other and no intervention. This study comprises four main research activities: 1) Formative qualitative research to determine feasibility of planned activities and inform development of the quantitative survey; 2) A community-based, longitudinal survey; 3) A retrospective review of health facility records; 4) Qualitative exploration of intervention acceptability and emergent themes through in-depth interviews with program participants, non-participants, their partners and health providers. Female community health workers are engaged as core members of the research team, working in tandem with female survey teams to identify women in the community who meet eligibility criteria. Female community health workers also act as key informants and community entry points during methods design and qualitative exploration. Main study outcomes are completion of antenatal care, institutional delivery, practice of birth spacing, family planning uptake and intervention acceptability in the communities. Qualitative methods also explore decision making around maternal health service use, fertility preference and perceptions of family planning. The innovative mixed methods design allows quantitative data to inform the relationships and phenomena to be explored in qualitative collection. In turn, qualitative findings will be triangulated with quantitative findings. Inspired by the principles of grounded theory, qualitative analysis will begin while data collection is ongoing. This "conversation" between quantitative and qualitative data will result in a more holistic, context-specific exploration and understanding of research topics, including the mechanisms through which the interventions are or are not effective. In addition, engagement of female community health workers as core members of the research team roots research methods in the realities of the community and provides teams with key informants who are simultaneously implicated in the health system, community and target population.

Changing Beliefs and Behaviors Related to Sexually Transmitted Diseases in Vulnerable Women: A Qualitative Study.

PubMed

Boroumandfar, Zahra; Kianpour, Masoud; Zargham, Ali; Abdoli, Samereh; Tayeri, Katayoun; Salehi, Mehrdad; Momeni, Godratollah; Khorvash, Farzin

2017-01-01

The first step in health education is awareness of the people and their acceptance to change their behavior. Therefore, the aim of this study was to investigate the effects of empowerment program towards the concept of self-care and prevention of sexually transmitted diseases (STDs) in women at risk of STDs. The present study was conducted as a qualitative approach (step of action and observation of an action) by using conventional content analysis method. An empowerment program regarding STDs (Action) was performed among 32 (with convenient sample) drug user women with addicted husbands referring to the counseling center for vulnerable women (drop in enter) in Isfahan in 2015. The knowledge of quiddity, transmission, and prevention of STDs, as well as some items of life skills such as self-awareness, interpersonal communication, and assertive behavior were taught in an educational program. Teaching methods were lectures, group, and individual training and role play. The impact of the program on modified belief and behavior change regarding STDs was evaluated with structured interviews. Analysis of the obtained results yielded three categories. The categories were awareness of STD, believing in being at risk, and decision and change. Promoting self-care and prevention through education programs based on action research can make a significant reduction in the incidence of problems and cause a behavior change in women with the disease or those at risk for STDs.

Training and technical assistance to enhance capacity building between prevention research centers and their partners.

PubMed

Spadaro, Antonia J; Grunbaum, Jo Anne; Dawkins, Nicola U; Wright, Demia S; Rubel, Stephanie K; Green, Diane C; Simoes, Eduardo J

2011-05-01

The Centers for Disease Control and Prevention has administered the Prevention Research Centers Program since 1986. We quantified the number and reach of training programs across all centers, determined whether the centers' outcomes varied by characteristics of the academic institution, and explored potential benefits of training and technical assistance for academic researchers and community partners. We characterized how these activities enhanced capacity building within Prevention Research Centers and the community. The program office collected quantitative information on training across all 33 centers via its Internet-based system from April through December 2007. Qualitative data were collected from April through May 2007. We selected 9 centers each for 2 separate, semistructured, telephone interviews, 1 on training and 1 on technical assistance. Across 24 centers, 4,777 people were trained in 99 training programs in fiscal year 2007 (October 1, 2006-September 30, 2007). Nearly 30% of people trained were community members or agency representatives. Training and technical assistance activities provided opportunities to enhance community partners' capacity in areas such as conducting needs assessments and writing grants and to improve the centers' capacity for cultural competency. Both qualitative and quantitative data demonstrated that training and technical assistance activities can foster capacity building and provide a reciprocal venue to support researchers' and the community's research interests. Future evaluation could assess community and public health partners' perception of centers' training programs and technical assistance.

The Impact of Credit on Village Economies

PubMed Central

Kaboski, Joseph P.; Townsend, Robert M.

2011-01-01

This paper evaluates the short-term impact of Thailand’s ‘Million Baht Village Fund’program, among the largest scale government microfinance iniative in the world, using pre- and post-program panel data and quasi-experimental cross-village variation in credit-per-household. We find that the village funds have increased total short-term credit, consumption, agricultural investment, income growth (from business and labor), but decreased overall asset growth. We also find a positive impact on wages, an important general equilibrium effect. The findings are broadly consistent qualitatively with models of credit-constrained household behavior and models of intermediation and growth. PMID:22844546

Assessing locomotor skills development in childhood using wearable inertial sensor devices: the running paradigm.

PubMed

Masci, Ilaria; Vannozzi, Giuseppe; Bergamini, Elena; Pesce, Caterina; Getchell, Nancy; Cappozzo, Aurelio

2013-04-01

Objective quantitative evaluation of motor skill development is of increasing importance to carefully drive physical exercise programs in childhood. Running is a fundamental motor skill humans adopt to accomplish locomotion, which is linked to physical activity levels, although the assessment is traditionally carried out using qualitative evaluation tests. The present study aimed at investigating the feasibility of using inertial sensors to quantify developmental differences in the running pattern of young children. Qualitative and quantitative assessment tools were adopted to identify a skill-sensitive set of biomechanical parameters for running and to further our understanding of the factors that determine progression to skilled running performance. Running performances of 54 children between the ages of 2 and 12 years were submitted to both qualitative and quantitative analysis, the former using sequences of developmental level, the latter estimating temporal and kinematic parameters from inertial sensor measurements. Discriminant analysis with running developmental level as dependent variable allowed to identify a set of temporal and kinematic parameters, within those obtained with the sensor, that best classified children into the qualitative developmental levels (accuracy higher than 67%). Multivariate analysis of variance with the quantitative parameters as dependent variables allowed to identify whether and which specific parameters or parameter subsets were differentially sensitive to specific transitions between contiguous developmental levels. The findings showed that different sets of temporal and kinematic parameters are able to tap all steps of the transitional process in running skill described through qualitative observation and can be prospectively used for applied diagnostic and sport training purposes. Copyright © 2012 Elsevier B.V. All rights reserved.

Hispanic Labor Friends Initiative: supporting vulnerable women.

PubMed

Hazard, Cambria Jones; Callister, Lynn Clark; Birkhead, Ana; Nichols, Lisa

2009-01-01

To evaluate the qualitative aspects of the Hispanic Labor Friends Initiative. "Hispanic Labor Friends," bilingual Hispanic community women who were themselves mothers, were recruited by clinic and hospital personnel. Women who agreed were educated, received translation certification, and were oriented to the initiative. Pregnant Hispanic immigrant women seen in the health center who met criteria set by the multidisciplinary health care team were assigned a Hispanic Labor Friend by 32 weeks' gestation. Hispanic Labor Friends assisted women with communication with healthcare providers and provided social support. Qualitative evaluation of the program consisted of interviews with several groups: (1) Hispanic immigrant women who had a Hispanic Labor Friend, (2) Hispanic immigrant women who were not in the Hispanic Labor Friends program, (3) Hispanic Labor Friends, (4) healthcare providers for Hispanic women. Data saturation was reached, and data were analyzed by the research team using descriptive qualitative inquiry. The Hispanic immigrant women described positive outcomes from being involved in the Hispanic Labor Friends program, including feeling supported and comforted. "I felt as though my family were at my side." One woman who had standard care said, "It is hard for me to communicate. When I gave birth, the nurses asked me things, and I didn't understand anything. I stayed quiet." One of the nurses who was interviewed said: "I think they [the HLF patients] get better care. Sometimes we think we can communicate with them with their little bit of English and our little bit of Spanish. But you get an HLF and it's a totally different story. We can more adequately tell what's going on with them...They end up getting better care." One Hispanic Labor Friend said, "The women are very appreciative that I was there to help them through a critical time." Women who participated in the study identified the need to have a continuing association with Hispanic Labor Friends in the early postpartum period. The provision of culturally appropriate social support is critical in the care of Hispanic immigrant childbearing women. Programs such as the Hispanic Labor Friends Initiative can help improve support and promote positive outcomes in these vulnerable and disadvantaged women.

'eSimulation'. Part 2: Evaluation of an interactive multimedia mental health education program for generalist nurses.

PubMed

Lamont, Scott; Brunero, Scott

2014-01-01

This paper reports on an evaluation of an eSimulation mental health education program for generalist nurses; developed using the following five key attributes of simulation: (1) creating a hypothetical opportunity; (2) authentic representation; (3) active participation; (4) integration; (5) repetition, evaluation and reflection. Four themes emerged from a qualitative thematic analysis of semi-structured interview data involving fourteen generalist nurses. The following four themes: (1) authenticity; (2) participation; (3) clinical reasoning; (4) control of learning provide supporting evidence that these attributes are positioned within the learning resource. Participants found the scenarios within the resource realistic, engaging and relevant to their scope of practice. This type of learning resource may help in developing the knowledge, skills and confidence of generalist nurses in delivering safe and competent mental health care in the generalist setting, when access to specialist services and appropriate means of training are unavailable.

Alumni perspectives on career preparation during a postdoctoral training program: a qualitative study.

PubMed

Faupel-Badger, Jessica M; Raue, Kimberley; Nelson, David E; Tsakraklides, Sophia

2015-03-02

Published evaluations of career preparation of alumni from long-standing postdoctoral fellowship programs in the biomedical sciences are limited and often focus on quantitative analysis of data from extant publicly available sources. Qualitative methods provide the opportunity to gather robust information about specific program elements from structured postdoctoral training programs and the influence of this training on subsequent career paths of alumni. In-depth interviews with a subset of the National Cancer Institute's Cancer Prevention Fellowship Program (CPFP) alumni (n=27), representing more than 25 years of the program's history and multiple career sectors, were conducted to assess alumni reflections on the training environment and career preparation during their time in the CPFP. NVivo software was used to analyze data and identify major themes. Four main themes emerged from these interviews, including: the value of structured training curriculum, mentorship, transdisciplinary environment, and professional identity. Even when reflecting on training that occurred one to two decades earlier, alumni were able to highlight specific components of a structured postdoctoral training program as influencing their research and career trajectories. These results may have relevance for those interested in assessing how postdoctoral training can influence fellows throughout their careers and understanding salient features of structured programs. © 2015 J. M. Faupel-Badger et al. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature

PubMed Central

Lauricella, Michela; Valdez, Jessica K.; Okamoto, Scott K.; Helm, Susana; Zaremba, Colleen

2016-01-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern U.S. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the “ground up.” This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs. PMID:26733384

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature.

PubMed

Lauricella, Michela; Valdez, Jessica K; Okamoto, Scott K; Helm, Susana; Zaremba, Colleen

2016-02-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican-American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern US. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the "ground up." This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs.

Global health education: a pilot in trans-disciplinary, digital instruction

PubMed Central

Wipfli, Heather; Press, David J.; Kuhn, Virginia

2013-01-01

Background The development of new global health academic programs provides unique opportunities to create innovative educational approaches within and across universities. Recent evidence suggests that digital media technologies may provide feasible and cost-effective alternatives to traditional classroom instruction; yet, many emerging global health academic programs lag behind in the utilization of modern technologies. Objective We created an inter-departmental University of Southern California (USC) collaboration to develop and implement a course focused on digital media and global health. Design Course curriculum was based on core tenants of modern education: multi-disciplinary, technologically advanced, learner-centered, and professional application of knowledge. Student and university evaluations were reviewed to qualitatively assess course satisfaction and educational outcomes. Results ‘New Media for Global Health’ ran for 18 weeks in the Spring 2012 semester with N=41 students (56.1% global health and 43.9% digital studies students). The course resulted in a number of high quality global health-related digital media products available at http://iml420.wordpress.com/. Challenges confronted at USC included administrative challenges related to co-teaching and frustration from students conditioned to a rigid system of teacher-led learning within a specific discipline. Quantitative and qualitative course evaluations reflected positive feedback for the course instructors and mixed reviews for the organization of the course. Conclusion The development of innovative educational programs in global health requires on-going experimentation and information sharing across departments and universities. Digital media technologies may have implications for future efforts to improve global health education. PMID:23643297

Global health education: a pilot in trans-disciplinary, digital instruction.

PubMed

Wipfli, Heather; Press, David J; Kuhn, Virginia

2013-05-02

The development of new global health academic programs provides unique opportunities to create innovative educational approaches within and across universities. Recent evidence suggests that digital media technologies may provide feasible and cost-effective alternatives to traditional classroom instruction; yet, many emerging global health academic programs lag behind in the utilization of modern technologies. We created an inter-departmental University of Southern California (USC) collaboration to develop and implement a course focused on digital media and global health. Course curriculum was based on core tenants of modern education: multi-disciplinary, technologically advanced, learner-centered, and professional application of knowledge. Student and university evaluations were reviewed to qualitatively assess course satisfaction and educational outcomes. 'New Media for Global Health' ran for 18 weeks in the Spring 2012 semester with N=41 students (56.1% global health and 43.9% digital studies students). The course resulted in a number of high quality global health-related digital media products available at http://iml420.wordpress.com/. Challenges confronted at USC included administrative challenges related to co-teaching and frustration from students conditioned to a rigid system of teacher-led learning within a specific discipline. Quantitative and qualitative course evaluations reflected positive feedback for the course instructors and mixed reviews for the organization of the course. The development of innovative educational programs in global health requires on-going experimentation and information sharing across departments and universities. Digital media technologies may have implications for future efforts to improve global health education.