Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed

Devers, K J

1999-12-01

To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. Existing literature in the social sciences and health services research, particularly in primary care and medicine. Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results.

Process evaluations of task sharing interventions for perinatal depression in low and middle income countries (LMIC): a systematic review and qualitative meta-synthesis.

PubMed

Munodawafa, Memory; Mall, Sumaya; Lund, Crick; Schneider, Marguerite

2018-03-23

Perinatal depression is common in low and middle income countries (LAMICs). Task sharing interventions have been implemented to treat perinatal depression in these settings, as a way of dealing with staff shortages. Task sharing allows lay health workers to provide services for less complex cases while being trained and supervised by specialists. Randomized controlled trials suggest that these interventions can be effective but there is limited qualitative information exploring barriers and facilitators to their implementation. This systematic review aims to systematically review current qualitative evidence of process evaluations of task sharing interventions for perinatal depression in LAMICs in relation to the United Kingdom (UK) Medical Research Council (MRC) framework for conducting process evaluations. We searched Medline/ PubMed, PsycINFO, Scopus, Cochrane Library and Web of science for studies from LAMICS using search terms under the broad categories of: (a) "maternal depression'" (b) "intervention" (c) "lay counsellor" OR "community health worker" OR "non-specialist" and (d) "LAMICs". Abstracts were independently reviewed for inclusion by two authors. Full text articles were screened and data for included articles were extracted using a standard data extraction sheet. Qualitative synthesis of qualitative evidence was conducted. 8420 articles were identified from initial searches. Of these, 26 full text articles were screened for eligibility with only three studies meeting the inclusion criteria. Main findings revealed that participants identified the following crucial factors: contextual factors included physical location, accessibility and cultural norms. Implementation factors included acceptability of the intervention and characteristics of the personnel. Mechanisms included counsellor factors such as motivating and facilitating trust; intervention factors such as use of stories and visual aids, and understandability of the content; and participant factors such as shared experience, meeting learning needs, and meeting expectations. While task sharing has been suggested as an effective way of filling the treatment gap for perinatal depression, there is a paucity of qualitative research exploring barriers and facilitators to implementing these interventions. Qualitative process evaluations are crucial for the development of culturally relevant interventions.

Quality dimensions in health evaluation: manager's conceptions.

PubMed

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

Oral Health Promotion and Homelessness: A Theory-Based Approach to Understanding Processes of Implementation and Adoption

ERIC Educational Resources Information Center

Beaton, Laura; Freeman, Ruth

2016-01-01

Objective: To use the Theory of Diffusion of Innovations as a framework to explore the qualitative data gleaned from a process evaluation of the Smile4life intervention across Scottish National Health Service (NHS) Boards and to inform future oral health promotion and homelessness. Design: A qualitative exploration. Setting: In 2012, the…

Organizational structure, team process, and future directions of interprofessional health care teams.

PubMed

Cole, Kenneth D; Waite, Martha S; Nichols, Linda O

2003-01-01

For a nationwide Geriatric Interdisciplinary Team Training (GITT) program evaluation of 8 sites and 26 teams, team evaluators developed a quantitative and qualitative team observation scale (TOS), examining structure, process, and outcome, with specific focus on the training function. Qualitative data provided an important expansion of quantitative data, highlighting positive effects that were not statistically significant, such as role modeling and training occurring within the clinical team. Qualitative data could also identify "too much" of a coded variable, such as time spent in individual team members' assessments and treatment plans. As healthcare organizations have increasing demands for productivity and changing reimbursement, traditional models of teamwork, with large teams and structured meetings, may no longer be as functional as they once were. To meet these constraints and to train students in teamwork, teams of the future will have to make choices, from developing and setting specific models to increasing the use of information technology to create virtual teams. Both quantitative and qualitative data will be needed to evaluate these new types of teams and the important outcomes they produce.

Priority-setting and hospital strategic planning: a qualitative case study.

PubMed

Martin, Douglas; Shulman, Ken; Santiago-Sorrell, Patricia; Singer, Peter

2003-10-01

To describe and evaluate the priority-setting element of a hospital's strategic planning process. Qualitative case study and evaluation against the conditions of 'accountability for reasonableness' of a strategic planning process at a large urban university-affiliated hospital. The hospital's strategic planning process met the conditions of 'accountability for reasonableness' in large part. Specifically: the hospital based its decisions on reasons (both information and criteria) that the participants felt were relevant to the hospital; the number and type of participants were very extensive; the process, decisions and reasons were well communicated throughout the organization, using multiple communication vehicles; and the process included an ethical framework linked to an effort to evaluate and improve the process. However, there were opportunities to improve the process, particularly by giving participants more time to absorb the information relevant to priority-setting decisions, more time to take difficult decisions and some means to appeal or revise decisions. A case study linked to an evaluation using 'accountability for reasonableness' can serve to improve priority-setting in the context of hospital strategic planning.

The qualitative research proposal.

PubMed

Klopper, H

2008-12-01

Qualitative research in the health sciences has had to overcome many prejudices and a number of misunderstandings, but today qualitative research is as acceptable as quantitative research designs and is widely funded and published. Writing the proposal of a qualitative study, however, can be a challenging feat, due to the emergent nature of the qualitative research design and the description of the methodology as a process. Even today, many sub-standard proposals at post-graduate evaluation committees and application proposals to be considered for funding are still seen. This problem has led the researcher to develop a framework to guide the qualitative researcher in writing the proposal of a qualitative study based on the following research questions: (i) What is the process of writing a qualitative research proposal? and (ii) What does the structure and layout of a qualitative proposal look like? The purpose of this article is to discuss the process of writing the qualitative research proposal, as well as describe the structure and layout of a qualitative research proposal. The process of writing a qualitative research proposal is discussed with regards to the most important questions that need to be answered in your research proposal with consideration of the guidelines of being practical, being persuasive, making broader links, aiming for crystal clarity and planning before you write. While the structure of the qualitative research proposal is discussed with regards to the key sections of the proposal, namely the cover page, abstract, introduction, review of the literature, research problem and research questions, research purpose and objectives, research paradigm, research design, research method, ethical considerations, dissemination plan, budget and appendices.

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis

PubMed Central

2014-01-01

Background Caring for a young person experiencing first-episode psychosis is challenging and can affect carers’ well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers’ beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. Methods A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Results Three themes were abstracted from the data, reflecting carers’ beliefs about the usefulness of the manual: promoting carers’ well-being, increasing carers’ understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. Conclusion This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. Trial registration ACTRN12609000064202 PMID:24906392

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis.

PubMed

McCann, Terence V; Lubman, Dan I

2014-06-06

Caring for a young person experiencing first-episode psychosis is challenging and can affect carers' well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers' beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Three themes were abstracted from the data, reflecting carers' beliefs about the usefulness of the manual: promoting carers' well-being, increasing carers' understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. ACTRN12609000064202.

Using Qualitative Research to Inform Development of Professional Guidelines: A Case Study of the Society of Critical Care Medicine Family-Centered Care Guidelines.

PubMed

Coombs, Maureen A; Davidson, Judy E; Nunnally, Mark E; Wickline, Mary A; Curtis, J Randall

2017-08-01

To explore the importance, challenges, and opportunities using qualitative research to enhance development of clinical practice guidelines, using recent guidelines for family-centered care in the ICU as an example. In developing the Society of Critical Care Medicine guidelines for family-centered care in the neonatal ICU, PICU, and adult ICU, we developed an innovative adaptation of the Grading of Recommendations, Assessments, Development and Evaluations approach to explicitly incorporate qualitative research. Using Grading of Recommendations, Assessments, Development and Evaluations and the Council of Medical Specialty Societies principles, we conducted a systematic review of qualitative research to establish family-centered domains and outcomes. Thematic analyses were undertaken on study findings and used to support Population, Intervention, Comparison, Outcome question development. We identified and employed three approaches using qualitative research in these guidelines. First, previously published qualitative research was used to identify important domains for the Population, Intervention, Comparison, Outcome questions. Second, this qualitative research was used to identify and prioritize key outcomes to be evaluated. Finally, we used qualitative methods, member checking with patients and families, to validate the process and outcome of the guideline development. In this, a novel report, we provide direction for standardizing the use of qualitative evidence in future guidelines. Recommendations are made to incorporate qualitative literature review and appraisal, include qualitative methodologists in guideline taskforce teams, and develop training for evaluation of qualitative research into guideline development procedures. Effective methods of involving patients and families as members of guideline development represent opportunities for future work.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed Central

Devers, K J

1999-01-01

OBJECTIVE: To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. DATA SOURCES: Existing literature in the social sciences and health services research, particularly in primary care and medicine. PRINCIPAL FINDING: Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. CONCLUSION: The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results. Images Figure 1 PMID:10591278

Bridging the qualitative-quantitative divide: Experiences from conducting a mixed methods evaluation in the RUCAS programme.

PubMed

Makrakis, Vassilios; Kostoulas-Makrakis, Nelly

2016-02-01

Quantitative and qualitative approaches to planning and evaluation in education for sustainable development have often been treated by practitioners from a single research paradigm. This paper discusses the utility of mixed method evaluation designs which integrate qualitative and quantitative data through a sequential transformative process. Sequential mixed method data collection strategies involve collecting data in an iterative process whereby data collected in one phase contribute to data collected in the next. This is done through examples from a programme addressing the 'Reorientation of University Curricula to Address Sustainability (RUCAS): A European Commission Tempus-funded Programme'. It is argued that the two approaches are complementary and that there are significant gains from combining both. Using methods from both research paradigms does not, however, mean that the inherent differences among epistemologies and methodologies should be neglected. Based on this experience, it is recommended that using a sequential transformative mixed method evaluation can produce more robust results than could be accomplished using a single approach in programme planning and evaluation focussed on education for sustainable development. Copyright © 2015 Elsevier Ltd. All rights reserved.

How Qualitative Research Informs Clinical and Policy Decision Making in Transplantation: A Review.

PubMed

Tong, Allison; Morton, Rachael L; Webster, Angela C

2016-09-01

Patient-centered care is no longer just a buzzword. It is now widely touted as a cornerstone in delivering quality care across all fields of medicine. However, patient-centered strategies and interventions necessitate evidence about patients' decision-making processes, values, priorities, and needs. Qualitative research is particularly well suited to understanding the experience and perspective of patients, donors, clinicians, and policy makers on a wide range of transplantation-related topics including organ donation and allocation, adherence to prescribed therapy, pretransplant and posttransplant care, implementation of clinical guidelines, and doctor-patient communication. In transplantation, evidence derived from qualitative research has been integrated into strategies for shared decision-making, patient educational resources, process evaluations of trials, clinical guidelines, and policies. The aim of this article is to outline key concepts and methods used in qualitative research, guide the appraisal of qualitative studies, and assist clinicians to understand how qualitative research may inform their practice and policy.

Assessment of Techniques for Evaluating Computer Systems for Federal Agency Procurements. Final Report.

ERIC Educational Resources Information Center

Letmanyi, Helen

Developed to identify and qualitatively assess computer system evaluation techniques for use during acquisition of general purpose computer systems, this document presents several criteria for comparison and selection. An introduction discusses the automatic data processing (ADP) acquisition process and the need to plan for uncertainty through…

Health Care Merged With Senior Housing: Description and Evaluation of a Successful Program.

PubMed

Barry, Theresa Teta

2017-01-01

Objective: This article describes and evaluates a successful partnership between a large health care organization and housing for seniors. The program provides on-site, primary care visits by a physician and a nurse in addition to intensive social services to residents in an affordable senior housing apartment building located in Pennsylvania. Per Donabedian's "Structure-Process-Outcome" model, the program demonstrated positive health care outcomes for its participants via a prescribed structure. To provide guidance for replication in similar settings, we qualitatively evaluated the processes by which successful outcomes were obtained. Methods: With program structures in place and outcomes measured, this case study collected and analyzed qualitative information taken from key informant interviews on care processes involved in the program. Themes were extracted from semistructured interviews and used to describe the processes that helped and hindered the program. Results and Discussion: Common processes were identified across respondents; however, the nuanced processes that lead to successful outcomes suggest that defined structures and processes may not be sufficient to produce similar outcomes in other settings. Further research is needed to determine the program's replicability and policy implications.

Using new media to build social capital for health: a qualitative process evaluation study of participation in the CityNet project.

PubMed

Bolam, Bruce; McLean, Carl; Pennington, Andrew; Gillies, Pamela

2006-03-01

The present article presents an exploratory qualitative process evaluation study of 'Ambassador' participation in CityNet, an innovative information-communication technology-based (ICT) project that aims to build aspects of social capital and improve access to information and services among disadvantaged groups in Nottingham, UK. A purposive sample of 40 'Ambassadors' interviewees was gathered in three waves of data collection. The two emergent analytic themes highlighted how improvements in confidence, self-esteem and social networks produced via participation were mitigated by structural problems in devolving power within the project. This illustrates how concepts of power are important for understanding the process of health promotion interventions using new media.

Using a theory-driven conceptual framework in qualitative health research.

PubMed

Macfarlane, Anne; O'Reilly-de Brún, Mary

2012-05-01

The role and merits of highly inductive research designs in qualitative health research are well established, and there has been a powerful proliferation of grounded theory method in the field. However, tight qualitative research designs informed by social theory can be useful to sensitize researchers to concepts and processes that they might not necessarily identify through inductive processes. In this article, we provide a reflexive account of our experience of using a theory-driven conceptual framework, the Normalization Process Model, in a qualitative evaluation of general practitioners' uptake of a free, pilot, language interpreting service in the Republic of Ireland. We reflect on our decisions about whether or not to use the Model, and describe our actual use of it to inform research questions, sampling, coding, and data analysis. We conclude with reflections on the added value that the Model and tight design brought to our research.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Neural differences in the processing of true and false sentences: insights into the nature of 'truth' in language comprehension.

PubMed

Marques, J Frederico; Canessa, Nicola; Cappa, Stefano

2009-06-01

The inquiry on the nature of truth in language comprehension has a long history of opposite perspectives. These perspectives either consider that there are qualitative differences in the processing of true and false statements, or that these processes are fundamentally the same and only differ in quantitative terms. The present study evaluated the processing nature of true and false statements in terms of patterns of brain activity using event-related functional-Magnetic-Resonance-Imaging (fMRI). We show that when true and false concept-feature statements are controlled for relation strength/ambiguity, their processing is associated to qualitatively different processes. Verifying true statements activates the left inferior parietal cortex and the caudate nucleus, a neural correlate compatible with an extended search and matching process for particular stored information. In contrast, verifying false statements activates the fronto-polar cortex and is compatible with a reasoning process of finding and evaluating a contradiction between the sentence information and stored knowledge.

Using qualitative and quantitative methods to evaluate small-scale disease management pilot programs.

PubMed

Esposito, Dominick; Taylor, Erin Fries; Gold, Marsha

2009-02-01

Interest in disease management programs continues to grow as managed care plans, the federal and state governments, and other organizations consider such efforts as a means to improve health care quality and reduce costs. These efforts vary in size, scope, and target population. While large-scale programs provide the means to measure impacts, evaluation of smaller interventions remains valuable as they often represent the early planning stages of larger initiatives. This paper describes a multi-method approach for evaluating small interventions that sought to improve the quality of care for Medicaid beneficiaries with multiple chronic conditions. Our approach relied on quantitative and qualitative methods to develop a complete understanding of each intervention. Quantitative data in the form of both process measures, such as case manager contacts, and outcome measures, such as hospital use, were reported and analyzed. Qualitative information was collected through interviews and the development of logic models to document the flow of intervention activities and how they were intended to affect outcomes. The logic models helped us to understand the underlying reasons for the success or lack thereof of each intervention. The analysis provides useful information on several fronts. First, qualitative data provided valuable information about implementation. Second, process measures helped determine whether implementation occurred as anticipated. Third, outcome measures indicated the potential for favorable results later, possibly suggesting further study. Finally, the evaluation of qualitative and quantitative data in combination helped us assess the potential promise of each intervention and identify common themes and challenges across all interventions.

National Security Technology Incubator Evaluation Process

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

This report describes the process by which the National Security Technology Incubator (NSTI) will be evaluated. The technology incubator is being developed as part of the National Security Preparedness Project (NSPP), funded by a Department of Energy (DOE)/National Nuclear Security Administration (NNSA) grant. This report includes a brief description of the components, steps, and measures of the proposed evaluation process. The purpose of the NSPP is to promote national security technologies through business incubation, technology demonstration and validation, and workforce development. The NSTI will focus on serving businesses with national security technology applications by nurturing them through critical stages ofmore » early development. An effective evaluation process of the NSTI is an important step as it can provide qualitative and quantitative information on incubator performance over a given period. The vision of the NSTI is to be a successful incubator of technologies and private enterprise that assist the NNSA in meeting new challenges in national safety and security. The mission of the NSTI is to identify, incubate, and accelerate technologies with national security applications at various stages of development by providing hands-on mentoring and business assistance to small businesses and emerging or growing companies. To achieve success for both incubator businesses and the NSTI program, an evaluation process is essential to effectively measure results and implement corrective processes in the incubation design if needed. The evaluation process design will collect and analyze qualitative and quantitative data through performance evaluation system.« less

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example

PubMed Central

Mair, Frances S; Dowrick, Christopher; Brún, Mary O’Reilly-de; de Brún, Tomas; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; van den Muijsenbergh, Maria; van Weel-Baumgarten, Evelyn; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-01-01

Objectives To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Design Participatory research approach using qualitative methods. Setting Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. Participants RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Primary outcome measures Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Results Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE’s methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork. Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. Conclusion A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. PMID:28827231

Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

ERIC Educational Resources Information Center

Bruhns, Arthur E.

Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

Are We There Yet? Evaluating Library Collections, Reference Services, Programs, and Personnel.

ERIC Educational Resources Information Center

Robbins-Carter, Jane; Zweizig, Douglas L.

1985-01-01

This second in a five-lesson tutorial on library evaluation focuses on the evaluation of library collections. Highlights include the seven-step evaluation process described in lesson one; quantitative methods (total size, unfilled requests, circulation, turnover rate); and qualitative methods (impressionistic, list-checking). One required and…

Methodological Challenges in Cross-Language Qualitative Research: A Research Review

PubMed Central

Squires, Allison

2009-01-01

Objectives Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this critical review of cross-language qualitative research was three fold: 1) review the methods literature addressing cross language research; 2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; and 3) test these criteria on published cross-language qualitative studies. Data sources A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. Review methods The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. Results The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant’s language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. Conclusions The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically. PMID:18789799

Methodological challenges in cross-language qualitative research: a research review.

PubMed

Squires, Allison

2009-02-01

Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this analysis of cross-language qualitative research was threefold: (1) review the methods literature addressing cross-language research; (2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; (3) test these criteria on published cross-language qualitative studies. A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant's language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically.

Factors Influencing Hand Washing Behaviour in Primary Schools: Process Evaluation within a Randomized Controlled Trial

ERIC Educational Resources Information Center

Chittleborough, Catherine R.; Nicholson, Alexandra L.; Basker, Elaine; Bell, Sarah; Campbell, Rona

2012-01-01

This article explores factors that may influence hand washing behaviour among pupils and staff in primary schools. A qualitative process evaluation within a cluster randomized controlled trial included pupil focus groups (n = 16, aged 6-11 years), semi-structured interviews (n = 16 teachers) and observations of hand washing facilities (n = 57).…

On Becoming Allies: A Qualitative Study of Lesbian-, Gay-, and Bisexual-Affirmative Counselor Training

ERIC Educational Resources Information Center

Dillon, Frank R.; Worthington, Roger L.; Savoy, Holly Bielstein; Rooney, S. Craig; Becker-Schutte, Ann; Guerra, Rachael M.

2004-01-01

The authors present a qualitative analysis of a process by which a research team of counselors-in-training confronted their heterosexist biases while investigating heterosexual attitudes toward sexual minorities. Members of the research team discovered that it was essential to reflect on and evaluate their attitudes, assumptions, and biases before…

The trees and the forest: mixed methods in the assessment of recovery based interventions' processes and outcomes in mental health.

PubMed

Hasson-Ohayon, Ilanit; Roe, David; Yanos, Philip T; Lysaker, Paul H

2016-12-01

Recent developments in mental health have emphasized recovery as an outcome for people with serious mental illness (SMI). Accordingly, several studies have attempted to evaluate the process and outcome of recovery-oriented psychosocial interventions. To review and discuss quantitative and qualitative findings from previous efforts to study the impact of five recovery-oriented interventions: Illness Management and Recovery (IMR), Narrative Enhancement and Cognitive Therapy (NECT), Supported Employment (SE), Supported Socialization (SS), and Family Psychoeducation. Reviewing the literature on studies that examine the effectiveness of these interventions by using both quantitative and qualitative approach. Qualitative findings in these studies augment quantitative findings and at times draw attention to unexpected findings and uniquely illuminate the effects of these interventions on self-reflective processes. There is a need for further exploration of how mixed-methods can be implemented to explore recovery-oriented outcomes. Critical questions regarding the implications of qualitative findings are posed.

Task sharing in rural Haiti: Qualitative assessment of a brief, structured training with and without apprenticeship supervision for community health workers

PubMed Central

McLean, Kristen E; Kaiser, Bonnie N; Hagaman, Ashley K; Wagenaar, Bradley H; Therosme, Tatiana P; Kohrt, Brandon A

2015-01-01

Despite growing support for supervision after task sharing trainings in humanitarian settings, there is limited research on the experience of trainees in apprenticeship and other supervision approaches. Studying apprenticeships from trainees’ perspectives is crucial to refine supervision and enhance motivation for service implementation. The authors implemented a multi-stage, transcultural adaptation for a pilot task sharing training in Haiti entailing three phases: 1) literature review and qualitative research to adapt a mental health and psychosocial support training; 2) implementation and qualitative process evaluation of a brief, structured group training; and 3) implementation and qualitative evaluation of an apprenticeship training, including a two year follow-up of trainees. Structured group training revealed limited knowledge acquisition, low motivation, time and resource constraints on mastery, and limited incorporation of skills into practice. Adding an apprenticeship component was associated with subjective clinical competency, increased confidence regarding utilising skills, and career advancement. Qualitative findings support the added value of apprenticeship according to trainees. PMID:26190953

Elementary Teachers' Views on the Creative Writing Process: An Evaluation

ERIC Educational Resources Information Center

Akkaya, Nevin

2014-01-01

The goal of this study is to discover and evaluate both the areas of personal interest and the views of 4th and 5th grade classroom teachers regarding the creative writing process. In this study, one of the qualitative study methods, state study, and related to this, single state design which refers to the whole has been chosen. Research was…

Integrating Evidence Within and Across Evidence Streams Using Qualitative Methods

EPA Science Inventory

There is high demand in environmental health for adoption of a structured process that evaluates and integrates evidence while making decisions transparent. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework holds promise to address this deman...

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Introduction Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Methods Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Results Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. Conclusions The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Evaluation of board performance in Iran's universities of medical sciences.

PubMed

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-10-01

The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Participants believed that the boards had no acceptable performance for a long time.RESULTS also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards' resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process.

Evaluation of board performance in Iran’s universities of medical sciences

PubMed Central

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-01-01

Background: The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. Methods: The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Results: Participants believed that the boards had no acceptable performance for a long time.Results also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards’ resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Conclusion: Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process. PMID:25337597

[Participation, knowledge production, and evaluative research: participation by different actors in a mental health study].

PubMed

Furtado, Juarez Pereira; Campos, Rosana Onocko

2008-11-01

This article reflects on the interrelations between participation, knowledge production, and public policy evaluation in light of issues from our own experience with evaluative research on a municipal network of Psychosocial Care Centers (CAPS) in Brazil. The article discusses the coordination of the complex process and the potentials and limits of partnerships for conducting qualitative evaluative studies in mental health with participation by different social actors. The authors conclude that qualitative evaluative research aligned with the perspective of including different points of view representing various segments is the best approach for understanding the numerous spin-offs from the implementation of services linked to the Brazilian psychiatric reform movement, given the inherent specificities of the mental health field.

Nondestructive evaluation of degradation in papaya fruit using intensity based algorithms

NASA Astrophysics Data System (ADS)

Kumari, Shubhashri; Nirala, Anil Kumar

2018-05-01

In the proposed work degradation in Papaya fruit has been evaluated nondestructively using laser biospeckle technique. The biospeckle activity inside the fruit has been evaluated qualitatively and quantitatively during its maturity to degradation stage using intensity based algorithms. Co-occurrence matrix (COM) has been used for qualitative analysis whereas Inertia Moment (IM), Absolute value Difference (AVD) and Autocovariance methods have been used for quantitative analysis. The biospeckle activity has been found to first increase and then decrease during study period of five days. In addition Granulometric size distribution (GSD) has also been used for the first time for the evaluation of degradation of the papaya. It is concluded that the degradation process of papaya fruit can be evaluated nondestructively using all the mentioned algorithms.

Tools for evaluating Veterinary Services: an external auditing model for the quality assurance process.

PubMed

Melo, E Correa

2003-08-01

The author describes the reasons why evaluation processes should be applied to the Veterinary Services of Member Countries, either for trade in animals and animal products and by-products between two countries, or for establishing essential measures to improve the Veterinary Service concerned. The author also describes the basic elements involved in conducting an evaluation process, including the instruments for doing so. These basic elements centre on the following:--designing a model, or desirable image, against which a comparison can be made--establishing a list of processes to be analysed and defining the qualitative and quantitative mechanisms for this analysis--establishing a multidisciplinary evaluation team and developing a process for standardising the evaluation criteria.

QATT: a Natural Language Interface for QPE. M.S. Thesis

NASA Technical Reports Server (NTRS)

White, Douglas Robert-Graham

1989-01-01

QATT, a natural language interface developed for the Qualitative Process Engine (QPE) system is presented. The major goal was to evaluate the use of a preexisting natural language understanding system designed to be tailored for query processing in multiple domains of application. The other goal of QATT is to provide a comfortable environment in which to query envisionments in order to gain insight into the qualitative behavior of physical systems. It is shown that the use of the preexisting system made possible the development of a reasonably useful interface in a few months.

Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

PubMed

Cypress, Brigitte S

Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example.

PubMed

O'Donnell, Catherine A; Mair, Frances S; Dowrick, Christopher; Brún, Mary O'Reilly-de; Brún, Tomas de; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; Muijsenbergh, Maria van den; Weel-Baumgarten, Evelyn van; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-08-21

To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Participatory research approach using qualitative methods. Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE's methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork.Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

From themes to hypotheses: following up with quantitative methods.

PubMed

Morgan, David L

2015-06-01

One important category of mixed-methods research designs consists of quantitative studies that follow up on qualitative research. In this case, the themes that serve as the results from the qualitative methods generate hypotheses for testing through the quantitative methods. That process requires operationalization to translate the concepts from the qualitative themes into quantitative variables. This article illustrates these procedures with examples that range from simple operationalization to the evaluation of complex models. It concludes with an argument for not only following up qualitative work with quantitative studies but also the reverse, and doing so by going beyond integrating methods within single projects to include broader mutual attention from qualitative and quantitative researchers who work in the same field. © The Author(s) 2015.

Adding Dimension to Evaluative Research Through the Use of Protocol Material.

ERIC Educational Resources Information Center

Tittle, Carol Kehr

A rationale and illustration of the use of original records or protocol materials in an evaluation research report are described. Records of school observations and audiotape transcripts were selected to represent the concepts or categories which were developed in the process of evaluation. These qualitative data were collected in a project which…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

Influence on Learning of a Collaborative Learning Method Comprising the Jigsaw Method and Problem-based Learning (PBL).

PubMed

Takeda, Kayoko; Takahashi, Kiyoshi; Masukawa, Hiroyuki; Shimamori, Yoshimitsu

2017-01-01

Recently, the practice of active learning has spread, increasingly recognized as an essential component of academic studies. Classes incorporating small group discussion (SGD) are conducted at many universities. At present, assessments of the effectiveness of SGD have mostly involved evaluation by questionnaires conducted by teachers, by peer assessment, and by self-evaluation of students. However, qualitative data, such as open-ended descriptions by students, have not been widely evaluated. As a result, we have been unable to analyze the processes and methods involved in how students acquire knowledge in SGD. In recent years, due to advances in information and communication technology (ICT), text mining has enabled the analysis of qualitative data. We therefore investigated whether the introduction of a learning system comprising the jigsaw method and problem-based learning (PBL) would improve student attitudes toward learning; we did this by text mining analysis of the content of student reports. We found that by applying the jigsaw method before PBL, we were able to improve student attitudes toward learning and increase the depth of their understanding of the area of study as a result of working with others. The use of text mining to analyze qualitative data also allowed us to understand the processes and methods by which students acquired knowledge in SGD and also changes in students' understanding and performance based on improvements to the class. This finding suggests that the use of text mining to analyze qualitative data could enable teachers to evaluate the effectiveness of various methods employed to improve learning.

Qualitative research in palliative care 1990-1999: a descriptive review.

PubMed

Froggatt, Katherine A; Field, David; Bailey, Chris; Krishnasamy, Meinir

2003-03-01

A collaborative, evaluative review of qualitative research in palliative care published between 1990 and 1999 has been conducted. Nearly 30,000 articles in 48 journals from specialist palliative care, oncology, death studies, medicine, nursing, gerontology, health and the social sciences were examined. From these journals, 138 articles (0.5%) reporting qualitative research with a focus on palliative care in the context of death, dying or bereavement were identified. These articles were reviewed using a proforma designed by the group. This article describes the review process, and the following findings: the distribution of different forms of qualitative research in palliative care; the location of such papers; the focus of the research; and the research methodology and methods adopted.

Automated simulation as part of a design workstation

NASA Technical Reports Server (NTRS)

Cantwell, E.; Shenk, T.; Robinson, P.; Upadhye, R.

1990-01-01

A development project for a design workstation for advanced life-support systems incorporating qualitative simulation, required the implementation of a useful qualitative simulation capability and the integration of qualitative and quantitative simulations, such that simulation capabilities are maximized without duplication. The reason is that to produce design solutions to a system goal, the behavior of the system in both a steady and perturbed state must be represented. The paper reports on the Qualitative Simulation Tool (QST), on an expert-system-like model building and simulation interface toll called ScratchPad (SP), and on the integration of QST and SP with more conventional, commercially available simulation packages now being applied in the evaluation of life-support system processes and components.

The relevance of qualitative research for clinical programs in psychiatry.

PubMed

Goering, Paula; Boydell, Katherine M; Pignatiello, Antonio

2008-03-01

It is time to move beyond education about qualitative research theory and methods to using them to understand and improve psychiatric practice. There is a good fit between this agenda and current thinking about research use that broadens definitions of evidence beyond the results of experiments. This paper describes a qualitative program evaluation to illustrate what kind of useful knowledge is generated and how it can be created through a clinician-researcher partnership. The linkage and exchange model of effective knowledge translation described involves interaction between clinicians and researchers throughout the research process and results in mutual learning through the planning, disseminating, and application of existing or new qualitative research in decision making.

Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care.

PubMed

Grant, Aileen; Dreischulte, Tobias; Treweek, Shaun; Guthrie, Bruce

2012-08-28

Trials of complex interventions are criticized for being 'black box', so the UK Medical Research Council recommends carrying out a process evaluation to explain the trial findings. We believe it is good practice to pre-specify and publish process evaluation protocols to set standards and minimize bias. Unlike protocols for trials, little guidance or standards exist for the reporting of process evaluations. This paper presents the mixed-method process evaluation protocol of a cluster randomized trial, drawing on a framework designed by the authors. This mixed-method evaluation is based on four research questions and maps data collection to a logic model of how the data-driven quality improvement in primary care (DQIP) intervention is expected to work. Data collection will be predominately by qualitative case studies in eight to ten of the trial practices, focus groups with patients affected by the intervention and quantitative analysis of routine practice data, trial outcome and questionnaire data and data from the DQIP intervention. We believe that pre-specifying the intentions of a process evaluation can help to minimize bias arising from potentially misleading post-hoc analysis. We recognize it is also important to retain flexibility to examine the unexpected and the unintended. From that perspective, a mixed-methods evaluation allows the combination of exploratory and flexible qualitative work, and more pre-specified quantitative analysis, with each method contributing to the design, implementation and interpretation of the other.As well as strengthening the study the authors hope to stimulate discussion among their academic colleagues about publishing protocols for evaluations of randomized trials of complex interventions. DATA-DRIVEN QUALITY IMPROVEMENT IN PRIMARY CARE TRIAL REGISTRATION: ClinicalTrials.gov: NCT01425502.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Processing and enzymatic treatment effects on Louisiana-grown fresh satsuma juice

USDA-ARS?s Scientific Manuscript database

A study was performed to evaluate the ability to rapidly produce fresh satsuma juice from local fruit with minimum processing inputs. Volatile flavor and aroma compounds, subjective assessments, and quality parameters were used to determine the qualitative changes that occur from different juice pr...

An Evaluation of the Federal Class-Size Reduction Program in Wake County, North Carolina--1999-2000.

ERIC Educational Resources Information Center

Scudder, David F.

An empirical evaluation of the federal class-size reduction (CSR) program in Wake County, North Carolina, during the 1999-2000 school year is presented. The qualitative process evaluation showed implementation issues involving the mechanics and the meaning of CSR. Often, schools did not understand where CSR occurred because of changing enrollment…

A Qualitative Approach to the Evaluation of Expert Systems Shells.

ERIC Educational Resources Information Center

Slawson, Dean A.; And Others

This study explores an approach to the evaluation of expert system shells using case studies. The methodology and some of the results of an evaluation of the prototype development of an expert system using the shell "M1" are detailed, including a description of the participants and the project, the data collection process and materials,…

Managing Cognitive Dissonance: Experience from an Environmental Education Teachers' Training Course in the Czech Republic

ERIC Educational Resources Information Center

Cincera, Jan

2013-01-01

This paper presents a qualitative evaluation of seven in-service environmental education teacher training courses conducted in the Czech Republic in 2009-2011. The evaluation applied a grounded theory approach. 14 focus groups, 13 interviews and two post-programme questionnaires were used. The evaluation describes a process of managing cognitive…

Organizational Analysis of the United States Army Evaluation Center

DTIC Science & Technology

2014-12-01

analysis of qualitative or quantitative data obtained from design reviews, hardware inspections, M&S, hardware and software testing , metrics review... Research Development Test & Evaluation (RDT&E) appropriation account. The Defense Acquisition Portal ACQuipedia website describes RDT&E as “ one of the... research , design , development, test and evaluation, production, installation, operation, and maintenance; data collection; processing and analysis

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

Developing Recruitment Methods for Vulnerable, Traumatized Adolescents: A Feminist Evaluation Approach

ERIC Educational Resources Information Center

Campbell, Rebecca; Greeson, Megan R.; Fehler-Cabral, Giannina

2014-01-01

This article describes the process by which we created a recruitment protocol for engaging adolescent sexual assault victims in a qualitative evaluation study. Working in collaboration with forensic nurses, rape victim advocates, adolescent rape survivors, and our institutional review board (IRB), we created a prospective recruitment method…

Sources of Confidence in School Community Councils

ERIC Educational Resources Information Center

Nygaard, Richard

2010-01-01

Three Utah middle level school community councils participated in a qualitative strengths-based process evaluation. Two of the school community councils were identified as exemplary, and the third was just beginning to function. One aspect of the evaluation was the source of school community council members' confidence. Each school had unique…

Evaluating Organizational Change at a Multinational Transportation Corporation: Method and Reflections

ERIC Educational Resources Information Center

Plakhotnik, Maria S.

2016-01-01

The purpose of this perspective on practice is to share my experience conducting an organizational change evaluation using qualitative methodology at a multinational transportation company Global Logistics. I provide a detailed description of the three phase approach to data analysis and my reflections on the process.

Do Different Training Conditions Facilitate Team Implementation? A Quasi-Experimental Mixed Methods Study

ERIC Educational Resources Information Center

Nielsen, Karina; Randall, Raymond; Christensen, Karl B.

2017-01-01

A mixed methods approach was applied to examine the effects of a naturally occurring teamwork intervention supported with training. The first objective was to integrate qualitative process evaluation and quantitative effect evaluation to examine "how" and "why" the training influence intervention outcomes. The intervention (N =…

Cognitive Apprenticeship in Health Sciences Education: A Qualitative Review

ERIC Educational Resources Information Center

Lyons, Kayley; McLaughlin, Jacqueline E.; Khanova, Julia; Roth, Mary T.

2017-01-01

Cognitive apprenticeship theory emphasizes the process of making expert thinking "visible" to students and fostering the cognitive and meta-cognitive processes required for expertise. The purpose of this review was to evaluate the use of cognitive apprenticeship theory with the primary aim of understanding how and to what extent the…

Evaluation of two CD-ROMs from a series on cell biology.

PubMed

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation.

Evaluation of Two CD-ROMs from a Series on Cell Biology

PubMed Central

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation. PMID:14673491

Evaluation methodology for comparing memory and communication of analytic processes in visual analytics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ragan, Eric D; Goodall, John R

2014-01-01

Provenance tools can help capture and represent the history of analytic processes. In addition to supporting analytic performance, provenance tools can be used to support memory of the process and communication of the steps to others. Objective evaluation methods are needed to evaluate how well provenance tools support analyst s memory and communication of analytic processes. In this paper, we present several methods for the evaluation of process memory, and we discuss the advantages and limitations of each. We discuss methods for determining a baseline process for comparison, and we describe various methods that can be used to elicit processmore » recall, step ordering, and time estimations. Additionally, we discuss methods for conducting quantitative and qualitative analyses of process memory. By organizing possible memory evaluation methods and providing a meta-analysis of the potential benefits and drawbacks of different approaches, this paper can inform study design and encourage objective evaluation of process memory and communication.« less

A front-of-pack nutrition logo: a quantitative and qualitative process evaluation in the Netherlands.

PubMed

Vyth, Ellis L; Steenhuis, Ingrid H M; Mallant, Sanne F; Mol, Zinzi L; Brug, Johannes; Temminghoff, Marcel; Feunekes, Gerda I; Jansen, Leon; Verhagen, Hans; Seidell, Jacob C

2009-01-01

This study aimed to perform a quantitative and qualitative process evaluation of the introduction of the Choices logo, a front-of-pack nutrition logo on products with a favorable product composition, adopted by many food producers, retail and food service organizations, conditionally endorsed by the Dutch government, validated by scientists, and in the process of international dissemination. An online questionnaire was sent to adult consumers 4 months after the introduction of the logo (n = 1,032) and 1 year later (n = 1,127). Additionally, seven consumer focus groups (n = 41) were conducted to provide more insight into the questionnaire responses. Quantitative analyses showed that exposure to the logo had significantly increased. Elderly and obese respondents reported to be more in need of a logo than younger and normal-weight individuals. Women perceived the logo more attractive and credible than men did. Further qualitative analyses indicated that the logo's credibility would improve if it became known that governmental and scientific authorities support it. Elderly respondents indicated that they needed a logo due to health concerns. Consumers interested in health reported that they used the logo. Further research focusing on specific target groups, forming healthful diets, and health outcomes is needed to investigate the effectiveness of the Choices logo.

Traditional and nontraditional evaluations of student outcomes in a practical final examination of veterinary radiology.

PubMed

Koskinen, Heli I

2010-01-01

The Faculty of Veterinary Medicine at the University of Helsinki recognized the lack of systems to measure the quality of education. At the department level, this meant lack of systems to measure the quality of students' outcomes. The aim of this article was to compare the quality of outcomes of a final examination in veterinary radiology by calculating the correlations between traditional (quantitative scores traditionally given by veterinary teachers) and nontraditional (qualitative Structure of the Observed Learning Outcome, or SOLO, method) grading results. Evaluation of the quality of the questions is also included. The results indicate that SOLO offers criteria for quality evaluation, especially for questions. A correlation of 0.60 (p<0.01) existed between qualitative and quantitative estimations, and a correlation of 0.79 (p<0.01) existed between evaluators, both using traditional scores. Two suggestions for a better system to evaluate quality in the future: First, development of problem-solving skills during the learning process should also be assessed. Second, both the scoring of factual correctness of answers (knowledge) and the grammatical structure of an answer and the quality of presentation should be included in the quality evaluation process.

Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations.

PubMed

Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C

2015-03-10

In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross-organizational findings about implementing healthcare innovations while also enhancing organizational capacity and accelerating translation of findings by facilitating continuous learning within individual sites. Researchers evaluating change initiatives and healthcare organizations implementing improvement initiatives may benefit from a Learning Evaluation approach.

Interdisciplinary evaluation of dysphagia: clinical swallowing evaluation and videoendoscopy of swallowing.

PubMed

Sordi, Marina de; Mourão, Lucia Figueiredo; Silva, Ariovaldo Armando da; Flosi, Luciana Claudia Leite

2009-01-01

Patients with dysphagia have impairments in many aspects, and an interdisciplinary approach is fundamental to define diagnosis and treatment. A joint approach in the clinical and videoendoscopy evaluation is paramount. To study the correlation between the clinical assessment (ACD) and the videoendoscopic (VED) assessment of swallowing by classifying the degree of severity and the qualitative/descriptive analyses of the procedures. cross-sectional, descriptive and comparative. held from March to December of 2006, at the Otolaryngology/Dysphagia ward of a hospital in the country side of São Paulo. 30 dysphagic patients with different disorders were assessed by ACD and VED. The data was classified by means of severity scales and qualitative/ descriptive analysis. the correlation between severity ACD and VED scales pointed to a statistically significant low agreement (KAPA = 0.4) (p=0,006). The correlation between the qualitative/descriptive analysis pointed to an excellent and statistically significant agreement (KAPA=0.962) (p<0.001) concerning the entire sample. the low agreement between the severity scales point to a need to perform both procedures, reinforcing VED as a doable procedure. The descriptive qualitative analysis pointed to an excellent agreement, and such data reinforces our need to understand swallowing as a process.

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets.

PubMed

Jones, Janet E; Jones, Laura L; Keeley, Thomas J H; Calvert, Melanie J; Mathers, Jonathan

2017-01-01

To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate the time and resources required to incorporate qualitative methods into COS development.

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets

PubMed Central

2017-01-01

Background To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. Methods In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Results Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Conclusions Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate the time and resources required to incorporate qualitative methods into COS development. PMID:28301485

Automated simulation as part of a design workstation

NASA Technical Reports Server (NTRS)

Cantwell, Elizabeth; Shenk, T.; Robinson, P.; Upadhye, R.

1990-01-01

A development project for a design workstation for advanced life-support systems (called the DAWN Project, for Design Assistant Workstation), incorporating qualitative simulation, required the implementation of a useful qualitative simulation capability and the integration of qualitative and quantitative simulation such that simulation capabilities are maximized without duplication. The reason is that to produce design solutions to a system goal, the behavior of the system in both a steady and perturbed state must be represented. The Qualitative Simulation Tool (QST), on an expert-system-like model building and simulation interface toll called ScratchPad (SP), and on the integration of QST and SP with more conventional, commercially available simulation packages now being applied in the evaluation of life-support system processes and components are discussed.

Evaluating the Healthy Start program. Design development to evaluative assessment.

PubMed

Raykovich, K S; McCormick, M C; Howell, E M; Devaney, B L

1996-09-01

The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could be used to evaluate 15 diverse grantees. This article discusses the experience of creating a process and outcomes evaluation design that was both substantively and methodologically appropriate given such issues as the diversity of grantees and their community-based intervention strategies; the process of accessing secondary data sources, including vital records; the quality of client level data submissions; and the need to incorporate both qualitative and quantitative approaches into the evaluation design. The relevance of this experience for the conduct of other field studies of public health interventions is discussed.

Finding Quality Geometry Apps: Not as Simple as a[superscript 2] + b[superscript 2] = c[superscript 2

ERIC Educational Resources Information Center

Larkin, Kevin

2016-01-01

Trying to find quality apps for use in mathematics classes can be time consuming and bewildering. This article outlines a process for evaluating apps and provides teachers with access to comprehensive qualitative evaluations of 53 geometrical apps based on pedagogical, mathematical and cognitive fidelities.

Relationship between Teacher Self-Efficacy and the Teacher Evaluation Process

ERIC Educational Resources Information Center

Pisciotta, Summer

2014-01-01

Changes in state laws led the education system personnel in Arizona to reconsider how they assess students, teachers, and administrators. Higher expectations for teacher and student performance and a budget deficit at schools resulted in evaluations being a focal point in teacher contract renewal. The purpose of this qualitative case study was to…

Models Matter--The Final Report of the National Longitudinal Evaluation of Comprehensive School Reform

ERIC Educational Resources Information Center

Aladjem, Daniel K.; LeFloch, Kerstin Carlson; Zhang, Yu; Kurki, Anja; Boyle, Andrea; Taylor, James E.; Herrmann, Suzannah; Uekawa, Kazuaki; Thomsen, Kerri; Fashola, Olatokunbo

2006-01-01

The National Longitudinal Evaluation of Comprehensive School Reform (NLECSR) is a quantitative and qualitative study of behavior, decisions, processes, and outcomes. It employs a quasi-experimental design with matched treatment and comparison schools. NLECSR seeks to determine the effects of CSR models on student achievement in about 650…

Entertainment Education and Social Change: Evaluating a Children's Soap Opera in Kenya

ERIC Educational Resources Information Center

de Block, Liesbeth

2012-01-01

This article discusses audience responses to a children's soap opera produced and broadcast in Kenya. It examines the evaluation process in relation to qualitative audience research within Cultural Studies. It challenges an Entertainment-Education model of media as vehicles for messages and links strongly with Communication for Social Change…

Framework for Optimizing the Evaluation of Data From Contaminated Soil in Sweden

EPA Science Inventory

The Swedish guidelines for the evaluation of data for the purpose of a risk assessment at contaminated sites are of a qualitative character, as opposed to the USEPA’s Data Quality Objective Process. In Sweden, this can sometimes be a problem because the demands on data quality ar...

Multi-Method Evaluation of College Teaching

ERIC Educational Resources Information Center

Algozzine, Bob; Beattie, John; Bray, Marty; Flowers, Claudia; Gretes, John; Mohanty, Ganesh; Spooner, Fred

2010-01-01

Student evaluation of instruction in college and university courses has been a routine and mandatory part of undergraduate and graduate education for some time. A major shortcoming of the process is that it relies exclusively on the opinions or qualitative judgments of students rather than on assessing the learning or transfer of knowledge that…

Associating versus Proposing or Associating What We Propose: Comment on Gawronski and Bodenhausen

ERIC Educational Resources Information Center

Albarracin, Dolores; Hart, William; McCulloch, Kathleen C.

2006-01-01

This commentary on the article by B. Gawronski and G. V. Bodenhausen (see record 2006-10465-003) highlights the strengths of the associative-propositional evaluation model. It then describes problems in proposing a qualitative separation between propositional and associative processes. Propositional processes are instead described as associative.…

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Development of water quality standards criteria. [for consumables (spacecrew supplies)

NASA Technical Reports Server (NTRS)

1976-01-01

Qualitative and semiquantitative analyses were made of volatile organic compounds in water supplies collected at various stages of processing in the space station prototype vacuum compression distillation unit to evaluate the process and the product water. Additional evaluation was made of specific ingredients required to adequately enhance the taste of the reclaimed water. A concept for the in-flight addition of these ingredients was developed. Revisions to previously recommended potable water criteria and specifications are included.

Qualitative Methods in Mental Health Services Research

PubMed Central

Palinkas, Lawrence A.

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This paper reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the papers included in this special series along with representative examples from the literature. Qualitative methods are used to provide a “thick description” or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods, but often differ with respect to study design, data collection and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semi-structured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research. PMID:25350675

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

Process Evaluation of the Project SHINE Intervention for African American Families: An Integrated Positive Parenting and Peer Monitoring Approach to Health Promotion.

PubMed

St George, Sara M; Wilson, Dawn K; McDaniel, Tyler; Alia, Kassandra A

2016-07-01

This study describes the process evaluation of Project SHINE, a randomized family-based health promotion intervention that integrated parenting and peer monitoring for improving sedentary behavior, physical activity, and diet in African American families. Adolescent-parent dyads (n = 89) were randomized to a 6-week behavioral, positive parenting, and peer monitoring skills intervention or a general health education comparison condition. Process evaluation included observational ratings of fidelity, attendance records, psychosocial measures, and qualitative interviews. Results indicated that the intervention was delivered with high fidelity based on facilitator adherence (>98% of content delivered) and competent use of theoretically based behavior change and positive parenting skills (100% of ratings >3 on a 1-4 scale). Although only 43% of peers attended the "bring a friend" session, overall attendance was high (4.39 ± 1.51 sessions) as was the retention rate (88%). Parents in the intervention condition reported significant improvements in communication related to adolescents' engagement in health behaviors both on their own and with peers. These findings were supported by qualitative themes related to improvements in family communication and connectedness. This study provides an innovative example of how future family-based health promotion trials can expand their process evaluation approaches by assessing theoretically relevant positive parenting variables as part of ongoing monitoring. © 2016 Society for Public Health Education.

The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice.

PubMed

Breimaier, Helga E; Heckemann, Birgit; Halfens, Ruud J G; Lohrmann, Christa

2015-01-01

Implementing clinical practice guidelines (CPGs) in healthcare settings is a complex intervention involving both independent and interdependent components. Although the Consolidated Framework for Implementation Research (CFIR) has never been evaluated in a practical context, it appeared to be a suitable theoretical framework to guide an implementation process. The aim of this study was to evaluate the comprehensiveness, applicability and usefulness of the CFIR in the implementation of a fall-prevention CPG in nursing practice to improve patient care in an Austrian university teaching hospital setting. The evaluation of the CFIR was based on (1) team-meeting minutes, (2) the main investigator's research diary, containing a record of a before-and-after, mixed-methods study design embedded in a participatory action research (PAR) approach for guideline implementation, and (3) an analysis of qualitative and quantitative data collected from graduate and assistant nurses in two Austrian university teaching hospital departments. The CFIR was used to organise data per and across time point(s) and assess their influence on the implementation process, resulting in implementation and service outcomes. Overall, the CFIR could be demonstrated to be a comprehensive framework for the implementation of a guideline into a hospital-based nursing practice. However, the CFIR did not account for some crucial factors during the planning phase of an implementation process, such as consideration of stakeholder aims and wishes/needs when implementing an innovation, pre-established measures related to the intended innovation and pre-established strategies for implementing an innovation. For the CFIR constructs reflecting & evaluating and engaging, a more specific definition is recommended. The framework and its supplements could easily be used by researchers, and their scope was appropriate for the complexity of a prospective CPG-implementation project. The CFIR facilitated qualitative data analysis and provided a structure that allowed project results to be organised and viewed in a broader context to explain the main findings. The CFIR was a valuable and helpful framework for (1) the assessment of the baseline, process and final state of the implementation process and influential factors, (2) the content analysis of qualitative data collected throughout the implementation process, and (3) explaining the main findings.

Toward an agenda for evaluation of qualitative research.

PubMed

Stige, Brynjulf; Malterud, Kirsti; Midtgarden, Torjus

2009-10-01

Evaluation is essential for research quality and development, but the diversity of traditions that characterize qualitative research suggests that general checklists or shared criteria for evaluation are problematic. We propose an approach to research evaluation that encourages reflexive dialogue through use of an evaluation agenda. In proposing an evaluation agenda we shift attention from rule-based judgment to reflexive dialogue. Unlike criteria, an agenda may embrace pluralism, and does not request consensus on ontological, epistemological, and methodological issues, only consensus on what themes warrant discussion. We suggest an evaluation agenda-EPICURE-with two dimensions communicated through use of two acronyms.The first, EPIC, refers to the challenge of producing rich and substantive accounts based on engagement, processing, interpretation, and (self-)critique. The second-CURE-refers to the challenge of dealing with preconditions and consequences of research, with a focus on (social) critique, usefulness, relevance, and ethics. The seven items of the composite agenda EPICURE are presented and exemplified. Features and implications of the agenda approach to research evaluation are then discussed.

Presenting qualitative data through the co-construction of a model.

PubMed

Chenery-Morris, Sam

2014-09-01

Research skills are developed in pre-registration midwifery curricula to enhance student midwives' appreciation and appropriate application of evidence within their midwifery practice. A spontaneous, innovative session was facilitated based on student experiences of non-midwifery placements, which helped demonstrate how qualitative data are analysed and can then be presented. By listening to each other's varied experiences, the students were able to relate their research knowledge to date with their collective 'empirical data' to enhance their understanding of presenting qualitative research. The paper reports on the learning process. It is an evaluation of the session, with student permission for publication gained; it is not research.

Unruly grandmothers, ghosts and ancestors: Chinese elders and the importance of culture in dementia evaluations.

PubMed

Elliott, Kathryn S; Di Minno, Mariann

2006-01-01

This article explores the cultural clashes that occurred when Chinese patients at an Alzheimer's center in California were evaluated for dementia. Lack of familiarity with Chinese culture made the culturally mainstream American clinicians at this center more likely to misinterpret the behavior of elderly Chinese-speaking patients and their families and, thereby, more likely to misdiagnose such patients and suggest culturally inappropriate recommendations. This tendency was reduced when relevant cultural knowledge was incorporated into the clinical evaluation. The evaluation process at this clinic and two patient examples are discussed to illustrate that familiarity with a patient's cultural background is essential for accurate diagnosis and referral. This ethnographic case study places the evaluation process in one particular clinic in cultural context and is suggestive in the way that exploratory qualitative research is meant to be, rather than broadly representative of dementia clinics or clinicians as a whole. However, problems created by cultural clashes at this clinic do suggest that what may be happening at other dementia clinics as they encounter increasingly more patients from diverse cultural backgrounds is an important empirical question worthy of further research, using both qualitative and quantitative methods.

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

Involving Young People in Changing Their School Environment to Make It Safer: Findings from a Process Evaluation in English Secondary Schools

ERIC Educational Resources Information Center

Fletcher, Adam; Fitzgerald-Yau, Natasha; Wiggins, Meg; Viner, Russell M.; Bonell, Chris

2015-01-01

Purpose: The purpose of this paper is to explore the process of involving students and staff on school action groups, and staff and student experiences of reviewing local data and initiating school-level changes, to address bullying and other aggression. Design/methodology/approach: The authors draw on qualitative, process data collected at four…

‘What difference does it make?’ Finding evidence of the impact of mental health service user researchers on research into the experiences of detained psychiatric patients

PubMed Central

Gillard, Steven; Borschmann, Rohan; Turner, Kati; Goodrich‐Purnell, Norman; Lovell, Kathleen; Chambers, Mary

2010-01-01

Abstract Background  Interest in the involvement of members of the public in health services research is increasingly focussed on evaluation of the impact of involvement on the research process and the production of knowledge about health. Service user involvement in mental health research is well‐established, yet empirical studies into the impact of involvement are lacking. Objective  To investigate the potential to provide empirical evidence of the impact of service user researchers (SURs) on the research process. Design  The study uses a range of secondary analyses of interview transcripts from a qualitative study of the experiences of psychiatric patients detained under the Mental Health Act (1983) to compare the way in which SURs and conventional university researchers (URs) conduct and analyse qualitative interviews. Results  Analyses indicated some differences in the ways in which service user‐ and conventional URs conducted qualitative interviews. SURs were much more likely to code (analyse) interview transcripts in terms of interviewees’ experiences and feelings, while conventional URs coded the same transcripts largely in terms of processes and procedures related to detention. The limitations of a secondary analysis based on small numbers of researchers are identified and discussed. Conclusions  The study demonstrates the potential to develop a methodologically robust approach to evaluate empirically the impact of SURs on research process and findings, and is indicative of the potential benefits of collaborative research for informing evidence‐based practice in mental health services. PMID:20536538

A human factors systems approach to understanding team-based primary care: a qualitative analysis

PubMed Central

Mundt, Marlon P.; Swedlund, Matthew P.

2016-01-01

Background. Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. Objective. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. Methods. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Results. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Conclusions. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. PMID:27578837

Interdisciplinary Studies and the Real World: A Practical Rationale for and Guide to Postgraduation Evaluation and Assessment

ERIC Educational Resources Information Center

Brooks, Benjamin; Widders, Evan

2012-01-01

This article is an outgrowth of the evaluation and assessment process in a large interdisciplinary studies (IDS) program at West Virginia University. We argue for the importance of collecting and assessing quantitative and qualitative data concerning learning outcomes, student satisfaction, career choice and development, and graduate education…

Finding Qualitative Research Evidence for Health Technology Assessment.

PubMed

DeJean, Deirdre; Giacomini, Mita; Simeonov, Dorina; Smith, Andrea

2016-08-01

Health technology assessment (HTA) agencies increasingly use reviews of qualitative research as evidence for evaluating social, experiential, and ethical aspects of health technologies. We systematically searched three bibliographic databases (MEDLINE, CINAHL, and Social Science Citation Index [SSCI]) using published search filters or "hedges" and our hybrid filter to identify qualitative research studies pertaining to chronic obstructive pulmonary disease and early breast cancer. The search filters were compared in terms of sensitivity, specificity, and precision. Our screening by title and abstract revealed that qualitative research constituted only slightly more than 1% of all published research on each health topic. The performance of the published search filters varied greatly across topics and databases. Compared with existing search filters, our hybrid filter demonstrated a consistently high sensitivity across databases and topics, and minimized the resource-intensive process of sifting through false positives. We identify opportunities for qualitative health researchers to improve the uptake of qualitative research into evidence-informed policy making. © The Author(s) 2016.

Implementing a complex rehabilitation intervention in a stroke trial: a qualitative process evaluation of AVERT.

PubMed

Luker, Julie A; Craig, Louise E; Bennett, Leanne; Ellery, Fiona; Langhorne, Peter; Wu, Olivia; Bernhardt, Julie

2016-05-10

The implementation of multidisciplinary stroke rehabilitation interventions is challenging, even when the intervention is evidence-based. Very little is known about the implementation of complex interventions in rehabilitation clinical trials. The aim of study was to better understand how the implementation of a rehabilitation intervention in a clinical trial within acute stroke units is experienced by the staff involved. This qualitative process evaluation was part of a large Phase III stroke rehabilitation trial (AVERT). A descriptive qualitative approach was used. We purposively sampled 53 allied health and nursing staff from 19 acute stroke units in Australia, New Zealand and Scotland. Semi-structured interviews were conducted by phone, voice-internet, or face to face. Digitally recorded interviews were transcribed and analysed by two researchers using rigorous thematic analysis. Our analysis uncovered ten important themes that provide insight into the challenges of implementing complex new rehabilitation practices within complex care settings, plus factors and strategies that assisted implementation. Themes were grouped into three main categories: staff experience of implementing the trial intervention, barriers to implementation, and overcoming the barriers. Participation in the trial was challenging but had personal rewards and improved teamwork at some sites. Over the years that the trial ran some staff perceived a change in usual care. Barriers to trial implementation at some sites included poor teamwork, inadequate staffing, various organisational barriers, staff attitudes and beliefs, and patient-related barriers. Participants described successful implementation strategies that were built on interdisciplinary teamwork, education and strong leadership to 'get staff on board', and developing different ways of working. The AVERT stroke rehabilitation trial required commitment to deliver an intervention that needed strong collaboration between nurses and physiotherapists and was different to current care models. This qualitative process evaluation contributes unique insights into factors that may be critical to successful trials teams, and as AVERT was a pragmatic trial, success factors to delivering complex intervention in clinical practice. AVERT registered with Australian New Zealand Clinical Trials Registry ACTRN12606000185561 .

Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review.

PubMed

Williams, Nefyn H; Hendry, Maggie; France, Barbara; Lewis, Ruth; Wilkinson, Clare

2007-12-01

Despite the health benefits of physical activity, most adults do not take the recommended amount of exercise. To assess whether exercise-referral schemes are effective in improving exercise participation in sedentary adults. Systematic review. Studies were identified by searching MEDLINE, CINAHL, EMBASE, AMED, PsycINFO, SPORTDiscus, The Cochrane Library and SIGLE until March 2007. Randomised controlled trials (RCTs), observational studies, process evaluations and qualitative studies of exercise-referral schemes, defined as referral by a primary care clinician to a programme that encouraged physical activity or exercise were included. RCT results were combined in a meta-analysis where there was sufficient homogeneity. Eighteen studies were included in the review. These comprised six RCTs, one non-randomised controlled study, four observational studies, six process evaluations and one qualitative study. In addition, two of the RCTs and two of the process evaluations incorporated a qualitative component. Results from five RCTs were combined in a meta-analysis. There was a statistically significant increase in the numbers of participants doing moderate exercise with a combined relative risk of 1.20 (95% confidence intervals = 1.06 to 1.35). This means that 17 sedentary adults would need to be referred for one to become moderately active. This small effect may be at least partly due to poor rates of uptake and adherence to the exercise schemes. Exercise-referral schemes have a small effect on increasing physical activity in sedentary people. The key challenge, if future exercise-referral schemes are to be commissioned by the NHS, is to increase uptake and improve adherence by addressing the barriers described in these studies.

Examination of Social Studies Curriculum and Course Books in the Context of Global Citizenship

ERIC Educational Resources Information Center

Karakus, Mehmet; Türkkan, Buket Turhan; Öztürk, Fikriye

2017-01-01

The document review method, which is a qualitative research method, was used in this study that aims to examine the social studies curriculum and course books in terms of attainments, teaching-learning process and measurement-evaluation process in the context of global citizenship. Furthermore, opinions of social studies teachers on the curriculum…

Capital Budgeting Guidelines: How to Decide Whether to Fund a New Dorm or an Upgraded Computer Lab.

ERIC Educational Resources Information Center

Swiger, John; Klaus, Allen

1996-01-01

A process for college and university decision making and budgeting for capital outlays that focuses on evaluating the qualitative and quantitative benefits of each proposed project is described and illustrated. The process provides a means to solicit suggestions from those involved and provide detailed information for cost-benefit analysis. (MSE)

Model of Values-Based Management Process in Schools: A Mixed Design Study

ERIC Educational Resources Information Center

Dogan, Soner

2016-01-01

The aim of this paper is to evaluate the school administrators' values-based management behaviours according to the teachers' perceptions and opinions and, accordingly, to build a model of values-based management process in schools. The study was conducted using explanatory design which is inclusive of both quantitative and qualitative methods.…

The PULSAR Specialist Care protocol: a stepped-wedge cluster randomized control trial of a training intervention for community mental health teams in recovery-oriented practice.

PubMed

Shawyer, Frances; Enticott, Joanne C; Brophy, Lisa; Bruxner, Annie; Fossey, Ellie; Inder, Brett; Julian, John; Kakuma, Ritsuko; Weller, Penelope; Wilson-Evered, Elisabeth; Edan, Vrinda; Slade, Mike; Meadows, Graham N

2017-05-08

Recovery features strongly in Australian mental health policy; however, evidence is limited for the efficacy of recovery-oriented practice at the service level. This paper describes the Principles Unite Local Services Assisting Recovery (PULSAR) Specialist Care trial protocol for a recovery-oriented practice training intervention delivered to specialist mental health services staff. The primary aim is to evaluate whether adult consumers accessing services where staff have received the intervention report superior recovery outcomes compared to adult consumers accessing services where staff have not yet received the intervention. A qualitative sub-study aims to examine staff and consumer views on implementing recovery-oriented practice. A process evaluation sub-study aims to articulate important explanatory variables affecting the interventions rollout and outcomes. The mixed methods design incorporates a two-step stepped-wedge cluster randomized controlled trial (cRCT) examining cross-sectional data from three phases, and nested qualitative and process evaluation sub-studies. Participating specialist mental health care services in Melbourne, Victoria are divided into 14 clusters with half randomly allocated to receive the staff training in year one and half in year two. Research participants are consumers aged 18-75 years who attended the cluster within a previous three-month period either at baseline, 12 (step 1) or 24 months (step 2). In the two nested sub-studies, participation extends to cluster staff. The primary outcome is the Questionnaire about the Process of Recovery collected from 756 consumers (252 each at baseline, step 1, step 2). Secondary and other outcomes measuring well-being, service satisfaction and health economic impact are collected from a subset of 252 consumers (63 at baseline; 126 at step 1; 63 at step 2) via interviews. Interview-based longitudinal data are also collected 12 months apart from 88 consumers with a psychotic disorder diagnosis (44 at baseline, step 1; 44 at step 1, step 2). cRCT data will be analyzed using multilevel mixed-effects modelling to account for clustering and some repeated measures, supplemented by thematic analysis of qualitative interview data. The process evaluation will draw on qualitative, quantitative and documentary data. Findings will provide an evidence-base for the continued transformation of Australian mental health service frameworks toward recovery. Australian and New Zealand Clinical Trial Registry: ACTRN12614000957695 . Date registered: 8 September 2014.

Patterns of Clinical Reasoning in Physical Therapist Students.

PubMed

Gilliland, Sarah; Wainwright, Susan Flannery

2017-05-01

Clinical reasoning is a complex, nonlinear problem-solving process that is influenced by models of practice. The development of physical therapists' clinical reasoning abilities is a crucial yet underresearched aspect of entry-level (professional) physical therapist education. The purpose of this qualitative study was to examine the types of clinical reasoning strategies physical therapist students engage in during a patient encounter. A qualitative descriptive case study design involving within and across case analysis was used. Eight second-year, professional physical therapist students from 2 different programs completed an evaluation and initial intervention for a standardized patient followed by a retrospective think-aloud interview to explicate their reasoning processes. Participants' clinical reasoning strategies were examined using a 2-stage qualitative method of thematic analysis. Participants demonstrated consistent signs of development of physical therapy-specific reasoning processes, yet varied in their approach to the case and use of reflection. Participants who gave greater attention to patient education and empowerment also demonstrated greater use of reflection-in-action during the patient encounter. One negative case illustrates the variability in the rate at which students may develop these abilities. Participants demonstrated development toward physical therapist--specific clinical reasoning, yet demonstrated qualitatively different approaches to the patient encounter. Multiple factors, including the use of reflection-in-action, may enable students to develop greater flexibility in their reasoning processes. © 2017 American Physical Therapy Association

Cochrane Qualitative and Implementation Methods Group guidance series-paper 4: methods for assessing evidence on intervention implementation.

PubMed

Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Booth, Andrew; Harden, Angela; Hannes, Karin; Thomas, James; Flemming, Kate; Garside, Ruth; Noyes, Jane

2018-05-01

This article provides reviewers with guidance on methods for identifying and processing evidence to understand intervention implementation. Strategies, tools, and methods are applied to the systematic review process to illustrate how process and implementation can be addressed using quantitative, qualitative, and other sources of evidence (i.e., descriptive textual and nonempirical). Reviewers can take steps to navigate the heterogeneity and level of uncertainty present in the concepts, measures, and methods used to assess implementation. Activities can be undertaken in advance of a Cochrane quantitative review to develop program theory and logic models that situate implementation in the causal chain. Four search strategies are offered to retrieve process and implementation evidence. Recommendations are made for addressing rigor or risk of bias in process evaluation or implementation evidence. Strategies are recommended for locating and extracting data from primary studies. The basic logic is presented to assist reviewers to make initial review-level judgments about implementation failure and theory failure. Although strategies, tools, and methods can assist reviewers to address process and implementation using quantitative, qualitative, and other forms of evidence, few exemplar reviews exist. There is a need for further methodological development and trialing of proposed approaches. Copyright © 2017 Elsevier Inc. All rights reserved.

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

An innovative method to involve community health workers as partners in evaluation research.

PubMed

Peacock, Nadine; Issel, L Michele; Townsell, Stephanie J; Chapple-McGruder, Theresa; Handler, Arden

2011-12-01

We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training.

Motivational Interviewing and Medication Review in Coronary Heart Disease (MIMeRiC): Intervention Development and Protocol for the Process Evaluation.

PubMed

Östbring, Malin Johansson; Eriksson, Tommy; Petersson, Göran; Hellström, Lina

2018-01-30

Trials of complex interventions are often criticized for being difficult to interpret because the effects of apparently similar interventions vary across studies dependent on context, targeted groups, and the delivery of the intervention. The Motivational Interviewing and Medication Review in Coronary heart disease (MIMeRiC) trial is a randomized controlled trial (RCT) of an intervention aimed at improving pharmacological secondary prevention. Guidelines for the development and evaluation of complex interventions have recently highlighted the need for better reporting of the development of interventions, including descriptions of how the intervention is assumed to work, how this theory informed the process evaluation, and how the process evaluation relates to the outcome evaluation. This paper aims to describe how the intervention was designed and developed. The aim of the process evaluation is to better understand how and why the intervention in the MIMeRiC trial was effective or not effective. The research questions for evaluating the process are based on the conceptual model of change processes assumed in the intervention and will be analyzed by qualitative and quantitative methods. Quantitative data are used to evaluate the medication review in terms of drug-related problems, to describe how patients' beliefs about medicines are affected by the intervention, and to evaluate the quality of motivational interviewing. Qualitative data will be used to analyze whether patients experienced the intervention as intended, how cardiologists experienced the collaboration and intervention, and how the intervention affected patients' overall experience of care after coronary heart disease. The development and piloting of the intervention are described in relation to the theoretical framework. Data for the process evaluation will be collected until March 2018. Some process evaluation questions will be analyzed before, and others will be analyzed after the outcomes of the MIMeRiC RCT are known. This paper describes the framework for the design of the intervention tested in the MIMeRiC trial, development of the intervention from the pilot stage to the complete trial intervention, and the framework and methods for the process evaluation. Providing the protocol of the process evaluation allows prespecification of the processes that will be evaluated, because we hypothesize that they will determine the outcomes of the MIMeRiC trial. This protocol also constitutes a contribution to the new field of process evaluations as made explicit in health services research and clinical trials of complex interventions. ©Malin Johansson Östbring, Tommy Eriksson, Göran Petersson, Lina Hellström. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 30.01.2018.

Evaluation of Two CD-ROMs from a Series on Cell Biology

ERIC Educational Resources Information Center

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as…

Neonatal Intensive Care Nursing Curriculum Challenges based on Context, Input, Process, and Product Evaluation Model: A Qualitative Study.

PubMed

Ashghali-Farahani, Mansoureh; Ghaffari, Fatemeh; Hoseini-Esfidarjani, Sara-Sadat; Hadian, Zahra; Qomi, Robabeh; Dargahi, Helen

2018-01-01

Weakness of curriculum development in nursing education results in lack of professional skills in graduates. This study was done on master's students in nursing to evaluate challenges of neonatal intensive care nursing curriculum based on context, input, process, and product (CIPP) evaluation model. This study was conducted with qualitative approach, which was completed according to the CIPP evaluation model. The study was conducted from May 2014 to April 2015. The research community included neonatal intensive care nursing master's students, the graduates, faculty members, neonatologists, nurses working in neonatal intensive care unit (NICU), and mothers of infants who were hospitalized in such wards. Purposeful sampling was applied. The data analysis showed that there were two main categories: "inappropriate infrastructure" and "unknown duties," which influenced the context formation of NICU master's curriculum. The input was formed by five categories, including "biomedical approach," "incomprehensive curriculum," "lack of professional NICU nursing mentors," "inappropriate admission process of NICU students," and "lack of NICU skill labs." Three categories were extracted in the process, including "more emphasize on theoretical education," "the overlap of credits with each other and the inconsistency among the mentors," and "ineffective assessment." Finally, five categories were extracted in the product, including "preferring routine work instead of professional job," "tendency to leave the job," "clinical incompetency of graduates," "the conflict between graduates and nursing staff expectations," and "dissatisfaction of graduates." Some changes are needed in NICU master's curriculum by considering the nursing experts' comments and evaluating the consequences of such program by them.

Hey girlfriend: an evaluation of AIDS prevention among women in the sex industry.

PubMed

Dorfman, L E; Derish, P A; Cohen, J B

1992-01-01

Increasingly, acquired immunodeficiency syndrome (AIDS) prevention programs have been developed to reach and influence street-based populations. Standard methods of evaluation do not fit the conditions of such programs. This article describes a process and outcome evaluation of an AIDS prevention program for sex workers in which qualitative and quantitative methods were combined in order to mediate research problems endemic to street-based populations. Methods included epidemiological questionnaires, open-ended interviews with participants, and ethnographic field notes. Process evaluation findings show that field staff who were indigenous to the neighborhood and population readily gained access to the community of sex workers and simultaneously became role models for positive behavior change. Outcome findings show that sex workers do feel at risk for AIDS, but usually from clients rather than from husbands or boyfriends. Accordingly, they use condoms more frequently with clients than with steady partners. Increasing condom use among sex workers with their steady partners remains an important challenge for AIDS prevention. Combining qualitative and quantitative research data provided a more comprehensive assessment of how to reach sex workers with effective AIDS risk reduction messages than either method could have provided alone.

Process evaluation of a cluster-randomised trial testing a pressure ulcer prevention care bundle: a mixed-methods study.

PubMed

Roberts, Shelley; McInnes, Elizabeth; Bucknall, Tracey; Wallis, Marianne; Banks, Merrilyn; Chaboyer, Wendy

2017-02-13

As pressure ulcers contribute to significant patient burden and increased health care costs, their prevention is a clinical priority. Our team developed and tested a complex intervention, a pressure ulcer prevention care bundle promoting patient participation in care, in a cluster-randomised trial. The UK Medical Research Council recommends process evaluation of complex interventions to provide insight into why they work or fail and how they might be improved. This study aimed to evaluate processes underpinning implementation of the intervention and explore end-users' perceptions of it, in order to give a deeper understanding of its effects. A pre-specified, mixed-methods process evaluation was conducted as an adjunct to the main trial, guided by a framework for process evaluation of cluster-randomised trials. Data was collected across eight Australian hospitals but mainly focused on the four intervention hospitals. Quantitative and qualitative data were collected across the evaluation domains: recruitment, reach, intervention delivery and response to intervention, at both cluster and individual patient level. Quantitative data were analysed using descriptive and inferential statistics. Qualitative data were analysed using thematic analysis. In the context of the main trial, which found a 42% reduction in risk of pressure ulcer with the intervention that was not significant after adjusting for clustering and covariates, this process evaluation provides important insights. Recruitment and reach among clusters and individuals was high, indicating that patients, nurses and hospitals are willing to engage with a pressure ulcer prevention care bundle. Of 799 intervention patients in the trial, 96.7% received the intervention, which took under 10 min to deliver. Patients and nurses accepted the care bundle, recognising benefits to it and describing how it enabled participation in pressure ulcer prevention (PUP) care. This process evaluation found no major failures relating to implementation of the intervention. The care bundle was found to be easy to understand and deliver, and it reached a large proportion of the target population and was found to be acceptable to patients and nurses; therefore, it may be an effective way of engaging patients in their pressure ulcer prevention care and promoting evidence-based practise.

Current Effects of Army Materiel Command Operation Order 16 189 at TACOM LCMC

DTIC Science & Technology

2017-05-25

Alexandria, VA: CNA Corporation. 78 Creswell, J. W. (2015). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative...research and development that relate to military requirements and test and evaluation . (d)(3) The Secretary shall establish or designate a single office or...for research. 4. Collect data. 5. Analyze and interpret the data. 42 6. Report and evaluate the research. Step 4 of the research process is

A system dynamics evaluation model: implementation of health information exchange for public health reporting

PubMed Central

Merrill, Jacqueline A; Deegan, Michael; Wilson, Rosalind V; Kaushal, Rainu; Fredericks, Kimberly

2013-01-01

Objective To evaluate the complex dynamics involved in implementing electronic health information exchange (HIE) for public health reporting at a state health department, and to identify policy implications to inform similar implementations. Materials and methods Qualitative data were collected over 8 months from seven experts at New York State Department of Health who implemented web services and protocols for querying, receipt, and validation of electronic data supplied by regional health information organizations. Extensive project documentation was also collected. During group meetings experts described the implementation process and created reference modes and causal diagrams that the evaluation team used to build a preliminary model. System dynamics modeling techniques were applied iteratively to build causal loop diagrams representing the implementation. The diagrams were validated iteratively by individual experts followed by group review online, and through confirmatory review of documents and artifacts. Results Three casual loop diagrams captured well-recognized system dynamics: Sliding Goals, Project Rework, and Maturity of Resources. The findings were associated with specific policies that address funding, leadership, ensuring expertise, planning for rework, communication, and timeline management. Discussion This evaluation illustrates the value of a qualitative approach to system dynamics modeling. As a tool for strategic thinking on complicated and intense processes, qualitative models can be produced with fewer resources than a full simulation, yet still provide insights that are timely and relevant. Conclusions System dynamics techniques clarified endogenous and exogenous factors at play in a highly complex technology implementation, which may inform other states engaged in implementing HIE supported by federal Health Information Technology for Economic and Clinical Health (HITECH) legislation. PMID:23292910

A system dynamics evaluation model: implementation of health information exchange for public health reporting.

PubMed

Merrill, Jacqueline A; Deegan, Michael; Wilson, Rosalind V; Kaushal, Rainu; Fredericks, Kimberly

2013-06-01

To evaluate the complex dynamics involved in implementing electronic health information exchange (HIE) for public health reporting at a state health department, and to identify policy implications to inform similar implementations. Qualitative data were collected over 8 months from seven experts at New York State Department of Health who implemented web services and protocols for querying, receipt, and validation of electronic data supplied by regional health information organizations. Extensive project documentation was also collected. During group meetings experts described the implementation process and created reference modes and causal diagrams that the evaluation team used to build a preliminary model. System dynamics modeling techniques were applied iteratively to build causal loop diagrams representing the implementation. The diagrams were validated iteratively by individual experts followed by group review online, and through confirmatory review of documents and artifacts. Three casual loop diagrams captured well-recognized system dynamics: Sliding Goals, Project Rework, and Maturity of Resources. The findings were associated with specific policies that address funding, leadership, ensuring expertise, planning for rework, communication, and timeline management. This evaluation illustrates the value of a qualitative approach to system dynamics modeling. As a tool for strategic thinking on complicated and intense processes, qualitative models can be produced with fewer resources than a full simulation, yet still provide insights that are timely and relevant. System dynamics techniques clarified endogenous and exogenous factors at play in a highly complex technology implementation, which may inform other states engaged in implementing HIE supported by federal Health Information Technology for Economic and Clinical Health (HITECH) legislation.

Commentary: Writing and evaluating qualitative research reports

USDA-ARS?s Scientific Manuscript database

An overview of qualitative methods is provided, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals ...

Evaluating the effectiveness of a practical inquiry-based learning bioinformatics module on undergraduate student engagement and applied skills.

PubMed

Brown, James A L

2016-05-06

A pedagogic intervention, in the form of an inquiry-based peer-assisted learning project (as a practical student-led bioinformatics module), was assessed for its ability to increase students' engagement, practical bioinformatic skills and process-specific knowledge. Elements assessed were process-specific knowledge following module completion, qualitative student-based module evaluation and the novelty, scientific validity and quality of written student reports. Bioinformatics is often the starting point for laboratory-based research projects, therefore high importance was placed on allowing students to individually develop and apply processes and methods of scientific research. Students led a bioinformatic inquiry-based project (within a framework of inquiry), discovering, justifying and exploring individually discovered research targets. Detailed assessable reports were produced, displaying data generated and the resources used. Mimicking research settings, undergraduates were divided into small collaborative groups, with distinctive central themes. The module was evaluated by assessing the quality and originality of the students' targets through reports, reflecting students' use and understanding of concepts and tools required to generate their data. Furthermore, evaluation of the bioinformatic module was assessed semi-quantitatively using pre- and post-module quizzes (a non-assessable activity, not contributing to their grade), which incorporated process- and content-specific questions (indicative of their use of the online tools). Qualitative assessment of the teaching intervention was performed using post-module surveys, exploring student satisfaction and other module specific elements. Overall, a positive experience was found, as was a post module increase in correct process-specific answers. In conclusion, an inquiry-based peer-assisted learning module increased students' engagement, practical bioinformatic skills and process-specific knowledge. © 2016 by The International Union of Biochemistry and Molecular Biology, 44:304-313 2016. © 2016 The International Union of Biochemistry and Molecular Biology.

A human factors systems approach to understanding team-based primary care: a qualitative analysis.

PubMed

Mundt, Marlon P; Swedlund, Matthew P

2016-12-01

Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

This paper explores the variety of qualitative methods available, in the context of a larger quantitative-qualitative debate in the field of educational evaluation. Each approach is reviewed in terms of the work of its major proponents. The dominant forms of qualitative evaluation include: (1) ethnography; (2) naturalistic inquiry; (3) generic…

Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory

PubMed Central

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-01-01

Objective To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. Data Sources and Design We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. Principle Findings We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Conclusions Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines. PMID:17286625

Qualitative data analysis for health services research: developing taxonomy, themes, and theory.

PubMed

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-08-01

To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. DATA SOURCES AND DESIGN: We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines.

Process service quality evaluation based on Dempster-Shafer theory and support vector machine.

PubMed

Pei, Feng-Que; Li, Dong-Bo; Tong, Yi-Fei; He, Fei

2017-01-01

Human involvement influences traditional service quality evaluations, which triggers an evaluation's low accuracy, poor reliability and less impressive predictability. This paper proposes a method by employing a support vector machine (SVM) and Dempster-Shafer evidence theory to evaluate the service quality of a production process by handling a high number of input features with a low sampling data set, which is called SVMs-DS. Features that can affect production quality are extracted by a large number of sensors. Preprocessing steps such as feature simplification and normalization are reduced. Based on three individual SVM models, the basic probability assignments (BPAs) are constructed, which can help the evaluation in a qualitative and quantitative way. The process service quality evaluation results are validated by the Dempster rules; the decision threshold to resolve conflicting results is generated from three SVM models. A case study is presented to demonstrate the effectiveness of the SVMs-DS method.

[Modality of combined methods of quantitative and qualitative research in evaluation of therapeutic effects of Chinese medicine].

PubMed

Liu, Jian-ping

2011-05-01

The core of evidence-based medicine lies in implementing the current best available evidence of clinical research to direct the decision making in clinical practice, incorporation of individual experience and value and preference of patients. However, the current evaluation method for clinical therapeutic effect cannot reflect the humanity and wholesomeness as well as individualized tailored treatment of Chinese medicine (CM) by using randomized controlled trials. This assay addressed the complex intervention of highly individualized treatment of CM and its societal characteristics, and the author proposes a model for the evaluation of therapeutic effects of CM in which quantitative and qualitative methods are combined, embodying the characteristics of the social and natural sciences in CM. The model can show the dynamic process of CM diagnosis and treatment from a perspective of the whole system and can be used for the evaluation of complex intervention of CM. We hope to raise a different thinking and method from the new drug development in the therapeutic effect evaluation.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Community interventions providing care and support to orphans and vulnerable children: a review of evaluation evidence.

PubMed

Schenk, Katie D

2009-07-01

Children affected by HIV in their families and communities face multiple risks to their health, education and psychosocial wellbeing. Community interventions for children who have been orphaned or rendered vulnerable take many forms, including educational assistance, home-based care, legal protection and psychosocial support. Despite a recent influx of funding for programme implementation, there exists little evidence to inform policymakers about whether their investments are improving the lives of vulnerable children and meeting key benchmarks including the Millennium Development Goals. This paper reviews the current evidence base on evaluations of community interventions for orphans and vulnerable children (OVC) in high HIV-prevalence African settings, focusing on studies' methodologies. Sources reviewed include published research studies and evidence from the unpublished programmatic "grey literature" located through database and internet searches. A total of 21 studies, varying in scope and generalisability, were identified. Interventions reviewed address children's wellbeing through various strategies within their communities. Evaluation methodologies reflect quantitative and qualitative approaches, including surveys (with and without baseline or comparison data), costing studies, focus groups, interviews, case studies, and participatory review techniques. Varied study methodologies reflect diverse research questions, various intervention types, and the challenges associated with evaluating complex interventions; highlighting the need to broaden the research paradigm in order to build the evidence base by including quasi-experimental and process evaluation approaches, and seeking further insights through participatory qualitative methodologies and costing studies. Although findings overall indicate the value of community interventions in effecting measurable improvements in child and family wellbeing, the quality and rigour of evidence is varied. A strategic research agenda is urgently needed to inform resource allocation and programme management decisions. Immediate imperatives include building local technical capacity to conduct quantitative and qualitative evaluation research, and strengthening monitoring and evaluation systems to collect process and outcome data (including costing) on key support models. Donors and implementers must support the collection of sound empirical evidence to inform the development and scale-up of OVC programmes.

Developing a framework for qualitative engineering: Research in design and analysis of complex structural systems

NASA Technical Reports Server (NTRS)

Franck, Bruno M.

1990-01-01

The research is focused on automating the evaluation of complex structural systems, whether for the design of a new system or the analysis of an existing one, by developing new structural analysis techniques based on qualitative reasoning. The problem is to identify and better understand: (1) the requirements for the automation of design, and (2) the qualitative reasoning associated with the conceptual development of a complex system. The long-term objective is to develop an integrated design-risk assessment environment for the evaluation of complex structural systems. The scope of this short presentation is to describe the design and cognition components of the research. Design has received special attention in cognitive science because it is now identified as a problem solving activity that is different from other information processing tasks (1). Before an attempt can be made to automate design, a thorough understanding of the underlying design theory and methodology is needed, since the design process is, in many cases, multi-disciplinary, complex in size and motivation, and uses various reasoning processes involving different kinds of knowledge in ways which vary from one context to another. The objective is to unify all the various types of knowledge under one framework of cognition. This presentation focuses on the cognitive science framework that we are using to represent the knowledge aspects associated with the human mind's abstraction abilities and how we apply it to the engineering knowledge and engineering reasoning in design.

Evaluating the Quality of Education at Dentistry School of Tehran University of Medical Sciences

PubMed Central

Farzianpour, Fereshteh; Monzavi, Abbas; Yassini, Esmaeil

2011-01-01

Background: Educational evaluation is a process which deals with data collection and assessment of academic activities’ progress. In this research, educational evaluation of Dentistry School of Tehran University of Medical Sciences, which trains students in undergraduate and residency courses, was studied. Methods: This descriptive study was done with a model of educational evaluation in ten steps and 13 fields including purposes and mission objectives, management and organization, academic board members, students, human resources and support, educational, research, health and treatment spaces, educational, diagnostic, research and laboratory tools, educational, research, health and treatment programs and courses, process of teaching and learning, evaluation and assessment, alumni, and patients satisfaction. Data were collected using observation, interviews, questionnaires, and checklists. Results: Results of the study were mainly qualitative and in some cases quantitative, based on defined optimal situation. The total mean of qualitative results of educational evaluation of dentistry school in all 13 fields was 55.98% which is relatively desirable. In the case of quantitative ones, results of some fields such as treatment quality of patients and education and learning of the students were relatively desirable (61.32% and 60.16% respectively). Conclusion: According to the results, educational goals and missions, educational and research facilities and spaces which were identified as the weakest areas need to be considered and paid more serious attention. PMID:22013466

Evaluation of patient centered medical home practice transformation initiatives.

PubMed

Crabtree, Benjamin F; Chase, Sabrina M; Wise, Christopher G; Schiff, Gordon D; Schmidt, Laura A; Goyzueta, Jeanette R; Malouin, Rebecca A; Payne, Susan M C; Quinn, Michael T; Nutting, Paul A; Miller, William L; Jaén, Carlos Roberto

2011-01-01

The patient-centered medical home (PCMH) has become a widely cited solution to the deficiencies in primary care delivery in the United States. To achieve the magnitude of change being called for in primary care, quality improvement interventions must focus on whole-system redesign, and not just isolated parts of medical practices. Investigators participating in 9 different evaluations of Patient Centered Medical Home implementation shared experiences, methodological strategies, and evaluation challenges for evaluating primary care practice redesign. A year-long iterative process of sharing and reflecting on experiences produced consensus on 7 recommendations for future PCMH evaluations: (1) look critically at models being implemented and identify aspects requiring modification; (2) include embedded qualitative and quantitative data collection to detail the implementation process; (3) capture details concerning how different PCMH components interact with one another over time; (4) understand and describe how and why physician and staff roles do, or do not evolve; (5) identify the effectiveness of individual PCMH components and how they are used; (6) capture how primary care practices interface with other entities such as specialists, hospitals, and referral services; and (7) measure resources required for initiating and sustaining innovations. Broad-based longitudinal, mixed-methods designs that provide for shared learning among practice participants, program implementers, and evaluators are necessary to evaluate the novelty and promise of the PCMH model. All PCMH evaluations should as comprehensive as possible, and at a minimum should include a combination of brief observations and targeted qualitative interviews along with quantitative measures.

New integrated information system for pusan national university hospital.

PubMed

Kim, Hyung Hoi; Cho, Kyung-Won; Kim, Hye Sook; Kim, Ju-Sim; Kim, Jung Hyun; Han, Sang Pil; Park, Chun Bok; Kim, Seok; Chae, Young Moon

2011-03-01

This study presents the information system for Pusan National University Hospital (PNUH), evaluates its performance qualitatively, and conducts economic analysis. Information system for PNUH was designed by component-based development and developed by internet technologies. Order Communication System, Electronic Medical Record, and Clinical Decision Support System were newly developed. The performance of the hospital information system was qualitatively evaluated based on the performance reference model in order to identify problem areas for the old system. The Information Economics approach was used to analyze the economic feasibility of hospital information system in order to account for the intangible benefits. Average performance scores were 3.16 for input layer, 3.35 for process layer, and 3.57 for business layer. In addition, the cumulative benefit to cost ratio was 0.50 in 2011, 1.73 in 2012, 1.76 in 2013, 1.71 in 2014, and 1.71 in 2015. The B/C ratios steadily increase as value items are added. While overall performance scores were reasonably high, doctors were less satisfied with the system, perhaps due to the weak clinical function in the systems. The information economics analysis demonstrated the economic profitability of the information systems if all intangible benefits were included. The second qualitative evaluation survey and economic analysis were proposed to evaluate the changes in performance of the new system.

Automated Simulation For Analysis And Design

NASA Technical Reports Server (NTRS)

Cantwell, E.; Shenk, Tim; Robinson, Peter; Upadhye, R.

1992-01-01

Design Assistant Workstation (DAWN) software being developed to facilitate simulation of qualitative and quantitative aspects of behavior of life-support system in spacecraft, chemical-processing plant, heating and cooling system of large building, or any of variety of systems including interacting process streams and processes. Used to analyze alternative design scenarios or specific designs of such systems. Expert system will automate part of design analysis: reason independently by simulating design scenarios and return to designer with overall evaluations and recommendations.

Understanding of evaluation capacity building in practice: a case study of a national medical education organization.

PubMed

Sarti, Aimee J; Sutherland, Stephanie; Landriault, Angele; DesRosier, Kirk; Brien, Susan; Cardinal, Pierre

2017-01-01

Evaluation capacity building (ECB) is a topic of great interest to many organizations as they face increasing demands for accountability and evidence-based practices. ECB is about building the knowledge, skills, and attitudes of organizational members, the sustainability of rigorous evaluative practices, and providing the resources and motivations to engage in ongoing evaluative work. There exists a solid foundation of theoretical research on ECB, however, understanding what ECB looks like in practice is relatively thin. Our purpose was to investigate what ECB looks like firsthand within a national medical educational organization. The context for this study was the Acute Critical Events Simulation (ACES) organization in Canada, which has successfully evolved into a national educational program, driven by physicians. We conducted an exploratory qualitative study to better understand and describe ECB in practice. In doing so, interviews were conducted with program leaders and instructors so as to gain a richer understanding of evaluative processes and practices. A total of 21 individuals participated in the semistructured interviews. Themes from our qualitative data analysis included the following: evaluation knowledge, skills, and attitudes, use of evaluation findings, shared evaluation beliefs and commitment, evaluation frameworks and processes, and resources dedicated to evaluation. The national ACES organization was a useful case study to explore ECB in practice. The ECB literature provided a solid foundation to understand the purpose and nuances of ECB. This study added to the paucity of studies focused on examining ECB in practice. The most important lesson learned was that the organization must have leadership who are intrinsically motivated to employ and use evaluation data to drive ongoing improvements within the organization. Leaders who are intrinsically motivated will employ risk taking when evaluation practices and processes may be somewhat unfamiliar. Creating and maintaining a culture of data use and ongoing inquiry have enabled national ACES to achieve a sustainable evaluation practice.

Neonatal Intensive Care Nursing Curriculum Challenges based on Context, Input, Process, and Product Evaluation Model: A Qualitative Study

PubMed Central

Ashghali-Farahani, Mansoureh; Ghaffari, Fatemeh; Hoseini-Esfidarjani, Sara-Sadat; Hadian, Zahra; Qomi, Robabeh; Dargahi, Helen

2018-01-01

Background: Weakness of curriculum development in nursing education results in lack of professional skills in graduates. This study was done on master's students in nursing to evaluate challenges of neonatal intensive care nursing curriculum based on context, input, process, and product (CIPP) evaluation model. Materials and Methods: This study was conducted with qualitative approach, which was completed according to the CIPP evaluation model. The study was conducted from May 2014 to April 2015. The research community included neonatal intensive care nursing master's students, the graduates, faculty members, neonatologists, nurses working in neonatal intensive care unit (NICU), and mothers of infants who were hospitalized in such wards. Purposeful sampling was applied. Results: The data analysis showed that there were two main categories: “inappropriate infrastructure” and “unknown duties,” which influenced the context formation of NICU master's curriculum. The input was formed by five categories, including “biomedical approach,” “incomprehensive curriculum,” “lack of professional NICU nursing mentors,” “inappropriate admission process of NICU students,” and “lack of NICU skill labs.” Three categories were extracted in the process, including “more emphasize on theoretical education,” “the overlap of credits with each other and the inconsistency among the mentors,” and “ineffective assessment.” Finally, five categories were extracted in the product, including “preferring routine work instead of professional job,” “tendency to leave the job,” “clinical incompetency of graduates,” “the conflict between graduates and nursing staff expectations,” and “dissatisfaction of graduates.” Conclusions: Some changes are needed in NICU master's curriculum by considering the nursing experts' comments and evaluating the consequences of such program by them. PMID:29628958

"Drugsbridge": A Humanistic Approach to Drug Education

ERIC Educational Resources Information Center

Mallick, Jane; Watts, Mike

2007-01-01

"Drugsbridge" is a humanistic programme providing a "zone of transformation" for discussion and debate on drug use. Twelve young people and six unrelated parents met over four carefully designed and facilitated sessions. Qualitative data enable evaluation of the processes and impact of these. The article highlights three…

[Reconstituting evaluation methods based on both qualitative and quantitative paradigms].

PubMed

Miyata, Hiroaki; Okubo, Suguru; Yoshie, Satoru; Kai, Ichiro

2011-01-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confusing and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. In this study we conducted content analysis regarding evaluation methods of qualitative healthcare research. We extracted descriptions on four types of evaluation paradigm (validity/credibility, reliability/credibility, objectivity/confirmability, and generalizability/transferability), and classified them into subcategories. In quantitative research, there has been many evaluation methods based on qualitative paradigms, and vice versa. Thus, it might not be useful to consider evaluation methods of qualitative paradigm are isolated from those of quantitative methods. Choosing practical evaluation methods based on the situation and prior conditions of each study is an important approach for researchers.

Measuring Down: Evaluating Digital Storytelling as a Process for Narrative Health Promotion.

PubMed

Gubrium, Aline C; Fiddian-Green, Alice; Lowe, Sarah; DiFulvio, Gloria; Del Toro-Mejías, Lizbeth

2016-05-15

Digital storytelling (DST) engages participants in a group-based process to create and share narrative accounts of life events. We present key evaluation findings of a 2-year, mixed-methods study that focused on effects of participating in the DST process on young Puerto Rican Latina's self-esteem, social support, empowerment, and sexual attitudes and behaviors. Quantitative results did not show significant changes in the expected outcomes. However, in our qualitative findings we identified several ways in which the DST made positive, health-bearing effects. We argue for the importance of "measuring down" to reflect the locally grounded, felt experiences of participants who engage in the process, as current quantitative scales do not "measure up" to accurately capture these effects. We end by suggesting the need to develop mixed-methods, culturally relevant, and sensitive evaluation tools that prioritize process effects as they inform intervention and health promotion. © The Author(s) 2016.

An Innovative Method to Involve Community Health Workers as Partners in Evaluation Research

PubMed Central

Issel, L. Michele; Townsell, Stephanie J.; Chapple-McGruder, Theresa; Handler, Arden

2011-01-01

Objectives. We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Methods. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Results. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Conclusions. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training. PMID:22021290

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing students’ clinical competencies seems necessary. PMID:24554959

Qualitative Parameters for Evaluation Procedures of Non-Formal and Informal Learning Achievements

ERIC Educational Resources Information Center

Stasiunaitiene, Egle; Kaminskiene, Lina

2009-01-01

The article introduces evaluation principles of non-formal and informal learning that determine the quality of evaluation, describes stages of the evaluation procedure, differentiates their qualitative parameters and defines their criteria and indicators. It also brings in the discussion that consideration of qualitative parameters for the…

Therapy of a couple with a bipolar spouse.

PubMed

Witusik, Andrzej; Pietras, Tadeusz

2017-10-23

Qualitative analysis of therapy of a couple with a partner who has bipolar disorder is an important research paradigm in contemporary psychotherapy of mental disorders.The qualitative method of the study is important both from the cognitive point of view and for the evaluation of the therapeutic efficacy in the individual, idiographical aspect. The aim of the study is a qualitative analysis of the therapeutic process of a couple in which one partner suffers from bipolar affective disorder. The study of the couple therapy process utilized the qualitative research methodology using variouspsychotherapeutic paradigms indicating the interrelationships that exist between relapses of the disease and functioning of the couple. The importance of triangulation processes, inheritance of transgenerational myths and dysfunctional cognitive patterns in the functional destabilization of a couple with one partner suffering from bipolar affective disorder was indicated. The study of the couple therapy process utilized the qualitative research methodology using variouspsychotherapeutic paradigms indicating the interrelationships that exist between relapses of the disease and functioning of the couple. The importance of triangulation processes, inheritance of transgenerational myths and dysfunctional cognitive patterns in the functional destabilization of a couple with one partner suffering from bipolar affective disorder was indicated. The dysfunctionality of the discussed couple is largely due to the effects of bipolar disorder and related disturbances on marital functioning. The spectrum of autism in the child is probably related both to the genetic strain of predisposition to psychiatric disorders and to the dysfunctionality of the parental dyad. The presence of bipolar affective disorder in the partner's family is also a genetic burden. The wife's aggression represents probably a syndrome of adaptation to disease in the family. Aggression plays a morphostatic role in the couple integrity.In both families of origin of the spouses, the transgeneration myth placed the woman in the position of a strong and family-oriented person.

On the evaluation of segmentation editing tools

PubMed Central

Heckel, Frank; Moltz, Jan H.; Meine, Hans; Geisler, Benjamin; Kießling, Andreas; D’Anastasi, Melvin; dos Santos, Daniel Pinto; Theruvath, Ashok Joseph; Hahn, Horst K.

2014-01-01

Abstract. Efficient segmentation editing tools are important components in the segmentation process, as no automatic methods exist that always generate sufficient results. Evaluating segmentation editing algorithms is challenging, because their quality depends on the user’s subjective impression. So far, no established methods for an objective, comprehensive evaluation of such tools exist and, particularly, intermediate segmentation results are not taken into account. We discuss the evaluation of editing algorithms in the context of tumor segmentation in computed tomography. We propose a rating scheme to qualitatively measure the accuracy and efficiency of editing tools in user studies. In order to objectively summarize the overall quality, we propose two scores based on the subjective rating and the quantified segmentation quality over time. Finally, a simulation-based evaluation approach is discussed, which allows a more reproducible evaluation without the need for human input. This automated evaluation complements user studies, allowing a more convincing evaluation, particularly during development, where frequent user studies are not possible. The proposed methods have been used to evaluate two dedicated editing algorithms on 131 representative tumor segmentations. We show how the comparison of editing algorithms benefits from the proposed methods. Our results also show the correlation of the suggested quality score with the qualitative ratings. PMID:26158063

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

PubMed

Tonkin-Crine, Sarah; Anthierens, Sibyl; Hood, Kerenza; Yardley, Lucy; Cals, Jochen W L; Francis, Nick A; Coenen, Samuel; van der Velden, Alike W; Godycki-Cwirko, Maciek; Llor, Carl; Butler, Chris C; Verheij, Theo J M; Goossens, Herman; Little, Paul

2016-05-12

Mixed methods are commonly used in health services research; however, data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point-of-care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs' and patients' experiences of taking part in the trial. Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with (1) 62 patients and (2) 66 GPs and quantitative data collected via questionnaires with (3) 2886 patients and (4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence. Three instances of dissonance occurred in 39 independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt that the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested that this was unnecessary if a full explanation was given. Whilst qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet. Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient booklet were relevant and useful for all patients and associated with increased patient satisfaction. A triangulation protocol to integrate qualitative and quantitative data can reveal findings that need further interpretation and also highlight areas of dissonance that lead to a deeper insight than separate analyses.

Faculty-Specific Factors of Degree of HE Internationalization: An Evaluation of Four Faculties of a Post-1992 University in the United Kingdom

ERIC Educational Resources Information Center

Jiang, Nan; Carpenter, Victoria

2013-01-01

Purpose: The purpose of this paper is to investigate the difference in the process of higher education (HE) internationalization across faculties in a post-1992 university and to identify faculty-specific factors through evaluating the four faculties in the case study. Design/methodology/approach: A qualitative research is conducted in a post-1992…

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

Morphofunctional evaluation of the testicle and the spermatogenic process of adult white-eyed parakeets (Aratinga leucophthalma MULLER, 1776) during the different seasons of the year.

PubMed

Peixoto, J V; Paula, T A R; Balarini, M K; Matta, S L P; Santos, J A D; Lima, C B; Peixoto, G V

2012-08-01

In this experiment, testicle fragments of 14 adult White-eyed Parakeets (Aratinga leucophthalma) were evaluated as for their seasonal reproductive activities using the following quantitative parameters: average thickness of the testicular tunica albuginea, volumetric proportion of tubular and extratubular compartments, average diameter of the seminiferous tubules and corporal weight. Parameters were created for qualitative evaluations of the degree of spermatogenic development. In this experiment, all the animals were distributed into four groups, and their testicular fragments were collected during the middle of summer, fall, winter and spring. The animals were submitted to volatile general anaesthesia, and a biopsy was made by celioscopy. The fragments collected were processed histologically. The slides were prepared and later evaluated by using an optical microscope. The average seasonal values of the corporal weight increased, starting in the winter and reaching the peak during the spring. A seasonal testicle cycle was observed, because, in the spring, the testicles showed values for the quantitative and qualitative parameters of spermatic production compatible with the period of greater activity, while the opposite thing happened during the fall. Our data indicate that the parameters of sperm production may be correlated with daily light rather than with air humidity. © 2012 Blackwell Verlag GmbH.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

The evaluator as technical assistant: A model for systemic reform support

NASA Astrophysics Data System (ADS)

Century, Jeanne Rose

This study explored evaluation of systemic reform. Specifically, it focused on the evaluation of a systemic effort to improve K-8 science, mathematics and technology education. The evaluation was of particular interest because it used both technical assistance and evaluation strategies. Through studying the combination of these roles, this investigation set out to increase understanding of potentially new evaluator roles, distinguish important characteristics of the evaluator/project participant relationship, and identify how these roles and characteristics contribute to effective evaluation of systemic science education reform. This qualitative study used interview, document analysis, and participant observation as methods of data collection. Interviews were conducted with project leaders, project participants, and evaluators and focused on the evaluation strategies and process, the use of the evaluation, and technical assistance. Documents analyzed included transcripts of evaluation team meetings and reports, memoranda and other print materials generated by the project leaders and the evaluators. Data analysis consisted of analytic and interpretive procedures consistent with the qualitative data collected and entailed a combined process of coding transcripts of interviews and meetings, field notes, and other documents; analyzing and organizing findings; writing of reflective and analytic memos; and designing and diagramming conceptual relationships. The data analysis resulted in the development of the Multi-Function Model for Systemic Reform Support. This model organizes systemic reform support into three functions: evaluation, technical assistance, and a third, named here as "systemic perspective." These functions work together to support the project's educational goals as well as a larger goal--building capacity in project participants. This model can now serve as an informed starting point or "blueprint" for strategically supporting systemic reform.

Land Mobile Satellite Service (LMSS) channel simulator: An end-to-end hardware simulation and study of the LMSS communications links

NASA Technical Reports Server (NTRS)

Salmasi, A. B. (Editor); Springett, J. C.; Sumida, J. T.; Richter, P. H.

1984-01-01

The design and implementation of the Land Mobile Satellite Service (LMSS) channel simulator as a facility for an end to end hardware simulation of the LMSS communications links, primarily with the mobile terminal is described. A number of studies are reported which show the applications of the channel simulator as a facility for validation and assessment of the LMSS design requirements and capabilities by performing quantitative measurements and qualitative audio evaluations for various link design parameters and channel impairments under simulated LMSS operating conditions. As a first application, the LMSS channel simulator was used in the evaluation of a system based on the voice processing and modulation (e.g., NBFM with 30 kHz of channel spacing and a 2 kHz rms frequency deviation for average talkers) selected for the Bell System's Advanced Mobile Phone Service (AMPS). The various details of the hardware design, qualitative audio evaluation techniques, signal to channel impairment measurement techniques, the justifications for criteria of different parameter selection in regards to the voice processing and modulation methods, and the results of a number of parametric studies are further described.

Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2017-01-01

NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.

Application of Nursing Process and Its Affecting Factors among Nurses Working in Mekelle Zone Hospitals, Northern Ethiopia

PubMed Central

Hagos, Fisseha; Alemseged, Fessehaye; Balcha, Fikadu; Berhe, Semarya; Aregay, Alemseged

2014-01-01

Background. Nursing process is considered as appropriate method to explain the nursing essence, its scientific bases, technologies and humanist assumptions that encourage critical thinking and creativity, and permits solving problems in professional practice. Objective. To assess the application of nursing process and it's affecting factors in Mekelle Zone Hospitals. Methods. A cross sectional design employing quantitative and qualitative methods was conducted in Mekelle zone hospitals March 2011. Qualitative data was collected from14 head nurses of six hospitals and quantitative was collected from 200 nurses selected by simple random sampling technique from the six hospitals proportional to their size. SPSS version 16.1 and thematic analysis was used for quantitative and qualitative data respectively. Results. Majority 180 (90%) of the respondents have poor knowledge and 99.5% of the respondents have a positive attitude towards the nursing process. All of the respondents said that they did not use the nursing process during provision of care to their patients at the time of the study. Majority (75%) of the respondent said that the nurse to patient ratio was not optimal to apply the nursing process. Conclusion and Recommendation. The nursing process is not yet applied in all of the six hospitals. The finding revealed that the knowledge of nurses on the nursing process is not adequate to put it in to practice and high patient nurse ratio affects its application. The studied hospitals should consider the application of the nursing process critically by motivating nurses and monitor and evaluate its progress. PMID:24649360

Interactive Video Usage on Autism Spectrum Disorder Training in Medical Education

ERIC Educational Resources Information Center

Taslibeyaz, Elif; Dursun, Onur Burak; Karaman, Selcuk

2017-01-01

This study aimed to compare the effects of interactive and non-interactive videos concerning the autism spectrum disorder on medical students' achievement. It also evaluated the relation between the interactive videos' interactivity and the students' decision-making process. It used multiple methods, including quantitative and qualitative methods.…

Learning through Accreditation: Faculty Reflections on the Experience of Program Evaluation

ERIC Educational Resources Information Center

Garrison, Sarah; Herring, Angel; Hinton, W. Jeff

2013-01-01

This qualitative study was conducted to explore the personal and professional experiences of family and consumer sciences educators (n = 3) who recently participated in the AAFCS accreditation process utilizing the 2010 Accreditation standards. Analysis of the transcribed semi-structured interview data yielded four overarching categories: (a)…

Educational Innovations as Staff Development: An Evaluative Approach.

ERIC Educational Resources Information Center

Marcelo, Carlos; And Others

1996-01-01

Reports a study that analyzed the processes of educational innovation in seven projects in the Andalusian region of Spain. Using qualitative and quantitative methods, the study determined that the quality of the impact of innovation on students, teachers, schools, and communities was determined by the original source, the relationship to perceived…

Engaging Community-Based Organizations in Fall Prevention Education

ERIC Educational Resources Information Center

Kramer, B. Josea; Vivrette, Rebecca L.; Rubenstein, Laurence Z.

2011-01-01

Falls are a major public health problem for older adults, and community-based organizations play a key role in educating seniors about falls prevention (FP). We conducted a qualitative process evaluation at six sites to report community-based centers' perspectives on adoption, adaptation, and sustainability of an evidence-based multifactorial FP…

A Model of Professional Development: Teachers' Perceptions of Their Professional Development

ERIC Educational Resources Information Center

Avidov-Ungar, Orit

2016-01-01

This research aims to evaluate the manner in which teachers perceive their professional development process. Forty-three teachers from Israeli schools participated in the study. I used a semi-structured interview to understand the teachers' perceptions about their professional development. The qualitative analysis identified two dimensions that…

An Analysis of the Effect of Mobile Learning on Lebanese Higher Education

ERIC Educational Resources Information Center

Jabbour, Khayrazad Kari

2014-01-01

This research explores the effect of mobile technology in Lebanese higher education classrooms. Three components were utilized to evaluate the impact: student attitudes, student achievements, and educational process. This study used both quantitative and qualitative methods to examine the research questions. The main sources for data collection…

Nursing students' evaluation of quality indicators during learning in clinical practice.

PubMed

Jansson, Inger; Ene, Kerstin W

2016-09-01

A supportive clinical learning environment is important for nursing students' learning. In this study, a contract between a county and a university involving a preceptor model of clinical education for nursing students is described. The aim of this study was to describe nursing students' clinical education based on quality indicators and to describe the students' experiences of what facilitated or hindered the learning process during their clinical practice. During autumn 2012 and spring 2013, 269 student evaluations with quantitative and qualitative answers were filled out anonymously. Quantitative data from the questionnaires concerning the quality indicators: Administration/information, Assessments/examinations and Reflection were processed to generate descriptive statistics that revealed gaps in what the preceptor model demands and what the students reported. The answers from the qualitative questions concerning the quality indicator Learning were analysed using content analysis. Four categories emerged: Independence and responsibility, continuity of learning, time, and the competence and attitudes of the staff. The study underlines that reflection, continuity, communication and feedback were important for the students' learning process, whereas heavy workload among staff and being supervised by many different preceptors were experienced as stressful and hindering by students. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of a large scale implementation of disease management programmes in various Dutch regions: a study protocol

PubMed Central

2011-01-01

Background Disease management programmes (DMPs) have been developed to improve effectiveness and economic efficiency within chronic care delivery by combining patient-related, professional-directed, and organisational interventions. The benefits of DMPs within different settings, patient groups, and versions remain unclear. In this article we propose a protocol to evaluate a range of current DMPs by capturing them in a single conceptual framework, employing comparable structure, process, and outcome measures, and combining qualitative and quantitative research methods. Methods To assess DMP effectiveness a practical clinical trial will be conducted. Twenty-two disease management experiments will be studied in various Dutch regions consisting of a variety of collaborations between organisations and/or professionals. Patient cohorts include those with cardiovascular diseases, chronic obstructive pulmonary disease, diabetes, stroke, depression, psychotic diseases, and eating disorders. Our methodological approach combines qualitative and quantitative research methods to enable a comprehensive evaluation of complex programmes. Process indicators will be collected from health care providers' data registries and measured via physician and staff questionnaires. Patient questionnaires include health care experiences, health care utilisation, and quality of life. Qualitative data will be gathered by means of interviews and document analysis for an in depth description of project interventions and the contexts in which DMPs are embedded, and an ethnographic process evaluation in five DMPs. Such a design will provide insight into ongoing DMPs and demonstrate which elements of the intervention are potentially (cost)-effective for which patient populations. It will also enable sound comparison of the results of the different programmes. Discussion The study will lead to a better understanding of (1) the mechanisms of disease management, (2) the feasibility, and cost-effectiveness of a disease management approach to improving health care, and (3) the factors that determine success and failure of DMPs. Our study results will be relevant to decision makers and managers who confront the challenge of implementing and integrating DMPs into the health care system. Moreover, it will contribute to the search for methods to evaluate complex healthcare interventions. PMID:21219620

Evaluation of a large scale implementation of disease management programmes in various Dutch regions: a study protocol.

PubMed

Lemmens, Karin M M; Rutten-Van Mölken, Maureen P M H; Cramm, Jane M; Huijsman, Robbert; Bal, Roland A; Nieboer, Anna P

2011-01-10

Disease management programmes (DMPs) have been developed to improve effectiveness and economic efficiency within chronic care delivery by combining patient-related, professional-directed, and organisational interventions. The benefits of DMPs within different settings, patient groups, and versions remain unclear. In this article we propose a protocol to evaluate a range of current DMPs by capturing them in a single conceptual framework, employing comparable structure, process, and outcome measures, and combining qualitative and quantitative research methods. To assess DMP effectiveness a practical clinical trial will be conducted. Twenty-two disease management experiments will be studied in various Dutch regions consisting of a variety of collaborations between organisations and/or professionals. Patient cohorts include those with cardiovascular diseases, chronic obstructive pulmonary disease, diabetes, stroke, depression, psychotic diseases, and eating disorders. Our methodological approach combines qualitative and quantitative research methods to enable a comprehensive evaluation of complex programmes. Process indicators will be collected from health care providers' data registries and measured via physician and staff questionnaires. Patient questionnaires include health care experiences, health care utilisation, and quality of life. Qualitative data will be gathered by means of interviews and document analysis for an in depth description of project interventions and the contexts in which DMPs are embedded, and an ethnographic process evaluation in five DMPs. Such a design will provide insight into ongoing DMPs and demonstrate which elements of the intervention are potentially (cost)-effective for which patient populations. It will also enable sound comparison of the results of the different programmes. The study will lead to a better understanding of (1) the mechanisms of disease management, (2) the feasibility, and cost-effectiveness of a disease management approach to improving health care, and (3) the factors that determine success and failure of DMPs. Our study results will be relevant to decision makers and managers who confront the challenge of implementing and integrating DMPs into the health care system. Moreover, it will contribute to the search for methods to evaluate complex healthcare interventions.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Community dialogues for child health: results from a qualitative process evaluation in three countries.

PubMed

Martin, Sandrine; Leitão, Jordana; Muhangi, Denis; Nuwa, Anthony; Magul, Dieterio; Counihan, Helen

2017-06-05

Across the developing world, countries are increasingly adopting the integrated community case management of childhood illnesses (iCCM) strategy in efforts to reduce child mortality. This intervention's effectiveness is dependent on community adoption and changes in care-seeking practices. We assessed the implementation process of a theory-driven community dialogue (CD) intervention specifically designed to strengthen the support and uptake of the newly introduced iCCM services and related behaviours in three African countries. A qualitative process evaluation methodology was chosen and used secondary project data and primary data collected in two districts of each of the three countries, in purposefully sampled communities. The final data set included 67 focus group discussions and 57 key informant interviews, totalling 642 respondents, including caregivers, CD facilitators community leaders, and trainers. Thematic analysis of the data followed the 'Framework Approach' utilising both a deduction and induction process. Results show that CDs contribute to triggering community uptake of and support for iCCM services through filling health information gaps and building cooperation within communities. We found it to be an effective approach for addressing social norms around child care practices. This approach was embraced by communities for its flexibility and value in planning individual and collective change. Regular CDs can contribute to the formation of new habits, particularly in relation to seeking timely care in case of child sickness. This study also confirms the value of process evaluation to unwrap the mechanisms of community mobilisation approaches in context and provides key insights for improving the CD approach.

Implementation of the SMART MOVE intervention in primary care: a qualitative study using normalisation process theory.

PubMed

Glynn, Liam G; Glynn, Fergus; Casey, Monica; Wilkinson, Louise Gaffney; Hayes, Patrick S; Heaney, David; Murphy, Andrew W M

2018-05-02

Problematic translational gaps continue to exist between demonstrating the positive impact of healthcare interventions in research settings and their implementation into routine daily practice. The aim of this qualitative evaluation of the SMART MOVE trial was to conduct a theoretically informed analysis, using normalisation process theory, of the potential barriers and levers to the implementation of a mhealth intervention to promote physical activity in primary care. The study took place in the West of Ireland with recruitment in the community from the Clare Primary Care Network. SMART MOVE trial participants and the staff from four primary care centres were invited to take part and all agreed to do so. A qualitative methodology with a combination of focus groups (general practitioners, practice nurses and non-clinical staff from four separate primary care centres, n = 14) and individual semi-structured interviews (intervention and control SMART MOVE trial participants, n = 4) with purposeful sampling utilising the principles of Framework Analysis was utilised. The Normalisation Process Theory was used to develop the topic guide for the interviews and also informed the data analysis process. Four themes emerged from the analysis: personal and professional exercise strategies; roles and responsibilities to support active engagement; utilisation challenges; and evaluation, adoption and adherence. It was evident that introducing a new healthcare intervention demands a comprehensive evaluation of the intervention itself and also the environment in which it is to operate. Despite certain obstacles, the opportunity exists for the successful implementation of a novel healthcare intervention that addresses a hitherto unresolved healthcare need, provided that the intervention has strong usability attributes for both disseminators and target users and coheres strongly with the core objectives and culture of the health care environment in which it is to operate. We carried out a theoretical analysis of stakeholder informed barriers and levers to the implementation of a novel exercise promotion tool in the Irish primary care setting. We believe that this process amplifies the implementation potential of such an intervention in primary care. The SMART MOVE trial is registered at Current Controlled Trials (ISRCTN99944116; Date of registration: 1st August 2012).

Conducting Qualitative Data Analysis: Qualitative Data Analysis as a Metaphoric Process

ERIC Educational Resources Information Center

Chenail, Ronald J.

2012-01-01

In the second of a series of "how-to" essays on conducting qualitative data analysis, Ron Chenail argues the process can best be understood as a metaphoric process. From this orientation he suggests researchers follow Kenneth Burke's notion of metaphor and see qualitative data analysis as the analyst systematically considering the "this-ness" of…

Qualitative research in rehabilitation science: opportunities, challenges, and future directions.

PubMed

VanderKaay, Sandra; Moll, Sandra E; Gewurtz, Rebecca E; Jindal, Pranay; Loyola-Sanchez, Adalberto; Packham, Tara L; Lim, Chun Y

2018-03-01

Qualitative research has had a significant impact within rehabilitation science over time. During the past 20 years the number of qualitative studies published per year in Disability and Rehabilitation has markedly increased (from 1 to 54). In addition, during this period there have been significant changes in how qualitative research is conceptualized, conducted, and utilized to advance the field of rehabilitation. The purpose of this article is to reflect upon the progress of qualitative research within rehabilitation to date, to explicate current opportunities and challenges, and to suggest future directions to continue to strengthen the contribution of qualitative research in this field. Relevant literature searches were conducted in electronic data bases and reference lists. Pertinent literature was examined to identify current opportunities and challenges for qualitative research use in rehabilitation and to identify future directions. Six key areas of opportunity and challenge were identified: (a) paradigm shifts, (b) advancements in methodology, (c) emerging technology, (d) advances in quality evaluation, (e) increasing popularity of mixed methods approaches, and (f) evolving approaches to knowledge translation. Two important future directions for rehabilitation are posited: (1) advanced training in qualitative methods and (2) engaging qualitative communities of research. Qualitative research is well established in rehabilitation and has an important place in the continued growth of this field. Ongoing development of qualitative researchers and methods are essential. Implications for Rehabilitation Qualitative research has the potential to improve rehabilitation practice by addressing some of the most pervasive concerns in the field such as practitioner-client interaction, the subjective and lived experience of disability, and clinical reasoning and decision making. This will serve to better inform those providing rehabilitation services thereby benefiting patients that are utilizing these services. Changes over time in how qualitative research is conceptualized, conducted, and utilized to advance rehabilitation science have resulted in a number of unique opportunities and challenges in using qualitative research that must be considered within this field. Advances in methodology and increased expectations for evaluation must be considered to ensure quality and credibility of qualitative rehabilitation research within rehabilitation. Improved quality and credibility may increase likelihood of research dissemination and use by clinicians intervening within the rehabilitation process in order to improve clinical practice. In order to maximize opportunities and mitigate challenges there are two principal future directions for rehabilitation scientists to consider: (1) advancing training in qualitative methods to adequately prepare future rehabilitation scientists and (2) engaging qualitative communities of research.

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren.

PubMed

Helitzer, D L; Davis, S M; Gittelsohn, J; Going, S B; Murray, D M; Snyder, P; Steckler, A B

1999-04-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used.

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Resolving Complex Research Data Management Issues in Biomedical Laboratories: Qualitative Study of an Industry-Academia Collaboration

PubMed Central

Myneni, Sahiti; Patel, Vimla L.; Bova, G. Steven; Wang, Jian; Ackerman, Christopher F.; Berlinicke, Cynthia A.; Chen, Steve H.; Lindvall, Mikael; Zack, Donald J.

2016-01-01

This paper describes a distributed collaborative effort between industry and academia to systematize data management in an academic biomedical laboratory. Heterogeneous and voluminous nature of research data created in biomedical laboratories make information management difficult and research unproductive. One such collaborative effort was evaluated over a period of four years using data collection methods including ethnographic observations, semi-structured interviews, web-based surveys, progress reports, conference call summaries, and face-to-face group discussions. Data were analyzed using qualitative methods of data analysis to 1) characterize specific problems faced by biomedical researchers with traditional information management practices, 2) identify intervention areas to introduce a new research information management system called Labmatrix, and finally to 3) evaluate and delineate important general collaboration (intervention) characteristics that can optimize outcomes of an implementation process in biomedical laboratories. Results emphasize the importance of end user perseverance, human-centric interoperability evaluation, and demonstration of return on investment of effort and time of laboratory members and industry personnel for success of implementation process. In addition, there is an intrinsic learning component associated with the implementation process of an information management system. Technology transfer experience in a complex environment such as the biomedical laboratory can be eased with use of information systems that support human and cognitive interoperability. Such informatics features can also contribute to successful collaboration and hopefully to scientific productivity. PMID:26652980

Expediting the Analysis of Qualitative Data in Evaluation: A Procedure for the Rapid Identification of Themes from Audio Recordings (RITA)

ERIC Educational Resources Information Center

Neal, Jennifer Watling; Neal, Zachary P.; VanDyke, Erika; Kornbluh, Mariah

2015-01-01

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

'Potentially inappropriate or specifically appropriate?' Qualitative evaluation of general practitioners views on prescribing, polypharmacy and potentially inappropriate prescribing in older people.

PubMed

Clyne, Barbara; Cooper, Janine A; Hughes, Carmel M; Fahey, Tom; Smith, Susan M

2016-08-11

Potentially inappropriate prescribing (PIP) is common in older people in primary care, as evidenced by a significant body of quantitative research. However, relatively few qualitative studies have investigated the phenomenon of PIP and its underlying processes from the perspective of general practitioners (GPs). The aim of this paper is to explore qualitatively, GP perspectives regarding prescribing and PIP in older primary care patients. Semi-structured qualitative interviews were conducted with GPs participating in a randomised controlled trial (RCT) of an intervention to decrease PIP in older patients (≥70 years) in Ireland. Interviews were conducted with GP participants (both intervention and control) from the OPTI-SCRIPT cluster RCT as part of the trial process evaluation between January and July 2013. Interviews were conducted by one interviewer and audio recorded. Interviews were transcribed verbatim and a thematic analysis was conducted. Seventeen semi-structured interviews were conducted (13 male; 4 female). Three main, inter-related themes emerged (complex prescribing environment, paternalistic doctor-patient relationship, and relevance of PIP concept). Patient complexity (e.g. polypharmacy, multimorbidity), as well as prescriber complexity (e.g. multiple prescribers, poor communication, restricted autonomy) were all identified as factors contributing to a complex prescribing environment where PIP could occur, as was a paternalistic-doctor patient relationship. The concept of PIP was perceived to be of variable usefulness to GPs and the criteria to measure it may be at odds with the complex processes of prescribing for this patient population. Several inter-related factors contributing to the occurrence of PIP were identified, some of which may be amenable to intervention. Improvement strategies focused on improved management of polypharmacy and multimorbidity, and communication across primary and secondary care could result in substantial improvements in PIP. Current controlled trials ISRCTN41694007.

QUAGOL: a guide for qualitative data analysis.

PubMed

Dierckx de Casterlé, Bernadette; Gastmans, Chris; Bryon, Els; Denier, Yvonne

2012-03-01

Data analysis is a complex and contested part of the qualitative research process, which has received limited theoretical attention. Researchers are often in need of useful instructions or guidelines on how to analyze the mass of qualitative data, but face the lack of clear guidance for using particular analytic methods. The aim of this paper is to propose and discuss the Qualitative Analysis Guide of Leuven (QUAGOL), a guide that was developed in order to be able to truly capture the rich insights of qualitative interview data. The article describes six major problems researchers are often struggling with during the process of qualitative data analysis. Consequently, the QUAGOL is proposed as a guide to facilitate the process of analysis. Challenges emerged and lessons learned from own extensive experiences with qualitative data analysis within the Grounded Theory Approach, as well as from those of other researchers (as described in the literature), were discussed and recommendations were presented. Strengths and pitfalls of the proposed method were discussed in detail. The Qualitative Analysis Guide of Leuven (QUAGOL) offers a comprehensive method to guide the process of qualitative data analysis. The process consists of two parts, each consisting of five stages. The method is systematic but not rigid. It is characterized by iterative processes of digging deeper, constantly moving between the various stages of the process. As such, it aims to stimulate the researcher's intuition and creativity as optimal as possible. The QUAGOL guide is a theory and practice-based guide that supports and facilitates the process of analysis of qualitative interview data. Although the method can facilitate the process of analysis, it cannot guarantee automatic quality. The skills of the researcher and the quality of the research team remain the most crucial components of a successful process of analysis. Additionally, the importance of constantly moving between the various stages throughout the research process cannot be overstated. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of Patient Centered Medical Home Practice Transformation Initiatives

PubMed Central

Crabtree, Benjamin F.; Chase, Sabrina M.; Wise, Christopher G.; Schiff, Gordon D.; Schmidt, Laura A.; Goyzueta, Jeanette R.; Malouin, Rebecca A.; Payne, Susan M. C.; Quinn, Michael T.; Nutting, Paul A.; Miller, William L.; Jaén, Carlos Roberto

2011-01-01

Background The patient-centered medical home (PCMH) has become a widely cited solution to the deficiencies in primary care delivery in the United States. To achieve the magnitude of change being called for in primary care, quality improvement interventions must focus on whole-system redesign, and not just isolated parts of medical practices. Methods Investigators participating in 9 different evaluations of Patient Centered Medical Home implementation shared experiences, methodological strategies, and evaluation challenges for evaluating primary care practice redesign. Results A year-long iterative process of sharing and reflecting on experiences produced consensus on 7 recommendations for future PCMH evaluations: (1) look critically at models being implemented and identify aspects requiring modification; (2) include embedded qualitative and quantitative data collection to detail the implementation process; (3) capture details concerning how different PCMH components interact with one another over time; (4) understand and describe how and why physician and staff roles do, or do not evolve; (5) identify the effectiveness of individual PCMH components and how they are used; (6) capture how primary care practices interface with other entities such as specialists, hospitals, and referral services; and (7) measure resources required for initiating and sustaining innovations. Conclusions Broad-based longitudinal, mixed-methods designs that provide for shared learning among practice participants, program implementers, and evaluators are necessary to evaluate the novelty and promise of the PCMH model. All PCMH evaluations should as comprehensive as possible, and at a minimum should include a combination of brief observations and targeted qualitative interviews along with quantitative measures. PMID:21079525

Patient-Centered Research to Support the Development of the Symptoms of Major Depressive Disorder Scale (SMDDS): Initial Qualitative Research.

PubMed

McCarrier, Kelly P; Deal, Linda S; Abraham, Lucy; Blum, Steven I; Bush, Elizabeth Nicole; Martin, Mona L; Thase, Michael E; Coons, Stephen Joel

2016-04-01

Content valid, patient-reported outcome (PRO) measures of major depressive disorder (MDD) symptoms are needed to assess MDD treatment benefit. While a range of questionnaires are currently available to evaluate aspects of depression from the patient's perspective, their comprehensiveness and qualitative development histories are unclear. The objective of this study was to describe the process and results of the preliminary qualitative development of a new symptom-based PRO measure intended to assess treatment benefit in MDD clinical trials. Qualitative interviews were conducted with adult MDD patients in the USA who recently experienced a major depressive episode. Experienced interviewers conducted concept elicitation (CE) and cognitive interviews using semi-structured interview guides. The CE interview guide was used to elicit spontaneous reports of symptom experiences along with probing to further explore and confirm concepts. The cognitive interview guide was developed to evaluate concept relevance, understandability, and structure of the draft items, and to facilitate further instrument refinement. Forty patients participated in the CE interviews. A total of 3022 symptom codes, representing 84 different concepts were derived from the transcripts. Data from the CE interviews were considered alongside existing literature and clinical expert opinion during an item-generation process, leading to development of a preliminary version of the Symptoms of Major Depressive Disorder Scale (SMDDS). Fifteen patients participated in three waves of cognitive interviews, during which the SMDDS was further refined. The SMDDS is a 35-item PRO measure intended for use as an endpoint in MDD clinical trials to support medical product labeling. The SMDDS uses a 7-day recall period and verbal rating scales. It was developed in accordance with the US Food and Drug Administration (FDA)'s PRO Guidance and best practices. Qualitative interviews have provided evidence for content validity. Future quantitative studies will confirm the SMDDS's measurement properties and support FDA qualification.

A health equity critique of social marketing: where interventions have impact but insufficient reach.

PubMed

Langford, Rebecca; Panter-Brick, Catherine

2013-04-01

Health interventions increasingly rely on formative qualitative research and social marketing techniques to effect behavioural change. Few studies, however, incorporate qualitative research into the process of program evaluation to understand both impact and reach: namely, to what extent behaviour change interventions work, for whom, in what contexts, and why. We reflect on the success of a community-based hygiene intervention conducted in the slums of Kathmandu, Nepal, evaluating both maternal behaviour and infant health. We recruited all available mother-infant pairs (n = 88), and allocated them to control and intervention groups. Formative qualitative research on hand-washing practices included structured observations of 75 mothers, 3 focus groups, and 26 in-depth interviews. Our intervention was led by Community Motivators, intensively promoting hand-washing-with-soap at key junctures of food and faeces contamination. The 6-month evaluation period included hand-washing and morbidity rates, participant observation, systematic records of fortnightly community meetings, and follow-up interviews with 12 mothers. While quantitative measures demonstrated improvement in hand-washing rates and a 40% reduction in child diarrhoea, the qualitative data highlighted important equity issues in reaching the ultra-poor. We argue that a social marketing approach is inherently limited: focussing on individual agency, rather than structural conditions constraining behaviour, can unwittingly exacerbate health inequity. This contributes to a prevention paradox whereby those with the greatest need of a health intervention are least likely to benefit, finding hand-washing in the slums to be irrelevant or futile. Thus social marketing is best deployed within a range of interventions that address the structural as well as the behavioural and cognitive drivers of behaviour change. We conclude that critiques of social marketing have not paid sufficient attention to issues of health equity, and demonstrate how this can be addressed with qualitative data, embedded in both the formative and evaluative phases of a health intervention. Copyright © 2013 Elsevier Ltd. All rights reserved.

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

PubMed

Holtrop, Jodi Summers; Rabin, Borsika A; Glasgow, Russell E

2018-03-13

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Implementing a lessons learned process at Sandia National Laboratories

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fosshage, Erik D.; Drewien, Celeste A.; Eras, Kenneth

2016-01-01

The Lessons Learned Process Improvement Team was tasked to gain an understanding of the existing lessons learned environment within the major programs at Sandia National Laboratories, identify opportunities for improvement in that environment as compared to desired attributes, propose alternative implementations to address existing inefficiencies, perform qualitative evaluations of alternative implementations, and recommend one or more near-term activities for prototyping and/or implementation. This report documents the work and findings of the team.

Exploring the barriers of quitting smoking during pregnancy: a systematic review of qualitative studies.

PubMed

Ingall, Georgina; Cropley, Mark

2010-06-01

Smoking during pregnancy is widely known to increase health risks to the foetus, and understanding the quitting process during pregnancy is essential in order to realise national government targets. Qualitative studies have been used in order to gain a greater understanding of the quitting process and the objective of this systematic review was to examine and evaluate qualitative studies that have investigated the psychological and social factors around women attempting to quit smoking during pregnancy. Electronic databases and journals were searched with seven articles included in this review. The findings demonstrated that women were aware of the health risks to the foetus associated with smoking; however knowledge of potential health risks was not sufficient to motivate them to quit. Several barriers to quitting were identified which included willpower, role, and meaning of smoking, issues with cessation provision, changes in relationship interactions, understanding of facts, changes in smell and taste and influence of family and friends. A further interesting finding was that cessation service provision by health professionals was viewed negatively by women. It was concluded that there is a shortage of qualitative studies that concentrate on the specific difficulties that pregnant women face when trying to quit smoking. 2009 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

Bridging the gap between the economic evaluation literature and daily practice in occupational health: a qualitative study among decision-makers in the healthcare sector.

PubMed

van Dongen, Johanna M; Tompa, Emile; Clune, Laurie; Sarnocinska-Hart, Anna; Bongers, Paulien M; van Tulder, Maurits W; van der Beek, Allard J; van Wier, Marieke F

2013-06-03

Continued improvements in occupational health can only be ensured if decisions regarding the implementation and continuation of occupational health and safety interventions (OHS interventions) are based on the best available evidence. To ensure that this is the case, scientific evidence should meet the needs of decision-makers. As a first step in bridging the gap between the economic evaluation literature and daily practice in occupational health, this study aimed to provide insight into the occupational health decision-making process and information needs of decision-makers. An exploratory qualitative study was conducted with a purposeful sample of occupational health decision-makers in the Ontario healthcare sector. Eighteen in-depth interviews were conducted to explore the process by which occupational health decisions are made and the importance given to the financial implications of OHS interventions. Twenty-five structured telephone interviews were conducted to explore the sources of information used during the decision-making process, and decision-makers' knowledge on economic evaluation methods. In-depth interview data were analyzed according to the constant comparative method. For the structured telephone interviews, summary statistics were prepared. The occupational health decision-making process generally consists of three stages: initiation stage, establishing the need for an intervention; pre-implementation stage, developing an intervention and its business case in order to receive senior management approval; and implementation and evaluation stage, implementing and evaluating an intervention. During this process, information on the financial implications of OHS interventions was found to be of great importance, especially the employer's costs and benefits. However, scientific evidence was rarely consulted, sound ex-post program evaluations were hardly ever performed, and there seemed to be a need to advance the economic evaluation skill set of decision-makers. Financial information is particularly important at the front end of implementation decisions, and can be a key deciding factor of whether to go forward with a new OHS intervention. In addition, it appears that current practice in occupational health in the healthcare sector is not solidly grounded in evidence-based decision-making and strategies should be developed to improve this.

Bridging the gap between the economic evaluation literature and daily practice in occupational health: a qualitative study among decision-makers in the healthcare sector

PubMed Central

2013-01-01

Background Continued improvements in occupational health can only be ensured if decisions regarding the implementation and continuation of occupational health and safety interventions (OHS interventions) are based on the best available evidence. To ensure that this is the case, scientific evidence should meet the needs of decision-makers. As a first step in bridging the gap between the economic evaluation literature and daily practice in occupational health, this study aimed to provide insight into the occupational health decision-making process and information needs of decision-makers. Methods An exploratory qualitative study was conducted with a purposeful sample of occupational health decision-makers in the Ontario healthcare sector. Eighteen in-depth interviews were conducted to explore the process by which occupational health decisions are made and the importance given to the financial implications of OHS interventions. Twenty-five structured telephone interviews were conducted to explore the sources of information used during the decision-making process, and decision-makers’ knowledge on economic evaluation methods. In-depth interview data were analyzed according to the constant comparative method. For the structured telephone interviews, summary statistics were prepared. Results The occupational health decision-making process generally consists of three stages: initiation stage, establishing the need for an intervention; pre-implementation stage, developing an intervention and its business case in order to receive senior management approval; and implementation and evaluation stage, implementing and evaluating an intervention. During this process, information on the financial implications of OHS interventions was found to be of great importance, especially the employer’s costs and benefits. However, scientific evidence was rarely consulted, sound ex-post program evaluations were hardly ever performed, and there seemed to be a need to advance the economic evaluation skill set of decision-makers. Conclusions Financial information is particularly important at the front end of implementation decisions, and can be a key deciding factor of whether to go forward with a new OHS intervention. In addition, it appears that current practice in occupational health in the healthcare sector is not solidly grounded in evidence-based decision-making and strategies should be developed to improve this. PMID:23731570

The impact of using peer interviewers in a study of patient empowerment amongst people in cancer follow-up.

PubMed

Jørgensen, Clara R; Eskildsen, Nanna B; Thomsen, Thora G; Nielsen, Inger D; Johnsen, Anna T

2017-12-05

A range of benefits have been reported from engaging peer interviewers in qualitative interviews, but little systematic evaluation exists to assess their impact on both process and outcomes of qualitative interviews in health research. To investigate the impact of involving patient representatives as peer interviewers in a research project on patient empowerment. 18 interviews were carried out as part of the wider study, seven by the academic researcher alone and eleven jointly with a peer interviewer. The interviews were analysed quantitatively and qualitatively to explore potential differences between interviews conducted by the researcher alone and interviews conducted jointly by the researcher and the peer interviewers. A phone evaluation of the peer interviews was carried out with the research participants, and notes were thematically analysed to understand their experiences. Differences were identified between the academic researcher and the peer interviewers in the types of questions they asked and the degree to which personal narrative was used in the interview. Peer interviewers varied significantly in their approach. Research participants were positive about the experience of being interviewed by a peer interviewer. No firm conclusions could be made about impact on outcomes. The uniqueness and complexity of qualitative interviews made it difficult to provide any firm conclusions about the impact of having peer interviewers on the research outcomes, and the benefits identified from the analysis mostly related to the process of the interviews. Benefits from using peer interviewers need to be considered alongside relevant ethical considerations, and available resources for training and support. © 2017 The Authors Health Expectations published by John Wiley & Sons Ltd.

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

Developing Leadership for Life: Outcomes from a Collegiate Student-Alumni Mentoring Program

ERIC Educational Resources Information Center

Priest, Kerry L.; Donley, Sarah

2014-01-01

This application brief describes the exploratory assessment of a mentoring program between current students and alumni of a leadership studies minor program. We connect leadership education research and practice in two ways: first, we describe a process of qualitative program evaluation to inform program best practices and improvement. In doing…

Exploring the Epistemic Impacts of Academic Performance Indicators in the Life Sciences

ERIC Educational Resources Information Center

Müller, Ruth; de Rijcke, Sarah

2017-01-01

While quantitative performance indicators are widely used by organizations and individuals for evaluative purposes, little is known about their impacts on the epistemic processes of academic knowledge production. In this article we bring together three qualitative research projects undertaken in the Netherlands and Austria to contribute to filling…

Community College Education Foundations and Transformational Philanthropy: Resource Management, Stewardship and Professionalism.

ERIC Educational Resources Information Center

LaBeouf, Joanne P.

This paper argues that, as institutional revenues continue to decline, community college administrators must not only work at developing a robust foundation with an identifiable process similar to that of a private nonprofit foundation, but also provide professional stewardship in its operation. The author used a qualitative, evaluative approach…

75 FR 64773 - Study Required by Section 989G(b) of the Dodd-Frank Act Regarding Compliance With Section 404(b...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-20

..., which addresses management's responsibility for reporting on the effectiveness of internal control over...) Quantitative and qualitative information about the trends of internal and external costs of having an external... over time; (3) Characteristics of internal controls, management's evaluation process and corporate...

Initial Validity Evidence for the State Mindfulness Scale for Physical Activity with Youth

ERIC Educational Resources Information Center

Ullrich-French, Sarah; Cox, Anne; Cole, Amy; Rhoades Cooper, Brittany; Gotch, Chad

2017-01-01

Experiencing mindfulness during movement-based interventions (e.g., yoga) may help support adaptive physical activity motivation processes in youth. However, there is currently no measure for assessing state mindfulness with youth within the context of physical activity. The purpose of this study was to qualitatively and quantitatively evaluate a…

Enhancing Palpation Skills through the Use of Stereognosis Drills

ERIC Educational Resources Information Center

Lawrance, Scott E.; Voll, Craig A.; Jochum, Jessica Emlich

2016-01-01

Context: Musculoskeletal palpation is taught in our athletic training programs as part of the injury evaluation process. However, as palpation skills are taught, the focus is oftentimes on accuracy of surface-anatomy landmarks instead of the ability to discriminate qualitative information such as tissue tone, spasm, or pain response from the soft…

Accessing Multicultural Issues through Critical Thinking, Critical Inquiry, and the Student Research Process

ERIC Educational Resources Information Center

Hawkins, Judith

2006-01-01

This qualitative study describes and evaluates a pedagogical procedure that allows multicultural college freshmen to devise and research topics indigenous to their communal backgrounds. The researcher wishes to ascertain whether a method delineated by an academic procedure and limited to a classroom setting can have extended social implications…

Art Appreciation for Developing Communication Skills among Preschool Children

ERIC Educational Resources Information Center

Duh, Matjaž

2016-01-01

In the contemporary process of teaching fine arts, children's own creative expression and art appreciation are used to encourage learners towards both perception and reception; consequently, the evaluation and internalization of works of art play an equally important role. In a qualitative empirical research study that takes the form of a case…

Demonstration for Social Change: An Experiment in Local Control.

ERIC Educational Resources Information Center

Gittell, Marilyn; And Others

This evaluative history of New York City's recent experiments in public education documents three projects: Ocean Hill-Brownsville, IS 201, and Two Bridges. This study employs a process oriented and a qualitative methodology which relies most on field observation and participant-observers. The Institute study observed the new community boards,…

Non-destructive and fast identification of cotton-polyester blend fabrics by the portable near-infrared spectrometer.

PubMed

Li, Wen-xia; Li, Feng; Zhao, Guo-liang; Tang, Shi-jun; Liu, Xiao-ying

2014-12-01

A series of 376 cotton-polyester (PET) blend fabrics were studied by a portable near-infrared (NIR) spectrometer. A NIR semi-quantitative-qualitative calibration model was established by Partial Least Squares (PLS) method combined with qualitative identification coefficient. In this process, PLS method in a quantitative analysis was used as a correction method, and the qualitative identification coefficient was set by the content of cotton and polyester in blend fabrics. Cotton-polyester blend fabrics were identified qualitatively by the model and their relative contents were obtained quantitatively, the model can be used for semi-quantitative identification analysis. In the course of establishing the model, the noise and baseline drift of the spectra were eliminated by Savitzky-Golay(S-G) derivative. The influence of waveband selection and different pre-processing method was also studied in the qualitative calibration model. The major absorption bands of 100% cotton samples were in the 1400~1600 nm region, and the one for 100% polyester were around 1600~1800 nm, the absorption intensity was enhancing with the content increasing of cotton or polyester. Therefore, the cotton-polyester's major absorption region was selected as the base waveband, the optimal waveband (1100~2500 nm) was found by expanding the waveband in two directions (the correlation coefficient was 0.6, and wave-point number was 934). The validation samples were predicted by the calibration model, the results showed that the model evaluation parameters was optimum in the 1100~2500 nm region, and the combination of S-G derivative, multiplicative scatter correction (MSC) and mean centering was used as the pre-processing method. RC (relational coefficient of calibration) value was 0.978, RP (relational coefficient of prediction) value was 0.940, SEC (standard error of calibration) value was 1.264, SEP (standard error of prediction) value was 1.590, and the sample's recognition accuracy was up to 93.4%. It showed that the cotton-polyester blend fabrics could be predicted by the semi-quantitative-qualitative calibration model.

Accumulator and random-walk models of psychophysical discrimination: a counter-evaluation.

PubMed

Vickers, D; Smith, P

1985-01-01

In a recent assessment of models of psychophysical discrimination, Heath criticises the accumulator model for its reliance on computer simulation and qualitative evidence, and contrasts it unfavourably with a modified random-walk model, which yields exact predictions, is susceptible to critical test, and is provided with simple parameter-estimation techniques. A counter-evaluation is presented, in which the approximations employed in the modified random-walk analysis are demonstrated to be seriously inaccurate, the resulting parameter estimates to be artefactually determined, and the proposed test not critical. It is pointed out that Heath's specific application of the model is not legitimate, his data treatment inappropriate, and his hypothesis concerning confidence inconsistent with experimental results. Evidence from adaptive performance changes is presented which shows that the necessary assumptions for quantitative analysis in terms of the modified random-walk model are not satisfied, and that the model can be reconciled with data at the qualitative level only by making it virtually indistinguishable from an accumulator process. A procedure for deriving exact predictions for an accumulator process is outlined.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Towards Measurement of Confidence in Safety Cases

NASA Technical Reports Server (NTRS)

Denney, Ewen; Paim Ganesh J.; Habli, Ibrahim

2011-01-01

Arguments in safety cases are predominantly qualitative. This is partly attributed to the lack of sufficient design and operational data necessary to measure the achievement of high-dependability targets, particularly for safety-critical functions implemented in software. The subjective nature of many forms of evidence, such as expert judgment and process maturity, also contributes to the overwhelming dependence on qualitative arguments. However, where data for quantitative measurements is systematically collected, quantitative arguments provide far more benefits over qualitative arguments, in assessing confidence in the safety case. In this paper, we propose a basis for developing and evaluating integrated qualitative and quantitative safety arguments based on the Goal Structuring Notation (GSN) and Bayesian Networks (BN). The approach we propose identifies structures within GSN-based arguments where uncertainties can be quantified. BN are then used to provide a means to reason about confidence in a probabilistic way. We illustrate our approach using a fragment of a safety case for an unmanned aerial system and conclude with some preliminary observations

The experience of acute leukaemia in adult patients: a qualitative thematic synthesis.

PubMed

Papadopoulou, Constantina; Johnston, Bridget; Themessl-Huber, Markus

2013-10-01

The aim of this review was to systematically identify and synthesise all qualitative evidence on how adult patients diagnosed with acute leukaemia experience living with their illness. A systematic search strategy was developed comprising of two search strings: i) acute leukaemia and ii) qualitative methodology. The search strategy was run in seven electronic databases (Medline, CINAHL, PsychINFO, EMBASE, BNI & Archive, SSCI and ASSIA). Nine qualitative studies in adult patients with acute leukaemia, published in peer reviewed journals between 01/1990 and 01/2013 were included in the final sample. The qualitative thematic synthesis resulted in the development of a conceptual model describing a person's path to build a renewed self. Following the initial blow of diagnosis with the range of initial reactions, patients with acute leukaemia are living in a contracting world; they have to deal with the life in hospital, the several losses and the impact of their illness on their emotions and interpersonal relationships. Several factors take up a buffering role at that stage: coping, support, information and hope. Finally, patients accommodate acute leukaemia in their lives through re-evaluating personal values and assigning new meaning to their experience. Results from this thematic synthesis are indicative of the impact of acute leukaemia on patients' lives and the processes they use to make sense and accommodate the illness in their life. Increasing our understanding of these processes is warranted to improve patient care. Copyright © 2013. Published by Elsevier Ltd.

Evaluating a Dutch cardiology primary care plus intervention on the Triple Aim outcomes: study design of a practice-based quantitative and qualitative research.

PubMed

Quanjel, Tessa C C; Spreeuwenberg, Marieke D; Struijs, Jeroen N; Baan, Caroline A; Ruwaard, Dirk

2017-09-06

In an attempt to deal with the pressures on the health-care system and to guarantee sustainability, changes are needed. This study focuses on a cardiology primary care plus intervention. Primary care plus (PC+) is a new health-care delivery model focused on substitution of specialist care in the hospital setting with specialist care in the primary care setting. The intervention consists of a cardiology PC+ centre in which cardiologists, supported by other health-care professionals, provide consultations in a primary care setting. The PC+ centre aims to improve the health of the population and quality of care as experienced by patients, and reduce the number of referrals to hospital-based outpatient specialist care in order to reduce health-care costs. These aims reflect the Triple Aim principle. Hence, the objectives of the study are to evaluate the cardiology PC+ centre in terms of the Triple Aim outcomes and to evaluate the process of the introduction of PC+. The study is a practice-based, quantitative study with a longitudinal observational design, and an additional qualitative study to supplement, interpret and improve the quantitative study. The study population of the quantitative part will consist of adult patients (≥18 years) with non-acute and low-complexity cardiology-related health complaints, who will be referred to the cardiology PC+ centre (intervention group) or hospital-based outpatient cardiology care (control group). All eligible patients will be asked to complete questionnaires at three different time points consisting of questions about their demographics, health status and experience of care. Additionally, quantitative data will be collected about health-care utilization and related health-care costs at the PC+ centre and the hospital. The qualitative part, consisting of semi-structured interviews, focus groups, and observations, is designed to evaluate the process as well as to amplify, clarify and explain quantitative results. This study will evaluate a cardiology PC+ centre using quantitative and supplementary qualitative methods. The findings of both sub-studies will fill a gap in knowledge about the effects of PC+ and in particular whether PC+ is able to pursue the Triple Aim outcomes. NTR6629 (Data registered: 25-08-2017) (registered retrospectively).

Reporting Qualitative Research: Standards, Challenges, and Implications for Health Design.

PubMed

Peditto, Kathryn

2018-04-01

This Methods column describes the existing reporting standards for qualitative research, their application to health design research, and the challenges to implementation. Intended for both researchers and practitioners, this article provides multiple perspectives on both reporting and evaluating high-quality qualitative research. Two popular reporting standards exist for reporting qualitative research-the Consolidated Criteria for Reporting Qualitative Research (COREQ) and the Standards for Reporting Qualitative Research (SRQR). Though compiled using similar procedures, they differ in their criteria and the methods to which they apply. Creating and applying reporting criteria is inherently difficult due to the undefined and fluctuating nature of qualitative research when compared to quantitative studies. Qualitative research is expansive and occasionally controversial, spanning many different methods of inquiry and epistemological approaches. A "one-size-fits-all" standard for reporting qualitative research can be restrictive, but COREQ and SRQR both serve as valuable tools for developing responsible qualitative research proposals, effectively communicating research decisions, and evaluating submissions. Ultimately, tailoring a set of standards specific to health design research and its frequently used methods would ensure quality research and aid reviewers in their evaluations.

[Application and Integration of Qualitative and Quantitative Research Methods in Intervention Studies in Rehabilitation Research].

PubMed

Wirtz, M A; Strohmer, J

2016-06-01

In order to develop and evaluate interventions in rehabilitation research a wide range of empirical research methods may be adopted. Qualitative research methods emphasize the relevance of an open research focus and a natural proximity to research objects. Accordingly, using qualitative methods special benefits may arise if researchers strive to identify and organize unknown information aspects (inductive purpose). Particularly, quantitative research methods require a high degree of standardization and transparency of the research process. Furthermore, a clear definition of efficacy and effectiveness exists (deductive purpose). These paradigmatic approaches are characterized by almost opposite key characteristics, application standards, purposes and quality criteria. Hence, specific aspects have to be regarded if researchers aim to select or combine those approaches in order to ensure an optimal gain in knowledge. © Georg Thieme Verlag KG Stuttgart · New York.

Quantitative methods in assessment of neurologic function.

PubMed

Potvin, A R; Tourtellotte, W W; Syndulko, K; Potvin, J

1981-01-01

Traditionally, neurologists have emphasized qualitative techniques for assessing results of clinical trials. However, in recent years qualitative evaluations have been increasingly augmented by quantitative tests for measuring neurologic functions pertaining to mental state, strength, steadiness, reactions, speed, coordination, sensation, fatigue, gait, station, and simulated activities of daily living. Quantitative tests have long been used by psychologists for evaluating asymptomatic function, assessing human information processing, and predicting proficiency in skilled tasks; however, their methodology has never been directly assessed for validity in a clinical environment. In this report, relevant contributions from the literature on asymptomatic human performance and that on clinical quantitative neurologic function are reviewed and assessed. While emphasis is focused on tests appropriate for evaluating clinical neurologic trials, evaluations of tests for reproducibility, reliability, validity, and examiner training procedures, and for effects of motivation, learning, handedness, age, and sex are also reported and interpreted. Examples of statistical strategies for data analysis, scoring systems, data reduction methods, and data display concepts are presented. Although investigative work still remains to be done, it appears that carefully selected and evaluated tests of sensory and motor function should be an essential factor for evaluating clinical trials in an objective manner.

Transportation systems evaluation methodology development and applications, phase 3

NASA Technical Reports Server (NTRS)

Kuhlthau, A. R.; Jacobson, I. D.; Richards, L. C.

1981-01-01

Transportation systems or proposed changes in current systems are evaluated. Four principal evaluation criteria are incorporated in the process, operating performance characteristics as viewed by potential users, decisions based on the perceived impacts of the system, estimating what is required to reduce the system to practice; and predicting the ability of the concept to attract financial support. A series of matrix multiplications in which the various matrices represent evaluations in a logical sequence of the various discrete steps in a management decision process is used. One or more alternatives are compared with the current situation, and the result provides a numerical rating which determines the desirability of each alternative relative to the norm and to each other. The steps in the decision process are isolated so that contributions of each to the final result are readily analyzed. The ability to protect against bias on the part of the evaluators, and the fact that system parameters which are basically qualitative in nature can be easily included are advantageous.

Designing dual-plate meteoroid shields: A new analysis

NASA Technical Reports Server (NTRS)

Swift, H. F.; Bamford, R.; Chen, R.

1982-01-01

Physics governing ultrahigh velocity impacts onto dual-plate meteor armor is discussed. Meteoroid shield design methodologies are considered: failure mechanisms, qualitative features of effective meteoroid shield designs, evaluating/processing meteoroid threat models, and quantitative techniques for optimizing effective meteoroid shield designs. Related investigations are included: use of Kevlar cloth/epoxy panels in meteoroid shields for the Halley's Comet intercept vehicle, mirror exposure dynamics, and evaluation of ion fields produced around the Halley Intercept Mission vehicle by meteoroid impacts.

Evaluation of a rule-based compositing technique for Landsat-5 TM and Landsat-7 ETM+ images

NASA Astrophysics Data System (ADS)

Lück, W.; van Niekerk, A.

2016-05-01

Image compositing is a multi-objective optimization process. Its goal is to produce a seamless cloud and artefact-free artificial image. This is achieved by aggregating image observations and by replacing poor and cloudy data with good observations from imagery acquired within the timeframe of interest. This compositing process aims to minimise the visual artefacts which could result from different radiometric properties, caused by atmospheric conditions, phenologic patterns and land cover changes. It has the following requirements: (1) image compositing must be cloud free, which requires the detection of clouds and shadows, and (2) the image composite must be seamless, minimizing artefacts and visible across inter image seams. This study proposes a new rule-based compositing technique (RBC) that combines the strengths of several existing methods. A quantitative and qualitative evaluation is made of the RBC technique by comparing it to the maximum NDVI (MaxNDVI), minimum red (MinRed) and maximum ratio (MaxRatio) compositing techniques. A total of 174 Landsat TM and ETM+ images, covering three study sites and three different timeframes for each site, are used in the evaluation. A new set of quantitative/qualitative evaluation techniques for compositing quality measurement was developed and showed that the RBC technique outperformed all other techniques, with MaxRatio, MaxNDVI, and MinRed techniques in order of performance from best to worst.

Evaluation of the Effectiveness of Stormwater Decision Support Tools for Infrastructure Selection and the Barriers to Implementation

NASA Astrophysics Data System (ADS)

Spahr, K.; Hogue, T. S.

2016-12-01

Selecting the most appropriate green, gray, and / or hybrid system for stormwater treatment and conveyance can prove challenging to decision markers across all scales, from site managers to large municipalities. To help streamline the selection process, a multi-disciplinary team of academics and professionals is developing an industry standard for selecting and evaluating the most appropriate stormwater management technology for different regions. To make the tool more robust and comprehensive, life-cycle cost assessment and optimization modules will be included to evaluate non-monetized and ecosystem benefits of selected technologies. Initial work includes surveying advisory board members based in cities that use existing decision support tools in their infrastructure planning process. These surveys will qualify the decisions currently being made and identify challenges within the current planning process across a range of hydroclimatic regions and city size. Analysis of social and other non-technical barriers to adoption of the existing tools is also being performed, with identification of regional differences and institutional challenges. Surveys will also gage the regional appropriateness of certain stormwater technologies based off experiences in implementing stormwater treatment and conveyance plans. In additional to compiling qualitative data on existing decision support tools, a technical review of components of the decision support tool used will be performed. Gaps in each tool's analysis, like the lack of certain critical functionalities, will be identified and ease of use will be evaluated. Conclusions drawn from both the qualitative and quantitative analyses will be used to inform the development of the new decision support tool and its eventual dissemination.

Implementation of a Multidisciplinary Guideline for Low Back Pain: Process-Evaluation Among Health Care Professionals.

PubMed

Suman, Arnela; Schaafsma, Frederieke G; Buchbinder, Rachelle; van Tulder, Maurits W; Anema, Johannes R

2017-09-01

Background To reduce the burden of low back pain (LBP) in the Netherlands, a multidisciplinary guideline for LBP has been implemented in Dutch primary care using a multifaceted implementation strategy targeted at health care professionals (HCPs) and patients. The current paper describes the process evaluation of the implementation among HCPs. Methods The strategy aimed to improve multidisciplinary collaboration and communication, and consisted of 7 components. This process evaluation was performed using the Linnan and Steckler framework. Data were collected using a mixed methods approach of quantitative and qualitative data. Results 128 HCPs participated in the implementation study, of which 96 participated in quantitative and 21 participated in qualitative evaluation. Overall dose delivered for this study was 89 %, and the participants were satisfied with the strategy, mostly with the multidisciplinary approach, which contributed to the mutual understanding of each other's disciplines and perspectives. While the training sessions did not yield any new information, the strategy created awareness of the guideline and its recommendations, contributing to positively changing attitudes and aiding in improving guideline adherent behaviour. However, many barriers to implementation still exist, including personal and practical factors, confidence, dependence and distrust issues among the HCPs, as well as policy factors (e.g. reimbursement systems). Conclusions The data presented in this paper have shown that the strategy that was used to implement the guideline in a Dutch primary care setting was feasible, especially when using a multidisciplinary approach. However, identified barriers for implementation have been identified and should be addressed in future implementation.

["So I have no way of measuring": a portrait of health education groups in the city of São Paulo, Brazil].

PubMed

Vincha, Kellem Regina Rosendo; Vieira, Viviane Laudelino; Guerra, Lúcia Dias da Silva; Botelho, Fernanda Cangussu; Pava-Cárdenas, Alexandra; Cervato-Mancuso, Ana Maria

2017-09-28

: The study analyzed the social representations of primary health care professionals on evaluative processes of groups that work with food and nutrition, and described the educational strategies used in this care. This was a qualitative study from 2012 to 2014 in the city of São Paulo, Brazil, in which 48 interviews were analyzed. In the analysis of the interviews, for classification of the educational strategies in learning categories and contents, Bogdan & Biklen and Zabala were used, respectively. The evaluative processes used the collective subject discourse technique, based on Jodelet's social representations. Three learning contents were found in the educational strategies and four social representations of the evaluative processes which combined to reveal the presence of a conflict by a practice directed by the work process to quantitative and individual evaluative criteria and a health-promoting practice that used inclusive approaches and participant evaluation. In this practice, the study implicitly identified the presence of autonomy in health. The study revealed the need to acknowledge and systematize group planning as an educational tool that qualifies and empowers comprehensive care.

Dynamical relations for left ventricular ejection - Flow rate, momentum, force and impulse

NASA Technical Reports Server (NTRS)

Back, L. H.; Selzer, R. H.; Gordon, D. G.; Ledbetter, D. C.; Crawford, D. W.

1984-01-01

An investigation was carried out to quantitatively evaluate left ventricular volume flow rate, momentum, force and impulse derived from application of conservation principles for mass and momentum of blood within the ventricle during the ejection phase. An automated digital image processing system was developed and applied to left ventricular angiograms which are computer processed and analyzed frame by frame to determine the dynamical relations by numerical methods. The initial experience with force and impulse has indicated that neither quantity seemed to be a sensitive indicator of coronary artery disease as evaluated by qualitative angiography for the particular patient group studied. Utilization of the dynamical relations in evaluating human left ventricular performance requires improved means of measurement and interpretation of clinical studies.

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren1–3

PubMed Central

Helitzer, Deborah L; Davis, Sally M; Gittelsohn, Joel; Going, Scott B; Murray, David M; Snyder, Patricia; Steckler, Allan B

2016-01-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used. PMID:10195608

Exploring how ward staff engage with the implementation of a patient safety intervention: a UK-based qualitative process evaluation

PubMed Central

Sheard, Laura; Marsh, Claire; O’Hara, Jane; Armitage, Gerry; Wright, John; Lawton, Rebecca

2017-01-01

Objectives A patient safety intervention was tested in a 33-ward randomised controlled trial. No statistically significant difference between intervention and control wards was found. We conducted a process evaluation of the trial and our aim in this paper is to understand staff engagement across the 17 intervention wards. Design Large qualitative process evaluation of the implementation of a patient safety intervention. Setting and participants National Health Service staff based on 17 acute hospital wards located at five hospital sites in the North of England. Data We concentrate on three sources here: (1) analysis of taped discussion between ward staff during action planning meetings; (2) facilitators’ field notes and (3) follow-up telephone interviews with staff focusing on whether action plans had been achieved. The analysis involved the use of pen portraits and adaptive theory. Findings First, there were palpable differences in the ways that the 17 ward teams engaged with the key components of the intervention. Five main engagement typologies were evident across the life course of the study: consistent, partial, increasing, decreasing and disengaged. Second, the intensity of support for the intervention at the level of the organisation does not predict the strength of engagement at the level of the individual ward team. Third, the standardisation of facilitative processes provided by the research team does not ensure that implementation standardisation of the intervention occurs by ward staff. Conclusions A dilution of the intervention occurred during the trial because wards engaged with Patient Reporting and Action for a Safe Environment (PRASE) in divergent ways, despite the standardisation of key components. Facilitative processes were not sufficiently adequate to enable intervention wards to successfully engage with PRASE components. PMID:28710206

Optimization of Vacuum Impregnation with Calcium Lactate of Minimally Processed Melon and Shelf-Life Study in Real Storage Conditions.

PubMed

Tappi, Silvia; Tylewicz, Urszula; Romani, Santina; Siroli, Lorenzo; Patrignani, Francesca; Dalla Rosa, Marco; Rocculi, Pietro

2016-10-05

Vacuum impregnation (VI) is a processing operation that permits the impregnation of fruit and vegetable porous tissues with a fast and more homogeneous penetration of active compounds compared to the classical diffusion processes. The objective of this research was to investigate the impact on VI treatment with the addition of calcium lactate on qualitative parameters of minimally processed melon during storage. For this aim, this work was divided in 2 parts. Initially, the optimization of process parameters was carried out in order to choose the optimal VI conditions for improving texture characteristics of minimally processed melon that were then used to impregnate melons for a shelf-life study in real storage conditions. On the basis of a 2 3 factorial design, the effect of Calcium lactate (CaLac) concentration between 0% and 5% and of minimum pressure (P) between 20 and 60 MPa were evaluated on color and texture. Processing parameters corresponding to 5% CaLac concentration and 60 MPa of minimum pressure were chosen for the storage study, during which the modifications of main qualitative parameters were evaluated. Despite of the high variability of the raw material, results showed that VI allowed a better maintenance of texture during storage. Nevertheless, other quality traits were negatively affected by the application of vacuum. Impregnated products showed a darker and more translucent appearance on the account of the alteration of the structural properties. Moreover microbial shelf-life was reduced to 4 d compared to the 7 obtained for control and dipped samples. © 2016 Institute of Food Technologists®.

Color postprocessing for 3-dimensional finite element mesh quality evaluation and evolving graphical workstation

NASA Technical Reports Server (NTRS)

Panthaki, Malcolm J.

1987-01-01

Three general tasks on general-purpose, interactive color graphics postprocessing for three-dimensional computational mechanics were accomplished. First, the existing program (POSTPRO3D) is ported to a high-resolution device. In the course of this transfer, numerous enhancements are implemented in the program. The performance of the hardware was evaluated from the point of view of engineering postprocessing, and the characteristics of future hardware were discussed. Second, interactive graphical tools implemented to facilitate qualitative mesh evaluation from a single analysis. The literature was surveyed and a bibliography compiled. Qualitative mesh sensors were examined, and the use of two-dimensional plots of unaveraged responses on the surface of three-dimensional continua was emphasized in an interactive color raster graphics environment. Finally, a postprocessing environment was designed for state-of-the-art workstation technology. Modularity, personalization of the environment, integration of the engineering design processes, and the development and use of high-level graphics tools are some of the features of the intended environment.

Health professionals in the process of vaccination against hepatitis B in two basic units of Belo Horizonte: a qualitative evaluation.

PubMed

Lages, Annelisa Santos; França, Elisabeth Barboza; Freitas, Maria Imaculada de Fátima

2013-06-01

According to the Vaccine Coverage Survey, performed in 2007, the immunization coverage against hepatitis B in Belo Horizonte, for infants under one year old, was below the level proposed by the Brazilian National Program of Immunization. This vaccine was used as basis for evaluating the involvement of health professionals in the process of vaccination in two Basic Health Units (UBS, acronym in Portuguese) in the city. This study is qualitative and uses the notions of Social Representations Theory and the method of Structural Analysis of Narrative to carry out the interviews and data analysis. The results show flaws related to controlling and use of the mirror card and the parent orientation, and also the monitoring of vaccination coverage (VC) and use of VC data as input for planning health actions. It was observed that the working process in the UBS is focused on routine tasks, with low creativity of the professionals, which includes representations that maintain strong tendency to value activities focused on the health of individuals to the detriment of public health actions. In conclusion, the vaccination process fault can be overcome with a greater appreciation of everyday actions and with a much better use of local information about vaccination, and some necessary adjustments within the UBS to improve public health actions.

Evaluating Education and Science at the KSC Visitor Complex

NASA Technical Reports Server (NTRS)

Erickson, Lance K.

2002-01-01

As part of a two-year NASA-ASEE project, a preliminary evaluation and subsequent recommendations were developed to improve the education and science content of the Kennedy Space Center Visitor Complex exhibits. Recommendations for improvements in those exhibits were based on qualitative descriptions of the exhibits, on comparisons to similar exhibit collections, and on available evaluation processes. Because of the subjective nature of measuring content in a broad group of exhibits and displays, emphasis is placed on employing a survey format for a follow-on, more quantitative evaluation. The use of an external organization for this evaluation development is also recommended to reduce bias and increase validity.

Evaluating Education and Science at the KSC Visitor Complex

NASA Technical Reports Server (NTRS)

Erickson, Lance K.

2001-01-01

As part of a two-year NASA-ASEE project, a preliminary evaluation and subsequent recommendations were developed to improve the education and science content of the Kennedy Space Center Visitor Complex exhibits. Recommendations for improvements in those exhibits were based on qualitative descriptions of the exhibits, on comparisons to similar exhibit collections, and on available evaluation processes. Because of the subjective nature of measuring content in a broad group of exhibits and displays, emphasis is placed on employing a survey format for a follow-on, more quantitative evaluation. The use of an external organization for this evaluation development is also recommended to reduce bias and increase validity.

Big fish in a big pond: a study of academic self concept in first year medical students.

PubMed

Jackman, Kirsty; Wilson, Ian G; Seaton, Marjorie; Craven, Rhonda G

2011-07-27

Big-fish-little-pond effect (BFLPE) research has demonstrated that students in high-ability environments have lower academic self-concepts than equally able students in low-ability settings. Research has shown low academic self-concepts to be associated with negative educational outcomes. Social comparison processes have been implicated as fundamental to the BFLPE. Twenty first-year students in an Australian medical school completed a survey that included academic self-concept and social comparison measures, before and after their first written assessments. Focus groups were also conducted with a separate group of students to explore students' perceptions of competence, the medical school environment, and social comparison processes. The quantitative study did not reveal any changes in academic self-concept or self-evaluation. The qualitative study suggested that the attributions that students used when discussing performance were those that have been demonstrated to negatively affect self-concept. Students reported that the environment was slightly competitive and they used social comparison to evaluate their performance. Although the BFLPE was not evident in the quantitative study, results from the qualitative study suggest that the BFLPE might be operating In that students were using attributions that are associated with lower self-concepts, the environment was slightly competitive, and social comparisons were used for evaluation.

Perspectives on the changing healthcare system: teaching systems-based practice to medical residents

PubMed Central

Martinez, Johanna; Phillips, Erica; Fein, Oliver

2013-01-01

Purpose The Accreditation Council for Graduate Medical Education restructured its accreditation system to be based on educational outcomes in six core competencies. Systems-based practice is one of the six core competencies. The purpose of this report is to describe Weill Cornell Medical College's Internal Medicine Residency program curriculum for systems-based practice (SBP) and its evaluation process. Methods To examine potential outcomes of the POCHS curriculum, an evaluation was conducted, examining participants': (1) knowledge gain; (2) course ratings; and (3) qualitative feedback. Results On average, there was a 19 percentage point increase in knowledge test scores for all three cohorts. The course was rated overall highly, receiving an average of 4.6 on a 1–5 scale. Lastly, the qualitative comments supported that the material is needed and valued. Conclusion The course, entitled Perspectives on the Changing Healthcare System (POCHS) and its evaluation process support that systems-based practice is crucial to residency education. The course is designed not only to educate residents about the current health care system but also to enable them to think critically about the risk and benefits of the changes. POCHS provides a framework for teaching and assessing this competency and can serve as a template for other residency programs looking to create or restructure their SBP curriculum. PMID:24001523

Development of retrospective quantitative and qualitative job-exposure matrices for exposures at a beryllium processing facility.

PubMed

Couch, James R; Petersen, Martin; Rice, Carol; Schubauer-Berigan, Mary K

2011-05-01

To construct a job-exposure matrix (JEM) for an Ohio beryllium processing facility between 1953 and 2006 and to evaluate temporal changes in airborne beryllium exposures. Quantitative area- and breathing-zone-based exposure measurements of airborne beryllium were made between 1953 and 2006 and used by plant personnel to estimate daily weighted average (DWA) exposure concentrations for sampled departments and operations. These DWA measurements were used to create a JEM with 18 exposure metrics, which was linked to the plant cohort consisting of 18,568 unique job, department and year combinations. The exposure metrics ranged from quantitative metrics (annual arithmetic/geometric average DWA exposures, maximum DWA and peak exposures) to descriptive qualitative metrics (chemical beryllium species and physical form) to qualitative assignment of exposure to other risk factors (yes/no). Twelve collapsed job titles with long-term consistent industrial hygiene samples were evaluated using regression analysis for time trends in DWA estimates. Annual arithmetic mean DWA estimates (overall plant-wide exposures including administration, non-production, and production estimates) for the data by decade ranged from a high of 1.39 μg/m(3) in the 1950s to a low of 0.33 μg/m(3) in the 2000s. Of the 12 jobs evaluated for temporal trend, the average arithmetic DWA mean was 2.46 μg/m(3) and the average geometric mean DWA was 1.53 μg/m(3). After the DWA calculations were log-transformed, 11 of the 12 had a statistically significant (p < 0.05) decrease in reported exposure over time. The constructed JEM successfully differentiated beryllium exposures across jobs and over time. This is the only quantitative JEM containing exposure estimates (average and peak) for the entire plant history.

The design of a real-time formative evaluation of the implementation process of lifestyle interventions at two worksites using a 7-step strategy (BRAVO@Work).

PubMed

Wierenga, Debbie; Engbers, Luuk H; van Empelen, Pepijn; Hildebrandt, Vincent H; van Mechelen, Willem

2012-08-07

Worksite health promotion programs (WHPPs) offer an attractive opportunity to improve the lifestyle of employees. Nevertheless, broad scale and successful implementation of WHPPs in daily practice often fails. In the present study, called BRAVO@Work, a 7-step implementation strategy was used to develop, implement and embed a WHPP in two different worksites with a focus on multiple lifestyle interventions.This article describes the design and framework for the formative evaluation of this 7-step strategy under real-time conditions by an embedded scientist with the purpose to gain insight into whether this this 7-step strategy is a useful and effective implementation strategy. Furthermore, we aim to gain insight into factors that either facilitate or hamper the implementation process, the quality of the implemented lifestyle interventions and the degree of adoption, implementation and continuation of these interventions. This study is a formative evaluation within two different worksites with an embedded scientist on site to continuously monitor the implementation process. Each worksite (i.e. a University of Applied Sciences and an Academic Hospital) will assign a participating faculty or a department, to implement a WHPP focusing on lifestyle interventions using the 7-step strategy. The primary focus will be to describe the natural course of development, implementation and maintenance of a WHPP by studying [a] the use and adherence to the 7-step strategy, [b] barriers and facilitators that influence the natural course of adoption, implementation and maintenance, and [c] the implementation process of the lifestyle interventions. All data will be collected using qualitative (i.e. real-time monitoring and semi-structured interviews) and quantitative methods (i.e. process evaluation questionnaires) applying data triangulation. Except for the real-time monitoring, the data collection will take place at baseline and after 6, 12 and 18 months. This is one of the few studies to extensively and continuously monitor the natural course of the implementation process of a WHPP by a formative evaluation using a mix of quantitative and qualitative methods on different organizational levels (i.e. management, project group, employees) with an embedded scientist on site. NTR2861.

Partnerships for Active Children in Elementary Schools (PACES): First year process evaluation.

PubMed

Egan, Cate A; Webster, Collin; Weaver, R Glenn; Brian, Ali; Stodden, David; Russ, Laura; Nesbitt, Danielle; Vazou, Spyridoula

2018-04-01

Movement integration (MI) is a strategy within comprehensive school physical activity programs (CSPAP). School-university partnerships are recommended to leverage teachers' capacity to use MI. A mixed method process evaluation was conducted of the first year of implementing Partnerships for Active Children in Elementary Schools (PACES). Classroom teachers (N=12) from four schools participated. Data were collected in Fall 2014 (baseline) and Spring 2015 (∼ four months of intervention) using the System for Observing Student Movement in Academic Routines and Transitions and semi-structured interviews. There were no significant differences between intervention classrooms and control classrooms MI promotion. Differences approaching significance (U=5, p=0.04, d=1.2) were observed when comparing classrooms that received two (community of practice, community-based participatory research) or three components (two components plus service learning) of the intervention and classrooms that received one (community of practice) or no components. Qualitative findings revealed that teachers in classrooms that were more successful responded more favorably to the intervention components than teachers in classrooms that were less successful. Quantitative and qualitative results supported the effectiveness of community-based participatory research as a component of PACES. This study provides information about MI process variables in the context of a CSPAP intervention. Copyright © 2017 Elsevier Ltd. All rights reserved.

A person-centered integrated care quality framework, based on a qualitative study of patients' evaluation of care in light of chronic care ideals.

PubMed

Berntsen, Gro; Høyem, Audhild; Lettrem, Idar; Ruland, Cornelia; Rumpsfeld, Markus; Gammon, Deede

2018-06-20

Person-Centered Integrated Care (PC-IC) is believed to improve outcomes and experience for persons with multiple long-term and complex conditions. No broad consensus exists regarding how to capture the patient-experienced quality of PC-IC. Most PC-IC evaluation tools focus on care events or care in general. Building on others' and our previous work, we outlined a 4-stage goal-oriented PC-IC process ideal: 1) Personalized goal setting 2) Care planning aligned with goals 3) Care delivery according to plan, and 4) Evaluation of goal attainment. We aimed to explore, apply, refine and operationalize this quality of care framework. This paper is a qualitative evaluative review of the individual Patient Pathways (iPP) experiences of 19 strategically chosen persons with multimorbidity in light of ideals for chronic care. The iPP includes all care events, addressing the persons collected health issues, organized by time. We constructed iPPs based on the electronic health record (from general practice, nursing services, and hospital) with patient follow-up interviews. The application of the framework and its refinement were parallel processes. Both were based on analysis of salient themes in the empirical material in light of the PC-IC process ideal and progressively more informed applications of themes and questions. The informants consistently reviewed care quality by how care supported/ threatened their long-term goals. Personal goals were either implicit or identified by "What matters to you?" Informants expected care to address their long-term goals and placed responsibility for care quality and delivery at the system level. The PC-IC process framework exposed system failure in identifying long-term goals, provision of shared long-term multimorbidity care plans, monitoring of care delivery and goal evaluation. The PC-IC framework includes descriptions of ideal care, key questions and literature references for each stage of the PC-IC process. This first version of a PC-IC process framework needs further validation in other settings. Gaps in care that are invisible with event-based quality of care frameworks become apparent when evaluated by a long-term goal-driven PC-IC process framework. The framework appears meaningful to persons with multimorbidity.

School Psychology as a Relational Enterprise: The Role and Process of Qualitative Methodology

ERIC Educational Resources Information Center

Newman, Daniel S.; Clare, Mary M.

2016-01-01

The purpose of this article is to explore the application of qualitative research to establishing a more complete understanding of relational processes inherent in school psychology practice. We identify the building blocks of rigorous qualitative research design through a conceptual overview of qualitative paradigms, methodologies, methods (i.e.,…

Nursing students evaluation of problem based learning and the impact of culture on the learning process and outcomes: a pilot project.

PubMed

Al-Kloub, Manal Ibrahim; Salameh, Taghreed Nayel; Froelicher, Erika Sivarajan

2014-03-01

This study evaluates students' learning experiences in a clinical pediatric nursing course adopting Problem Based Learning (PBL) and investigates how students' cultural background impacts on self directed learning. A mixed-methods approach combining quantitative and qualitative methods was utilized to answer the research objectives. An observational technique for the PBL teaching sessions was employed; and 226 third-year students were asked to complete PBL evaluation questionnaire. Fifty seven percent (n = 130) responses to the questionnaire were analyzed. Overall, students considered PBL to be moderately effective in their learning experience, with a mean of 3.64 (S.D = 1.18). Students qualitative responses fell within four thematic categories including: developing cognitive abilities, independent learning, motivation to learn, and group learning. Difficulties encountered by students were: it is time-consuming, it has unclear objectives, it is a stressful process, and it results in an increased workload. A small number of students indicated that PBL tutorials were boring and complained about lack of contribution from instructors and limited recourses. Learning is intertwined with culture; students' previous educational experiences, uncertainty, English language proficiency, computer resources, gender, and achievement were identified as the most important cultural issues that impact the learning process and outcomes. Successful implementation of PBL does not come easily; teachers should be alert to the issues of culture in designing curriculum. Copyright © 2013 Elsevier Ltd. All rights reserved.

Resolving complex research data management issues in biomedical laboratories: Qualitative study of an industry-academia collaboration.

PubMed

Myneni, Sahiti; Patel, Vimla L; Bova, G Steven; Wang, Jian; Ackerman, Christopher F; Berlinicke, Cynthia A; Chen, Steve H; Lindvall, Mikael; Zack, Donald J

2016-04-01

This paper describes a distributed collaborative effort between industry and academia to systematize data management in an academic biomedical laboratory. Heterogeneous and voluminous nature of research data created in biomedical laboratories make information management difficult and research unproductive. One such collaborative effort was evaluated over a period of four years using data collection methods including ethnographic observations, semi-structured interviews, web-based surveys, progress reports, conference call summaries, and face-to-face group discussions. Data were analyzed using qualitative methods of data analysis to (1) characterize specific problems faced by biomedical researchers with traditional information management practices, (2) identify intervention areas to introduce a new research information management system called Labmatrix, and finally to (3) evaluate and delineate important general collaboration (intervention) characteristics that can optimize outcomes of an implementation process in biomedical laboratories. Results emphasize the importance of end user perseverance, human-centric interoperability evaluation, and demonstration of return on investment of effort and time of laboratory members and industry personnel for success of implementation process. In addition, there is an intrinsic learning component associated with the implementation process of an information management system. Technology transfer experience in a complex environment such as the biomedical laboratory can be eased with use of information systems that support human and cognitive interoperability. Such informatics features can also contribute to successful collaboration and hopefully to scientific productivity. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Development of a Patient-Reported Outcome Instrument to Evaluate Symptoms of Advanced NSCLC: Qualitative Research and Content Validity of the Non-Small Cell Lung Cancer Symptom Assessment Questionnaire (NSCLC-SAQ)

PubMed Central

Atkinson, Thomas M.; DeBusk, Kendra P.A.; Liepa, Astra M.; Scanlon, Michael; Coons, Stephen Joel

2016-01-01

PURPOSE To describe the process and results of the preliminary qualitative development of a new symptom-based PRO measure intended to assess treatment benefit in advanced non-small cell lung cancer (NSCLC) clinical trials. METHODS Individual qualitative interviews were conducted with adult NSCLC (Stage I–IV) patients in the US. Experienced interviewers conducted concept elicitation (CE) and cognitive interviews using semi-structured interview guides. The CE interview guide was used to elicit spontaneous reports of symptom experiences along with probing to further explore and confirm concepts. Interview transcripts were coded and analyzed by professional qualitative coders using Atlas.ti software, and were summarized by like-content using an iterative coding framework. Data from the CE interviews were considered alongside existing literature and clinical expert opinion during an item-generation process, leading to development of a preliminary version of the NSCLC Symptom Assessment Questionnaire (NSCLC-SAQ). Three waves of cognitive interviews were conducted to evaluate concept relevance, item interpretability, and structure of the draft items to facilitate further instrument refinement. FINDINGS Fifty-one patients (mean age 64.9 [SD=11.2]; 51.0% female) participated in the CE interviews. A total of 1,897 expressions of NSCLC-related symptoms were identified and coded in interview transcripts, representing approximately 42 distinct symptom concepts. A 9-item initial draft instrument was developed for testing in three waves of cognitive interviews with additional NSCLC patients (n=20), during which both paper and electronic versions of the instrument were evaluated and refined. Participant responses and feedback during cognitive interviews led to the removal of 2 items and substantial modifications to others. IMPLICATIONS The NSCLC-SAQ is a 7-item PRO measure intended for use in advanced NSCLC clinical trials to support medical product labelling. The NSCLC-SAQ uses a 7-day recall period and verbal rating scales. It was developed in accordance with the FDA’s PRO Guidance and scientific best practices, and the resulting qualitative interview data provide evidence of content validity. The NSCLC-SAQ has been prepared in both paper and electronic administration formats and a tablet computer-based version is currently undergoing quantitative testing to confirm its measurement properties and support FDA qualification. PMID:27041408

Schooling and Socioeconomic Attainments: High School and College Influences. Report No. 248.

ERIC Educational Resources Information Center

Griffin, Larry J.; Alexander, Karl L.

The socioeconomic consequences of qualitative variations in educational experiences are evaluated for a sample of young adult males (N=525) who were first surveyed in 1955 as high school sophomores and followed up in 1970. Models of institutional influence and of within-school processes are developed for both secondary and post-secondary education…

Development Plans in Turkey and a Managerial Analysis on Education (1963-2013 Years)

ERIC Educational Resources Information Center

Çakir, Rahman

2015-01-01

The purpose of this study is that to evaluate nine educational management plans between the years 1963-2013 and one plan in the process of implementation educational management. Document analysis technique from the qualitative research methods was used in this research. Data was analyzed as three stages: description, analysis and interpretation.…

Elementary Principal Decision-Making Process during Crisis Situations in One Northern New Jersey District

ERIC Educational Resources Information Center

Torley, Marilyn

2011-01-01

The purpose of this qualitative study was to investigate how school administrators respond during a crisis. Relevant research pertaining to crisis decision-making will be presented, focusing on the three steps of crisis decision theory (a) assessing the severity of the negative event (b) determining response options, and (c) evaluating response…

A Qualitative Case Study of Strategies for Choosing and Evaluating Alternative Assessments in Online Higher Education

ERIC Educational Resources Information Center

Streff, Robert James

2016-01-01

Studies have shown that not all students are assessed effectively using standard testing formats. However, it is unclear what alternative methodology would be useful to determine whether students have acquired the skills necessary for today's global market. This research study's purpose was to understand the processes instructors use when choosing…

Protocol for a process-oriented qualitative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme using the Researcher-in-Residence model

PubMed Central

Eyre, Laura; George, Bethan; Marshall, Martin

2015-01-01

Introduction The integration of health and social care in England is widely accepted as the answer to fragmentation, financial concerns and system inefficiencies, in the context of growing and ageing populations with increasingly complex needs. Despite an expanding body of literature, there is little evidence yet to suggest that integrated care can achieve the benefits that its advocates claim for it. Researchers have often adopted rationalist and technocratic approaches to evaluation, treating integration as an intervention rather than a process. Results have usually been of limited use to practitioners responsible for health and social care integration. There is, therefore, a need to broaden the evidence base, exploring not only what works but also how integrated care can most successfully be implemented and delivered. For this reason, we are carrying out a formative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme. Our expectation is that this will add value to the literature by focusing on the processes by which the vision and objectives of integrated care are translated through phases of development, implementation and delivery from a central to a local perspective, and from a strategic to an operational perspective. Methods and analysis The qualitative and process-oriented evaluation uses an innovative participative approach—the Researcher-in-Residence model. The evaluation is underpinned by a critical ontology, an interpretive epistemology and a critical discourse analysis methodology. Data will be generated using interviews, observations and documentary gathering. Ethics and dissemination Emerging findings will be interpreted and disseminated collaboratively with stakeholders, to enable the research to influence and optimise the effective implementation of integrated care across WELC. Presentations and publications will ensure that learning is shared as widely as possible. The study has received ethical approval from University College London's Research Ethics Committee and has all appropriate NHS governance clearances. PMID:26546147

Standards for reporting qualitative research: a synthesis of recommendations.

PubMed

O'Brien, Bridget C; Harris, Ilene B; Beckman, Thomas J; Reed, Darcy A; Cook, David A

2014-09-01

Standards for reporting exist for many types of quantitative research, but currently none exist for the broad spectrum of qualitative research. The purpose of the present study was to formulate and define standards for reporting qualitative research while preserving the requisite flexibility to accommodate various paradigms, approaches, and methods. The authors identified guidelines, reporting standards, and critical appraisal criteria for qualitative research by searching PubMed, Web of Science, and Google through July 2013; reviewing the reference lists of retrieved sources; and contacting experts. Specifically, two authors reviewed a sample of sources to generate an initial set of items that were potentially important in reporting qualitative research. Through an iterative process of reviewing sources, modifying the set of items, and coding all sources for items, the authors prepared a near-final list of items and descriptions and sent this list to five external reviewers for feedback. The final items and descriptions included in the reporting standards reflect this feedback. The Standards for Reporting Qualitative Research (SRQR) consists of 21 items. The authors define and explain key elements of each item and provide examples from recently published articles to illustrate ways in which the standards can be met. The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear standards for reporting qualitative research. These standards will assist authors during manuscript preparation, editors and reviewers in evaluating a manuscript for potential publication, and readers when critically appraising, applying, and synthesizing study findings.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

Quality nursing care: a qualitative enquiry.

PubMed

Hogston, R

1995-01-01

In spite of the wealth of literature on quality nursing care, a disparity exists in defining quality. The purpose of this study was an attempt to seek out practising nurses' perceptions of quality nursing care and to present a definition of quality as described by nurses. Eighteen nurses from a large hospital in the south of England were interviewed. Qualitative analysis based on a modified grounded theory approach revealed three categories described as 'structure', 'process' and 'outcome'. This supports previous work on evaluating quality care but postulates that structure, process and outcome could also be used as a mechanism for defining quality. The categories are defined by using the words of the informants in order to explain the essential attributes of quality nursing care. The findings demonstrate how more informants cited quality in terms of process and outcome than structure. It is speculated that the significance of this rests with the fact that nurses have direct control over process and outcome whereas the political and economic climate in which nurses work is beyond their control and decisions over structure lie with their managers.

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

PubMed

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development. To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care. Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients' experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor's knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. 'Resistance' emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines. The synthesis of studies of lay experiences of living with rheumatoid arthritis began with 29 papers. Four could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with rheumatoid arthritis. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory. In both topic areas, only a minority of the studies included in the syntheses were found to have referenced each other, suggesting that unnecessary replication had occurred. We only evaluated meta-ethnography as a method for synthesising qualitative research, but there are other methods being employed. Further research is required to investigate how different methods of qualitative synthesis influence the outcome of the synthesis. Meta-ethnography is an effective method for synthesising qualitative research. The process of reciprocally translating the findings from each individual study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a 'line of argument' that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, but not all meta-ethnographic syntheses do so. Instead, some will identify fields in which saturation has been reached and in which no theoretical development has taken place for some time. Both outcomes are helpful in either moving research forward or avoiding wasted resources. Meta-ethnography is a highly interpretative method requiring considerable immersion in the individual studies to achieve a synthesis. It places substantial demands upon the synthesiser and requires a high degree of qualitative research skill. Meta-ethnography has great potential as a method of synthesis in qualitative health technology assessment but it is still evolving and cannot, at present, be regarded as a standardised approach capable of application in a routinised way. Funding for this study was provided by the Health Technology Assessment programme of the National Institute for Health Research.

PRISM: Priority Symptom Management Project phase I: assessment.

PubMed

Ropka, M E; Spencer-Cisek, P

2001-01-01

To provide an overview of the process, goals, and outcome recommendations from the assessment phase of the Oncology Nursing Society's Priority Symptom Management (PRISM) project and to provide the foundation for a series of evidence-based practice and qualitative systematic review articles generated from the first phase of PRISM. Published articles, abstracts, and books; computerized databases; nonpublished research; personal communications; and proceedings of the PRISM summit meeting. Symptom management is a key component in quality cancer care. The assessment phase of PRISM yielded systematic reviews with an evidence-based framework to evaluate key symptoms, developed a framework for teaching and evaluating other symptoms, and recommended future ONS initiatives. Outcome recommendations from the PRISM summit targeted practice; professional and public education; research; and health policy. These activities provide background for subsequent evidence-based practice and qualitative systematic review articles that will focus on cancer symptom management.

The girlpower project--recreation, BC health goals and social capital.

PubMed

Higgins, J W; Reed, N

2001-01-01

'GirlPower,' a participatory action research project, explored how participation in recreation might contribute to the achievement of BC's Health Goals and nurture social capital. After identifying their health issues, up to 43 young women participated in recreational activities for 10 months, gradually taking responsibility for the planning of the weekly sessions. Data collection methods included weekly participation rates, two surveys to measure self-perceptions and health habits, focus groups with participants to assess needs and as a process evaluation tool, a qualitative summative evaluation with participants, key informant interviews with staff, a journal kept by the project leader and fieldnotes of researchers' observations. Quantitative findings did not support the propositions that the project contributed to the health of participants. However, analysis of the qualitative data suggests that GirlPower participants emerged from the project with a better sense of control over their lives and feeling more connected to their community.

Investigating the role of Fuzzy as confirmatory tool for service quality assessment (Case study: Comparison of Fuzzy SERVQUAL and SERVQUAL in hotel service evaluation)

NASA Astrophysics Data System (ADS)

Wahyudi, R. D.

2017-11-01

The problem was because of some indicators qualitatively assessed had been discussed in engineering field. Whereas, qualitative assessment was presently used in certain occasion including in engineering field, for instance, the assessment of service satisfaction. Probably, understanding of satisfaction definition caused bias if customers had their own definition of satisfactory level of service. Therefore, the use of fuzzy logic in SERVQUAL as service satisfaction measurement tool would probably be useful. This paper aimed to investigate the role of fuzzy in SERVQUAL by comparing result measurement of SERVQUAL and fuzzy SERVQUAL for study case of hotel service evaluation. Based on data processing, initial result showed that there was no significant different between them. Thus, either implementation of fuzzy SERVQUAL in different case or study about the role of fuzzy logic in SERVQUAL would be interesting further discussed topic.

Advanced image fusion algorithms for Gamma Knife treatment planning. Evaluation and proposal for clinical use.

PubMed

Apostolou, N; Papazoglou, Th; Koutsouris, D

2006-01-01

Image fusion is a process of combining information from multiple sensors. It is a useful tool implemented in the treatment planning programme of Gamma Knife Radiosurgery. In this paper we evaluate advanced image fusion algorithms for Matlab platform and head images. We develop nine level grayscale image fusion methods: average, principal component analysis (PCA), discrete wavelet transform (DWT) and Laplacian, filter - subtract - decimate (FSD), contrast, gradient, morphological pyramid and a shift invariant discrete wavelet transform (SIDWT) method in Matlab platform. We test these methods qualitatively and quantitatively. The quantitative criteria we use are the Root Mean Square Error (RMSE), the Mutual Information (MI), the Standard Deviation (STD), the Entropy (H), the Difference Entropy (DH) and the Cross Entropy (CEN). The qualitative are: natural appearance, brilliance contrast, presence of complementary features and enhancement of common features. Finally we make clinically useful suggestions.

Issues and Research in Special Education. Volume 2.

ERIC Educational Resources Information Center

Gaylord-Ross, Robert, Ed.

This compilation presents five papers on issues and research in special education. "Qualitative Research in Special Education: An Evaluative Review" (Charles A. Peck and Gail C. Furman) explicates some of the epistemological assumptions underlying qualitative research methods, reviews examples of qualitative research, evaluates the contributions…

Assessing locomotor skills development in childhood using wearable inertial sensor devices: the running paradigm.

PubMed

Masci, Ilaria; Vannozzi, Giuseppe; Bergamini, Elena; Pesce, Caterina; Getchell, Nancy; Cappozzo, Aurelio

2013-04-01

Objective quantitative evaluation of motor skill development is of increasing importance to carefully drive physical exercise programs in childhood. Running is a fundamental motor skill humans adopt to accomplish locomotion, which is linked to physical activity levels, although the assessment is traditionally carried out using qualitative evaluation tests. The present study aimed at investigating the feasibility of using inertial sensors to quantify developmental differences in the running pattern of young children. Qualitative and quantitative assessment tools were adopted to identify a skill-sensitive set of biomechanical parameters for running and to further our understanding of the factors that determine progression to skilled running performance. Running performances of 54 children between the ages of 2 and 12 years were submitted to both qualitative and quantitative analysis, the former using sequences of developmental level, the latter estimating temporal and kinematic parameters from inertial sensor measurements. Discriminant analysis with running developmental level as dependent variable allowed to identify a set of temporal and kinematic parameters, within those obtained with the sensor, that best classified children into the qualitative developmental levels (accuracy higher than 67%). Multivariate analysis of variance with the quantitative parameters as dependent variables allowed to identify whether and which specific parameters or parameter subsets were differentially sensitive to specific transitions between contiguous developmental levels. The findings showed that different sets of temporal and kinematic parameters are able to tap all steps of the transitional process in running skill described through qualitative observation and can be prospectively used for applied diagnostic and sport training purposes. Copyright © 2012 Elsevier B.V. All rights reserved.

An evaluation of the process and initial impact of disseminating a nursing e-thesis.

PubMed

Macduff, Colin

2009-05-01

This paper is a report of a study conducted to evaluate product, process and outcome aspects of the dissemination of a nursing PhD thesis via an open-access electronic institutional repository. Despite the growth of university institutional repositories which make theses easily accessible via the world wide web, nursing has been very slow to evaluate related processes and outcomes. Drawing on Stake's evaluation research methods, a case study design was adopted. The case is described using a four-phase structure within which key aspects of process and impact are reflexively analysed. In the conceptualization/re-conceptualization phase, fundamental questions about the purpose, format and imagined readership for a published nursing PhD were considered. In the preparation phase, seven key practical processes were identified that are likely to be relevant to most e-theses. In the dissemination phase email invitations were primarily used to invite engagement. The evaluation phase involved quantitative indicators of initial impact, such as page viewing and download statistics and qualitative feedback on processes and product. Analysis of process and impact elements of e-thesis dissemination is likely to have more than intrinsic value. The advent of e-theses housed in web-based institutional repositories has the potential to transform thesis access and use. It also offers potential to transform the nature and scope of thesis production and dissemination. Nursing scholars can exploit and evaluate such opportunities.

Qualitative evaluation of the implementation of the Interdisciplinary Management Tool: a reflective tool to enhance interdisciplinary teamwork using Structured, Facilitated Action Research for Implementation.

PubMed

Nancarrow, Susan A; Smith, Tony; Ariss, Steven; Enderby, Pamela M

2015-07-01

Reflective practice is used increasingly to enhance team functioning and service effectiveness; however, there is little evidence of its use in interdisciplinary teams. This paper presents the qualitative evaluation of the Interdisciplinary Management Tool (IMT), an evidence-based change tool designed to enhance interdisciplinary teamwork through structured team reflection. The IMT incorporates three components: an evidence-based resource guide; a reflective implementation framework based on Structured, Facilitated Action Research for Implementation methodology; and formative and summative evaluation components. The IMT was implemented with intermediate care teams supported by independent facilitators in England. Each intervention lasted 6 months and was evaluated over a 12-month period. Data sources include interviews, a focus group with facilitators, questionnaires completed by team members and documentary feedback from structured team reports. Data were analysed qualitatively using the Framework approach. The IMT was implemented with 10 teams, including 253 staff from more than 10 different disciplines. Team challenges included lack of clear vision; communication issues; limited career progression opportunities; inefficient resource use; need for role clarity and service development. The IMT successfully engaged staff in the change process, and resulted in teams developing creative strategies to address the issues identified. Participants valued dedicated time to focus on the processes of team functioning; however, some were uncomfortable with a focus on teamwork at the expense of delivering direct patient care. The IMT is a relatively low-cost, structured, reflective way to enhance team function. It empowers individuals to understand and value their own, and others' roles and responsibilities within the team; identify barriers to effective teamwork, and develop and implement appropriate solutions to these. To be successful, teams need protected time to take for reflection, and executive support to be able to broker changes that are beyond the scope of the team. © 2014 John Wiley & Sons Ltd.

Commentary: Writing and Evaluating Qualitative Research Reports

PubMed Central

Thompson, Deborah; Aroian, Karen J.; McQuaid, Elizabeth L.; Deatrick, Janet A.

2016-01-01

Objective To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. Methods A question and answer format is used to address considerations for writing and evaluating qualitative research. Results and Conclusions When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field’s ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. PMID:27118271

Reflexive photography: an alternative method for documenting the learning process of cultural competence.

PubMed

Amerson, Roxanne; Livingston, Wade G

2014-04-01

This qualitative descriptive study used reflexive photography to evaluate the learning process of cultural competence during an international service-learning project in Guatemala. Reflexive photography is an innovative qualitative research technique that examines participants' interactions with their environment through their personal reflections on images that they captured during their experience. A purposive sample of 10 baccalaureate nursing students traveled to Guatemala, where they conducted family and community assessments, engaged in home visits, and provided health education. Data collection involved over 100 photographs and a personal interview with each student. The themes developed from the photographs and interviews provided insight into the activities of an international experience that influence the cognitive, practical, and affective learning of cultural competence. Making home visits and teaching others from a different culture increased students' transcultural self-efficacy. Reflexive photography is a more robust method of self-reflection, especially for visual learners.

Usability Evaluation of an Unstructured Clinical Document Query Tool for Researchers.

PubMed

Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B

2018-01-01

Natural Language Processing - Patient Information Extraction for Researchers (NLP-PIER) was developed for clinical researchers for self-service Natural Language Processing (NLP) queries with clinical notes. This study was to conduct a user-centered analysis with clinical researchers to gain insight into NLP-PIER's usability and to gain an understanding of the needs of clinical researchers when using an application for searching clinical notes. Clinical researcher participants (n=11) completed tasks using the system's two existing search interfaces and completed a set of surveys and an exit interview. Quantitative data including time on task, task completion rate, and survey responses were collected. Interviews were analyzed qualitatively. Survey scores, time on task and task completion proportions varied widely. Qualitative analysis indicated that participants found the system to be useful and usable in specific projects. This study identified several usability challenges and our findings will guide the improvement of NLP-PIER 's interfaces.

Evaluation of an interview process for admission into a school of pharmacy.

PubMed

Kelsch, Michael P; Friesner, Daniel L

2012-03-12

To evaluate the doctor of pharmacy (PharmD) admissions interview process at North Dakota State University (NDSU). Faculty pairs interviewed candidates using a standardized grading rubric to evaluate qualitative parameters or attributes such as ethics, relevant life and work experience, emotional maturity, commitment to patient care, leadership, and understanding of the pharmacy profession. Total interview scores, individual attribute domain scores, and the consistency and reliability of the interviewers were assessed. The total mean interview score for the candidate pool was 17.4 of 25 points. Mean scores for individual domains ranged from 2.3 to 3.0 on a Likert-scale of 0-4. Nine of the 11 faculty pairs showed no mean differences from their interview partner in total interview scores given. Evaluations by 8 of the 11 faculty pairs produced high interrater reliability. The current interview process is generally consistent and reliable; however, future improvements such as additional interviewer training and adoption of a multiple mini-interview format could be made.

Evaluation of an Interview Process for Admission Into a School of Pharmacy

PubMed Central

Friesner, Daniel L.

2012-01-01

Objective. To evaluate the doctor of pharmacy (PharmD) admissions interview process at North Dakota State University (NDSU). Methods. Faculty pairs interviewed candidates using a standardized grading rubric to evaluate qualitative parameters or attributes such as ethics, relevant life and work experience, emotional maturity, commitment to patient care, leadership, and understanding of the pharmacy profession. Total interview scores, individual attribute domain scores, and the consistency and reliability of the interviewers were assessed. Results. The total mean interview score for the candidate pool was 17.4 of 25 points. Mean scores for individual domains ranged from 2.3 to 3.0 on a Likert-scale of 0-4. Nine of the 11 faculty pairs showed no mean differences from their interview partner in total interview scores given. Evaluations by 8 of the 11 faculty pairs produced high interrater reliability. Conclusions. The current interview process is generally consistent and reliable; however, future improvements such as additional interviewer training and adoption of a multiple mini-interview format could be made. PMID:22438594

How do the EMA and FDA decide which anticancer drugs make it to the market? A comparative qualitative study on decision makers' views.

PubMed

Tafuri, G; Stolk, P; Trotta, F; Putzeist, M; Leufkens, H G; Laing, R O; De Allegri, M

2014-01-01

The process leading to a regulatory outcome is guided by factors both related and unrelated to the data package, defined in this analysis as 'formal and informal factors', respectively. The aim of this qualitative study was to analyse which formal and informal factors drive the decision-making process of the European Medicines Agency (EMA) and Food and Drug Administration (FDA) regulators with regard to anticancer drugs, using in-depth semi-structured interviews with regulators of the two agencies. In line with the theory and practice of qualitative research, no set sample size was defined a priori. Respondent enrolment continued until saturation and redundancy were reached. Data were collected through means of in-depth semi-structured interviews conducted either in a face-to-face setting or via Skype(®) with each regulator. The interviews were audio-recorded and verbatim transcribed. The analysis was manually carried out on the transcribed text. Data were independently coded and categorized by two researchers. Interpretation of the findings emerged through a process of triangulation between the two. Seven EMA and six FDA regulators, who had extensive experience with making decisions about anticancer medicines, were interviewed between April and June 2012. There is an open dialogue between the FDA and EMA, with the two moving closer and exchanging information, not opinions. Differences in decision-making between the agencies may be due to a different evaluation of end points. Different interaction modalities with industry and patients represent an additional source of divergence with a potential impact on decision-making. The key message of our respondents was that the agencies manage uncertainty in a different way: unlike the EMA, the FDA has a prevailing attitude to take risks in order to guarantee quicker access to new treatments. Although formal factors are the main drivers for regulatory decisions, the influence of informal factors plays an important role in the drug evaluation process.

Cooking, healthy eating, fitness and fun (CHEFFs): qualitative evaluation of a nutrition education program for children living at urban family homeless shelters.

PubMed

Rodriguez, Jacqueline; Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-12-01

We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants' understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children's knowledge and understanding of content, (2) children's shift in attitudes or intentions, and (3) interpretations through children's life experience. Food insecurity as well as shelter food service and policies were important influences on children's choices, hunger, and sense of well-being. Children's experiences highlighted the need to advocate for shelter policies that adequately provide for children's nutritional and physical activity requirements and foster academic development.

The meaning of city noises: Investigating sound quality in Paris (France)

NASA Astrophysics Data System (ADS)

Dubois, Daniele; Guastavino, Catherine; Maffiolo, Valerie; Guastavino, Catherine; Maffiolo, Valerie

2004-05-01

The sound quality of Paris (France) was investigated by using field inquiries in actual environments (open questionnaires) and using recordings under laboratory conditions (free-sorting tasks). Cognitive categories of soundscapes were inferred by means of psycholinguistic analyses of verbal data and of mathematical analyses of similarity judgments. Results show that auditory judgments mainly rely on source identification. The appraisal of urban noise therefore depends on the qualitative evaluation of noise sources. The salience of human sounds in public spaces has been demonstrated, in relation to pleasantness judgments: soundscapes with human presence tend to be perceived as more pleasant than soundscapes consisting solely of mechanical sounds. Furthermore, human sounds are qualitatively processed as indicators of human outdoor activities, such as open markets, pedestrian areas, and sidewalk cafe districts that reflect city life. In contrast, mechanical noises (mainly traffic noise) are commonly described in terms of physical properties (temporal structure, intensity) of a permanent background noise that also characterizes urban areas. This connotes considering both quantitative and qualitative descriptions to account for the diversity of cognitive interpretations of urban soundscapes, since subjective evaluations depend both on the meaning attributed to noise sources and on inherent properties of the acoustic signal.

'Healthy Eating and Lifestyle in Pregnancy (HELP)' trial: Process evaluation framework.

PubMed

Simpson, Sharon A; Cassidy, Dunla; John, Elinor

2014-07-01

We developed and tested in a cluster RCT a theory-driven group-based intervention for obese pregnant women. It was designed to support women to moderate weight gain during pregnancy and reduce BMI one year after birth, in addition to targeting secondary health and wellbeing outcomes. In line with MRC guidance on developing and evaluating complex interventions in health, we conducted a process evaluation alongside the trial. This paper describes the development of the process evaluation framework. This cluster RCT recruited 598 pregnant women. Women in the intervention group were invited to attend a weekly weight-management group. Following a review of relevant literature, we developed a process evaluation framework which outlined key process indicators that we wanted to address and how we would measure these. Central to the process evaluation was to understand the mechanism of effect of the intervention. We utilised a logic-modelling approach to describe the intervention which helped us focus on what potential mediators of intervention effect to measure, and how. The resulting process evaluation framework was designed to address 9 core elements; context, reach, exposure, recruitment, fidelity, recruitment, retention, contamination and theory-testing. These were assessed using a variety of qualitative and quantitative approaches. The logic model explained the processes by which intervention components bring about change in target outcomes through various mediators and theoretical pathways including self-efficacy, social support, self-regulation and motivation. Process evaluation is a key element in assessing the effect of any RCT. We developed a process evaluation framework and logic model, and the results of analyses using these will offer insights into why the intervention is or is not effective. Copyright © 2014.

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Functional evaluations in the monitoring of the river ecosystem processes: the Adige River as a case stu.

PubMed

Braioni, M G; Salmoiraghi, G; Bracco, F; Villani, M; Braioni, A; Girelli, L

2002-03-12

A model of analysis and environmental evaluation was applied to 11 stretches of the Adige River, where an innovative procedure was carried out to interpret ecological results. Within each stretch, the most suitable methods were used to assess the quality and processes of flood plains, banks, water column, bed, and interstitial environment. Indices were applied to evaluate the wild state and ecological quality of the banks (wild state index, buffer strip index) and the landscape quality of wide areas of the fluvial corridor (environmental landscape index). The biotic components (i.e., macrozoobenthos, phytoplankton and zooplankton, interstitial hyporheic fauna, vegetation in the riparian areas) were analysed by both quantitative and functional methods (as productivity, litter--processing and colonisation). The results achieved were then translated into five classes of functional evaluation. These qualitative assessments have thus preserved a high level of precision and sensitivity in quantifying both the quality of the environmental conditions and the integrity of the ecosystem processes. Read together with urban planning data, they indicate what actions are needed to restore and rehabilitate the Adige River corridor.

[Psychosocial Risk Evaluation in the Workplace: Expert-based Development of a Checklist for Occupational Physicians].

PubMed

Weigl, M; Müller, A; Angerer, P; Petru, R

2016-03-01

The implementation of psychosocial risk assessment at the workplace often fails in practice. One reason is the lack of competence of those who are in charge of the process. We present a checklist for the effective implementation of psychosocial risk assessment at workplace. This tool shall support occupational physicians in the preparation, planning and implementation of a psychosocial risks assessment process. Based on a stepwise development and validation process, specific steps and factors for the successful implementation were identified qualitatively with 15 occupational physicians and experts. This was conducted in a 2-stage Delphi study. In the following, the identified steps and factors were transferred into a checklist. Subsequently, the checklist was evaluated in a focus group of occupational physicians (user evaluation). Thereafter, the contents were subjected to an expert evaluation. Our checklist for the effective implementation of the process of psychosocial risk management in the workplace aims to strengthen the competence of occupational physicians, especially in the implementation of risk assessments in small and medium-sized enterprises (SMEs). © Georg Thieme Verlag KG Stuttgart · New York.

Comparing appropriateness and equivalence of email interviews to phone interviews in qualitative research on reproductive decisions.

PubMed

Hershberger, Patricia E; Kavanaugh, Karen

2017-10-01

Despite an increasing use of qualitative email interviews by nurse researchers, there is little understanding about the appropriateness and equivalence of email interviews to other qualitative data collection methods, especially on sensitive topics research. The purpose is to describe our procedures for completing asynchronous, email interviews and to evaluate the appropriateness and equivalency of email interviews to phone interviews in two qualitative research studies that examined reproductive decisions. Content analysis guided the methodological appraisal of appropriateness and equivalency of in-depth, asynchronous email interviews to single phone interviews. Appropriateness was determined by: (a) participants' willingness to engage in email or phone interviews, (b) completing data collection in a timely period, and (c) participants' satisfaction with the interview. Equivalency was evaluated by: (a) completeness of the interview data, and (b) insight obtained from the data. Of the combined sample in the two studies (N=71), 31% of participants chose to participate via an email interview over a phone interview. The time needed to complete the email interviews averaged 27 to 28days and the number of investigator probe-participant response interchanges was 4 to 5cycles on average. In contrast, the phone interviews averaged 59 to 61min in duration. Most participants in both the email and phone interviews reported they were satisfied or very satisfied with their ability to express their true feelings throughout the interview. Regarding equivalence, 100% of the email and phone interviews provided insight into decision processes. Although insightful, two of the email and one phone interview had short answers or, at times, underdeveloped responses. Participants' quotes and behaviors cited within four published articles, a novel evaluation of equivalency, revealed that 20% to 37.5% of the citations about decision processes were from email participants, which is consistent with the percent of email participants. In-depth, asynchronous email interviews were appropriate and garnered rich, insightful data that augmented the phone interviews. Awareness of the procedures, appropriateness, and nuances when carrying out email interviews on sensitive topics may provide nurse researchers with the ability to obtain thick, rich data that can best advance clinical practice and direct future research. Copyright © 2017 Elsevier Inc. All rights reserved.

Undergraduate medical education programme renewal: a longitudinal context, input, process and product evaluation study.

PubMed

Mirzazadeh, Azim; Gandomkar, Roghayeh; Hejri, Sara Mortaz; Hassanzadeh, Gholamreza; Koochak, Hamid Emadi; Golestani, Abolfazl; Jafarian, Ali; Jalili, Mohammad; Nayeri, Fatemeh; Saleh, Narges; Shahi, Farhad; Razavi, Seyed Hasan Emami

2016-02-01

The purpose of this study was to utilize the Context, Input, Process and Product (CIPP) evaluation model as a comprehensive framework to guide initiating, planning, implementing and evaluating a revised undergraduate medical education programme. The eight-year longitudinal evaluation study consisted of four phases compatible with the four components of the CIPP model. In the first phase, we explored the strengths and weaknesses of the traditional programme as well as contextual needs, assets, and resources. For the second phase, we proposed a model for the programme considering contextual features. During the process phase, we provided formative information for revisions and adjustments. Finally, in the fourth phase, we evaluated the outcomes of the new undergraduate medical education programme in the basic sciences phase. Information was collected from different sources such as medical students, faculty members, administrators, and graduates, using various qualitative and quantitative methods including focus groups, questionnaires, and performance measures. The CIPP model has the potential to guide policy makers to systematically collect evaluation data and to manage stakeholders' reactions at each stage of the reform in order to make informed decisions. However, the model may result in evaluation burden and fail to address some unplanned evaluation questions.

Critiquing qualitative research.

PubMed

Beck, Cheryl Tatano

2009-10-01

The ability to critique research is a valuable skill that is fundamental to a perioperative nurse's ability to base his or her clinical practice on evidence derived from research. Criteria differ for critiquing a quantitative versus a qualitative study (ie, statistics are evaluated in a quantitative study, but not in a qualitative study). This article provides on guidelines for assessing qualitative research. Excerpts from a published qualitative research report are summarized and then critiqued. Questions are provided that help evaluate different sections of a research study (eg, sample, data collection methods, data analysis).

Evaluation of scavenging in two-stroke-cycle engines

NASA Technical Reports Server (NTRS)

Venediger, Herbert J

1934-01-01

The viewpoints are discussed, according to which the scavenging of two-stroke-cycle engines can be evaluated, and the relations between scavenging pressure and the quantity of the scavenging medium required, as also between the scavenging pressure and the revolution speed, are developed. It is further shown that the power increase is limited by the scavenging process, so that further researches are desirable for qualitative improvement. These results lead to several conclusions regarding the propulsion of motor vehicles by the two-stroke-cycle engines. Lastly, attention is called to the fundamental defect of the two-dimensional treatment of the scavenging process and to the consequent distinction between the two-dimensional and three-dimensional scavenging-type efficiency.

Engaging the Somali community in the road safety agenda: a process evaluation from the London borough of Hounslow.

PubMed

Christie, Nicola; Sleney, Judith; Ahmed, Fatima; Knight, Elisabeth

2012-08-01

In the UK the most disadvantaged in society are more likely than those more affluent to be injured or killed in a road traffic collision and therefore it is a major cause of health inequality. There is a strong link between ethnicity, deprivation and injury. Whilst national road traffic injury data does not collect ethnic origin the London accident and analysis group does in terms of broad categories such as 'white', 'black' and 'Asian'. Analysis of this data revealed the over-representation of child pedestrian casualties from a 'black' ethnic origin. This information led road safety practitioners in one London borough to map child pedestrian casualties against census data which identified the Somali community as being particularly at risk of being involved in a road traffic collision. Working with the community they sought to discuss and address road safety issues and introduced practical evidence based approaches such as child pedestrian training. The process evaluation of the project used a qualitative approach and showed that engaging with community partners and working across organisational boundaries was a useful strategy to gain an understanding of the Somali community. A bottom approach provided the community with a sense of control and involvement which appears to add value in terms of reducing the sense of powerlessness that marginalised communities often feel. In terms of evaluation, small projects like these, lend themselves to a qualitative process evaluation though it has to be accepted that the strength of this evidence may be regarded as weak. Where possible routine injury data needs to take into account ethnicity which is a known risk factor for road casualty involvement which needs to be continually monitored.

The Evaluator's Perspective: Evaluating the State Capacity Building Program.

ERIC Educational Resources Information Center

Madey, Doren L.

A historical antagonism between the advocates of quantitative evaluation methods and the proponents of qualitative evaluation methods has stymied the recognition of the value to be gained by utilizing both methodologies in the same study. The integration of quantitative and qualitative methods within a single evaluation has synergistic effects in…

Student Experiments on the Effects of Dam Removal on the Elwha River

NASA Astrophysics Data System (ADS)

Sandland, T. O.; Grack Nelson, A. L.

2006-12-01

The National Center for Earth Surface Dynamics (NCED) is an NSF funded Science and Technology Center devoted to developing a quantitative, predictive science of the ecological and physical processes that define and shape rivers and river networks. The Science Museum of Minnesota's (SMM) Earthscapes River Restoration classes provide k-12 students, teachers, and the public opportunities to explore NCED concepts and, like NCED scientists, move from a qualitative to a quantitative-based understanding of river systems. During a series of classes, students work with an experimental model of the Elwha River in Washington State to gain an understanding of the processes that define and shape river systems. Currently, two large dams on the Elwha are scheduled for removal to restore salmon habitat. Students design different dam removal scenarios to test and make qualitative observations describing and comparing how the modeled system evolves over time. In a following session, after discussing the ambiguity of the previous session's qualitative data, student research teams conduct a quantitative experiment to collect detailed measurements of the system. Finally, students interpret, critique, and compare the data the groups collected and ultimately develop and advocate a recommendation for the "ideal" dam removal scenario. SMM is currently conducting a formative evaluation of River Restoration classes to improve their educational effectiveness and guide development of an educator's manual. As of August 2006, pre- and post-surveys have been administered to 167 students to gauge student learning and engagement. The surveys have found the program successful in teaching students why scientists use river models and what processes and phenomena are at work in river systems. Most notable is the increase in student awareness of sediment in river systems. A post-visit survey was also administered to 20 teachers who used the models in their classrooms. This survey provided feedback about teachers' experience with the program and will help inform the development of a future educator's manual. All teachers found the program to be effective at providing opportunities for students to make qualitative observations and most (95%) found the program effective at providing students opportunities to make quantitative measurements. A full summary of evaluation results will be shared at the meeting.

Midwest School District Transition Academy: A Qualitative, Process Evaluation of a Program for Students with Autism Spectrum Disorders or Emotional Disturbances

ERIC Educational Resources Information Center

Myers, Paul D.

2012-01-01

The purpose of the study was to examine the implementation of a special education program designed to support students with autism and social/emotional disturbances in a large, suburban school district. The study examined how services are delivered to students, staffing/personnel aspects, and budgetary considerations relative to programming.…

Promoting the Health and Wellbeing of Young Black Men Using Community-Based Drama

ERIC Educational Resources Information Center

Kemp, Martin

2006-01-01

Purpose--This paper aims to explore the role of drama and theatre in promoting the emotional and social wellbeing of a group of young Black men living in south London. Design/methodology/approach--A qualitative methodology was used in a process and outcome evaluation of a drama-based initiative that aimed to promote young Black men's sexual and…

How Is the Learning Environment in Physics Lesson with Using 7E Model Teaching Activities

ERIC Educational Resources Information Center

Turgut, Umit; Colak, Alp; Salar, Riza

2017-01-01

The aim of this research is to reveal the results in the planning, implementation and evaluation of the process for learning environments to be designed in compliance with 7E learning cycle model in physics lesson. "Action research", which is a qualitative research pattern, is employed in this research in accordance with the aim of the…

Community-based health care for indigenous women in Mexico: a qualitative evaluation

PubMed Central

2014-01-01

Introduction Indigenous women in Mexico represent a vulnerable population in which three kinds of discrimination converge (ethnicity, gender and class), having direct repercussions on health status. The discrimination and inequity in health care settings brought this population to the fore as a priority group for institutional action. The objective of this study was to evaluate the processes and performance of the “Casa de la Mujer Indígena”, a community based project for culturally and linguistically appropriate service delivery for indigenous women. The evaluation summarizes perspectives from diverse stakeholders involved in the implementation of the model, including users, local authorities, and institutional representatives. Methods The study covered five Casas implementation sites located in four Mexican states. A qualitative process evaluation focused on systematically analyzing the Casas project processes and performance was conducted using archival information and semi-structured interviews. Sixty-two interviews were conducted, and grounded theory approach was applied for data analysis. Results Few similarities were observed between the proposed model of service delivery and its implementation in diverse locations, signaling discordant operating processes. Evidence gathered from Casas personnel highlighted their ability to detect obstetric emergencies and domestic violence cases, as well as contribute to the empowerment of women in the indigenous communities served by the project. These themes directly translated to increases in the reporting of abuse and referrals for obstetric emergencies. Conclusions The model’s cultural and linguistic competency, and contributions to increased referrals for obstetric emergencies and abuse are notable successes. The flexibility and community-based nature of the model has allowed it to be adapted to the particularities of diverse indigenous contexts. Local, culturally appropriate implementation has been facilitated by the fact that the Casas have been implemented with local leadership and local women have taken ownership. Users express overall satisfaction with service delivery, while providing constructive feedback for the improvement of existing Casas, as well as more cost-effective implementation of the model in new sites. Integration of user’s input obtained from this process evaluation into future planning will undoubtedly increase buy-in. The Casas model is pertinent and viable to other contexts where indigenous women experience disparities in care. PMID:24393517

Community-based health care for indigenous women in Mexico: a qualitative evaluation.

PubMed

Pelcastre-Villafuerte, Blanca; Ruiz, Myriam; Meneses, Sergio; Amaya, Claudia; Márquez, Margarita; Taboada, Arianna; Careaga, Katherine

2014-01-06

Indigenous women in Mexico represent a vulnerable population in which three kinds of discrimination converge (ethnicity, gender and class), having direct repercussions on health status. The discrimination and inequity in health care settings brought this population to the fore as a priority group for institutional action. The objective of this study was to evaluate the processes and performance of the "Casa de la Mujer Indígena", a community based project for culturally and linguistically appropriate service delivery for indigenous women. The evaluation summarizes perspectives from diverse stakeholders involved in the implementation of the model, including users, local authorities, and institutional representatives. The study covered five Casas implementation sites located in four Mexican states. A qualitative process evaluation focused on systematically analyzing the Casas project processes and performance was conducted using archival information and semi-structured interviews. Sixty-two interviews were conducted, and grounded theory approach was applied for data analysis. Few similarities were observed between the proposed model of service delivery and its implementation in diverse locations, signaling discordant operating processes. Evidence gathered from Casas personnel highlighted their ability to detect obstetric emergencies and domestic violence cases, as well as contribute to the empowerment of women in the indigenous communities served by the project. These themes directly translated to increases in the reporting of abuse and referrals for obstetric emergencies. The model's cultural and linguistic competency, and contributions to increased referrals for obstetric emergencies and abuse are notable successes. The flexibility and community-based nature of the model has allowed it to be adapted to the particularities of diverse indigenous contexts. Local, culturally appropriate implementation has been facilitated by the fact that the Casas have been implemented with local leadership and local women have taken ownership. Users express overall satisfaction with service delivery, while providing constructive feedback for the improvement of existing Casas, as well as more cost-effective implementation of the model in new sites. Integration of user's input obtained from this process evaluation into future planning will undoubtedly increase buy-in. The Casas model is pertinent and viable to other contexts where indigenous women experience disparities in care.

[HERA-QUEST: HTA evaluation of generic pharmaceutical products to improve quality, economic efficiency, patient safety and transparency in drug product changes in hospitals].

PubMed

Gyalrong-Steur, Miriam; Kellermann, Anita; Bernard, Rudolf; Berndt, Georg; Bindemann, Meike; Nusser-Rothermundt, Elfriede; Amann, Steffen; Brakebusch, Myga; Brüggmann, Jörg; Tydecks, Eva; Müller, Markus; Dörje, Frank; Kochs, Eberhard; Riedel, Rainer

2017-04-01

In view of the rising cost pressure and an increasing number of drug shortages, switches between generic drug preparations have become a daily routine in hospitals. To ensure consistently high treatment quality and best possible patient safety, the equivalence of the new and the previous drug preparation must be ensured before any change in the purchase of pharmaceutical products takes place. So far, no easily usable, transparent and standardized instrument for this kind of comparison between generic drug products has been available. A group of pharmaceutical experts has developed the drug HTA (health technology assessment) model "HERA" (HTA Evaluation of geneRic phArmaceutical products) through a multi-step process. The instrument is designed to perform both a qualitative and economic comparison of equivalent drug preparations ("aut idem" substitution) before switching products. The economic evaluation does not only consider unit prices and consumption quantity, but also the processing costs associated with a product change process. The qualitative comparison is based on the evaluation of 34 quality criteria belonging to six evaluation fields (e.g., approval status, practical handling, packaging design). The objective evaluation of the quality criteria is complemented by an assessment of special features of the individual hospital for complex drug switches, including the feedback of the physicians utilizing the drug preparation. Thus potentially problematic switches of pharmaceutical products can be avoided at the best possible rate, contributing to the improvement of patient safety. The novel drug HTA model HERA is a tool used in clinical practice that can add to an increase in quality, therapeutic safety and transparency of drug use while simultaneously contributing to the economic optimization of drug procurement in hospitals. Combining these two is essential for hospitals facing the tension between rising cost pressure and at the same time increasing demands on quality and transparency, triggered by, amongst others, current legislation (Hospital Structures Act, anti-corruption legislation). Copyright © 2017. Published by Elsevier GmbH.

Evaluating Fidelity to a Modified NIATx Process Improvement Strategy for Improving HIV Services in Correctional Facilities.

PubMed

Pankow, Jennifer; Willett, Jennifer; Yang, Yang; Swan, Holly; Dembo, Richard; Burdon, William M; Patterson, Yvonne; Pearson, Frank S; Belenko, Steven; Frisman, Linda K

2018-04-01

In a study aimed at improving the quality of HIV services for inmates, an organizational process improvement strategy using change teams was tested in 14 correctional facilities in 8 US states and Puerto Rico. Data to examine fidelity to the process improvement strategy consisted of quantitative ratings of the structural and process components of the strategy and qualitative notes that explicate challenges in maintaining fidelity to the strategy. Fidelity challenges included (1) lack of communication and leadership within change teams, (2) instability in team membership, and (3) issues with data utilization in decision-making to implement improvements to services delivery.

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Qualitative Evaluation.

ERIC Educational Resources Information Center

Stone, James C., Ed.; James, Raymond A., Ed.

1981-01-01

"Qualitative evaluation" is the theme of this issue of the California Journal of Teacher Education. Ralph Tyler states that evaluation is essentially descriptive, and using numbers does not solve basic problems. Martha Elin Vernazza examines the issue of objectivity in history and its implications for evaluation. She posits that the…

Procedure versus process: ethical paradigms and the conduct of qualitative research.

PubMed

Pollock, Kristian

2012-09-27

Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic 'procedural' resolution. This is not to say that qualitative studies are 'unethical' but that their ethical nature can only be safeguarded through the practice of 'micro-ethics' based on the judgement and integrity of researchers in the field. This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of 'empirical ethics' as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values.

Imaging first impressions: distinct neural processing of verbal and nonverbal social information.

PubMed

Kuzmanovic, Bojana; Bente, Gary; von Cramon, D Yves; Schilbach, Leonhard; Tittgemeyer, Marc; Vogeley, Kai

2012-03-01

First impressions profoundly influence our attitudes and behavior toward others. However, little is known about whether and to what degree the cognitive processes that underlie impression formation depend on the domain of the available information about the target person. To investigate the neural bases of the influence of verbal as compared to nonverbal information on interpersonal judgments, we identified brain regions where the BOLD signal parametrically increased with increasing strength of evaluation based on either short text vignettes or mimic and gestural behavior. While for verbal stimuli the increasing strength of subjective evaluation was correlated with increased neural activation of precuneus and posterior cingulate cortex (PC/PCC), a similar effect was observed for nonverbal stimuli in the amygdala. These findings support the assumption that qualitatively different cognitive operations underlie person evaluation depending upon the stimulus domain: while the processing of nonverbal person information may be more strongly associated with affective processing as indexed by recruitment of the amygdala, verbal person information engaged the PC/PCC that has been related to social inferential processing. Copyright © 2011 Elsevier Inc. All rights reserved.

Better movers and thinkers (BMT): A quasi-experimental study into the impact of physical education on children's cognition-A study protocol.

PubMed

Dalziell, Andrew; Boyle, James; Mutrie, Nanette

2015-01-01

This study will extend on a pilot study and will evaluate the impact of a novel approach to PE, Better Movers and Thinkers (BMT), on students' cognition, physical activity habits, and gross motor coordination (GMC). The study will involve six mainstream state schools with students aged 9-11 years. Three schools will be allocated as the intervention condition and three as the control condition. The design of the study is a 16-week intervention with pre-, post- and 6 month follow-up measurements taken using the 'Cognitive Assessment System (CAS)' GMC tests, and the 'Physical Activity Habits Questionnaire for Children (PAQ-C).' Qualitative data will be gathered using student focus groups and class teacher interviews in each of the six schools. ANCOVA will be used to evaluate any effect of intervention comparing pre-test scores with post-test scores and then pre-test scores with 6 month follow-up scores. Qualitative data will be analysed through an iterative process using grounded theory. This protocol provides the details of the rationale and design of the study and details of the intervention, outcome measures, and the recruitment process. The study will address gaps within current research by evaluating if a change of approach in the delivery of PE within schools has an effect on children's cognition, PA habits, and GMC within a Scottish setting.

Big Fish in a Big Pond: a study of academic self concept in first year medical students

PubMed Central

2011-01-01

Background Big-fish-little-pond effect (BFLPE) research has demonstrated that students in high-ability environments have lower academic self-concepts than equally able students in low-ability settings. Research has shown low academic self-concepts to be associated with negative educational outcomes. Social comparison processes have been implicated as fundamental to the BFLPE. Methods Twenty first-year students in an Australian medical school completed a survey that included academic self-concept and social comparison measures, before and after their first written assessments. Focus groups were also conducted with a separate group of students to explore students' perceptions of competence, the medical school environment, and social comparison processes. Results The quantitative study did not reveal any changes in academic self-concept or self-evaluation. The qualitative study suggested that the attributions that students used when discussing performance were those that have been demonstrated to negatively affect self-concept. Students reported that the environment was slightly competitive and they used social comparison to evaluate their performance. Conclusions Although the BFLPE was not evident in the quantitative study, results from the qualitative study suggest that the BFLPE might be operating In that students were using attributions that are associated with lower self-concepts, the environment was slightly competitive, and social comparisons were used for evaluation. PMID:21794166

Methods and impact of engagement in research, from theory to practice and back again: early findings from the Patient-Centered Outcomes Research Institute.

PubMed

Forsythe, Laura; Heckert, Andrea; Margolis, Mary Kay; Schrandt, Suzanne; Frank, Lori

2018-01-01

Since 2012, PCORI has been funding patient-centered comparative effectiveness research with a requirement for engaging patients and other stakeholders in the research, a requirement that is unique among the US funders of clinical research. This paper presents PCORI's evaluation framework for assessing the short- and long-term impacts of engagement; describes engagement in PCORI projects (types of stakeholders engaged, when in the research process they are engaged and how they are engaged, contributions of their engagement); and identifies the effects of engagement on study design, processes, and outcomes selection, as reported by both PCORI-funded investigators and patient and other stakeholder research partners. Detailed quantitative and qualitative information collected annually from investigators and their partners was analyzed via descriptive statistics and cross-sectional qualitative content and thematic analysis, and compared against the outcomes expected from the evaluation framework and its underlying conceptual model. The data support the role of engaged research partners in refinements to the research questions, selection of interventions to compare, choice of study outcomes and how they are measured, contributions to strategies for recruitment, and ensuring studies are patient-centered. The evaluation framework and the underlying conceptual model are supported by results to date. PCORI will continue to assess the effects of engagement as the funded projects progress toward completion, dissemination, and uptake into clinical decision making.

Process evaluation of a workplace health promotion intervention aimed at improving work engagement and energy balance.

PubMed

van Berkel, Jantien; Boot, Cécile R L; Proper, Karin I; Bongers, Paulien M; van der Beek, Allard J

2013-01-01

To evaluate the process of the implementation of an intervention aimed at improving work engagement and energy balance, and to explore associations between process measures and compliance. Process measures were assessed using a combination of quantitative and qualitative methods. The mindfulness training was attended at least once by 81.3% of subjects, and 54.5% were highly compliant. With regard to e-coaching and homework exercises, 6.3% and 8.0%, respectively, were highly compliant. The training was appreciated with a 7.5 score and e-coaching with a 6.8 score. Appreciation of training and e-coaching, satisfaction with trainer and coach, and practical facilitation were significantly associated with compliance. The intervention was implemented well on the level of the mindfulness training, but poorly on the level of e-coaching and homework time investment. To increase compliance, attention should be paid to satisfaction and trainer-participant relationship.

Using the cognitive interviewing process to improve survey design by allied health: A qualitative study.

PubMed

Howlett, Owen; McKinstry, Carol; Lannin, Natasha A

2018-04-01

Allied health professionals frequently use surveys to collect data for clinical practice and service improvement projects. Careful development and piloting of purpose-designed surveys is important to ensure intended measuring (that respondents correctly interpret survey items when responding). Cognitive interviewing is a specific technique that can improve the design of self-administered surveys. The aim of this study was to describe the use of the cognitive interviewing process to improve survey design, which involved a purpose-designed, online survey evaluating staff use of functional electrical stimulation. A qualitative study involving one round of cognitive interviewing with three occupational therapists and three physiotherapists. The cognitive interviewing process identified 11 issues with the draft survey, which could potentially influence the validity and quality of responses. The raised issues included difficulties with: processing the question to be able to respond, determining a response to the question, retrieving relevant information from memory and comprehending the written question. Twelve survey amendments were made following the cognitive interviewing process, comprising four additions, seven revisions and one correction. The cognitive interviewing process applied during the development of a purpose-designed survey enabled the identification of potential problems and informed revisions to the survey prior to its use. © 2017 Occupational Therapy Australia.

Factors that affect implementation of a nurse staffing directive: results from a qualitative multi-case evaluation.

PubMed

Robinson, Claire H; Annis, Ann M; Forman, Jane; Krein, Sarah L; Yankey, Nicholas; Duffy, Sonia A; Taylor, Beth; Sales, Anne E

2016-08-01

To assess implementation of the Veterans Health Administration staffing methodology directive. In 2010 the Veterans Health Administration promulgated a staffing methodology directive for inpatient nursing units to address staffing and budget forecasting. A qualitative multi-case evaluation approach assessed staffing methodology implementation. Semi-structured telephone interviews were conducted from March - June 2014 with Nurse Executives and their teams at 21 facilities. Interviews focused on the budgeting process, implementation experiences, use of data, leadership support, and training. An implementation score was created for each facility using a 4-point rating scale. The scores were used to select three facilities (low, medium and high implementation) for more detailed case studies. After analysing interview summaries, the evaluation team developed a four domain scoring structure: (1) integration of staffing methodology into budget development; (2) implementation of the Directive elements; (3) engagement of leadership and staff; and (4) use of data to support the staffing methodology process. The high implementation facility had leadership understanding and endorsement of staffing methodology, confidence in and ability to work with data, and integration of staffing methodology results into the budgeting process. The low implementation facility reported poor leadership engagement and little understanding of data sources and interpretation. Implementation varies widely across facilities. Implementing staffing methodology in facilities with complex and changing staffing needs requires substantial commitment at all organizational levels especially for facilities that have traditionally relied on historical levels to budget for staffing. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

The first cycle of the reflective pedagogical paradigm implementation in the introduction probability theory course

NASA Astrophysics Data System (ADS)

Julie, Hongki

2017-08-01

One of purposes of this study was describing the steps of the teaching and learning process if the teacher in the Introduction Probability Theory course wanted to teach about the event probability by using the reflective pedagogical paradigm (RPP) and describing the results achieved by the students. The study consisted of three cycles, but the results would be presented in this paper was limited to the results obtained in the first cycle. Stages conducted by the researcher in the first cycle could be divided into five stages, namely (1) to know the students' context, (2) to plan and provide student learning experiences, (3) to facilitate students in actions, (4) to ask students to make a reflection and (5) to evaluate. The type of research used in this research was descriptive qualitative and quantitative research. The students' learning experience, the students' action, and the students' reflection would be described qualitatively. The student evaluation results would be described quantitatively. The research subject in this study was 38 students taking the introduction probability theory course in class C. From the students' reflection, still quite a lot of students were not complete in writing concepts that they have learned and / or have not been precise in describing the relationships between concepts that they have learned. From the students' evaluation, 85.29% students got score under 7. If examined more deeply, the most difficulty of students were in the mathematical horizontal process. As a result, they had difficulty in performing the mathematical vertical process.

Facilitating evaluations of innovative, competence-based assessments: creating understanding and involving multiple stakeholders.

PubMed

Gulikers, Judith T M; Baartman, Liesbeth K J; Biemans, Harm J A

2010-05-01

Schools are held more responsible for evaluating, quality assuring and improving their student assessments. Teachers' lack of understanding of new, competence-based assessments as well as the lack of key stakeholders' involvement, hamper effective and efficient self-evaluations by teachers of innovative, competence-based assessments (CBAs). While evaluating two CBAs in Agricultural Vocational Education and Training institutions, two interventions in the evaluation process aimed to tackle these problems were examined: (1) starting with explicating the CBA in the teacher team using a concrete explication format and (2) qualitatively involving key stakeholders (i.e., teachers, students and employers) in the evaluation of the CBA through mixed-group interviews. Quantitative and qualitative analysis, as well as stakeholders' perceptions are used to find indications for the added value of these interventions for evaluation and further improvement of the CBAs. Results show that external facilitation is needed to make both interventions work. However, under this condition, explicating the CBA led to more complete, concrete and shared understandings of the actual CBA among teachers and mixed-groups interviews resulted in more concrete and elaborate evaluations of the CBAs' quality and more ideas for improvement. Both interventions can facilitate building up elaborate, more valid and concrete arguments for CBA quality in self-evaluations, certainly in the case of evaluating innovative assessments. Lessons learned will provide guidelines for incorporating the interventions into other evaluations of innovative programs. Copyright 2009 Elsevier Ltd. All rights reserved.

Living in a material world: Development and evaluation of a new materials science course for non-science majors

NASA Astrophysics Data System (ADS)

Brust, Gregory John

This study was designed to discover if there is a difference in the scientific attitudes and process skills between a group of students who were instructed with Living in a Material World and groups of students in non-science majors sections of introductory biology, chemistry, and geology courses at the University of Southern Mississippi (USM). Each of the four courses utilized different instructional techniques. Students' scientific attitudes were measured with the Scientific Attitudes Inventory (SAI II) and their knowledge of science process skills were measured with the Test of Integrated Process Skills (TIPS II). The Group Assessment of Logical Thinking (GALT) was also administered to determine if the cognitive levels of students are comparable. A series of four questionnaires called Qualitative Course Assessments (QCA) were also administered to students in the experimental course to evaluate subtle changes in their understanding of the nature and processes of science and attitudes towards science. Student responses to the QCA questionnaires were triangulated with results of the qualitative instruments, and students' work on the final project. Results of the GALT found a significant difference in the cognitive levels of students in the experimental course (PSC 190) and in one of the control group, the introductory biology (BSC 107). Results of the SAI II and the TIPS II found no significant difference between the experimental group and the control groups. Qualitative analyses of students' responses to selected questions from the TIPS II, selected items on the SAI II, QCA questionnaires, and Materials that Fly project reports demonstrate an improvement in the understanding of the nature and processes of science and a change to positive attitude toward science of students in the experimental group. Students indicated that hands-on, inquiry-based labs and performance assessment were the most effective methods for their learning. These results indicate that science courses for non-science majors should focus on connections to students' daily lives while utilizing an STS curriculum and inquiry-based activities. Future research could focus on long term effects of this type of course as well as the effectiveness of these teaching methods for science majors.

Using qualitative insights to change practice: exploring the culture of antibiotic prescribing and consumption for urinary tract infections

PubMed Central

Duane, Sinead; Domegan, Christine; Callan, Aoife; Galvin, Sandra; Cormican, Martin; Bennett, Kathleen; Murphy, Andrew W

2016-01-01

Objectives The aim of this paper is to explore the culture of antibiotic prescribing and consumption in the community for urinary tract infections (UTI) from the perspective of the general practitioners (GPs) and community member. Design Indepth interviews were conducted with GPs, and focus groups were held with community members. Setting General practice and community setting. Participants 15 GPs practising in rural and urban locations in Ireland participated in the indepth interviews. 6 focus groups (n=42) with participants who had direct or indirect experiences with UTI were also undertaken. Results The decision to prescribe or consume an antibiotic for a UTI is a set of complex processes including need recognition, information search and evaluation processes governed by the relationship and interactions between the GP and the patient. Different GP and patient decision-making profiles emerged emphasising the diversity and variety of general practice in real-life settings. The GP findings showed a requirement for more microbiological information on antibiotic resistance patterns to inform prescribing decisions. Focus group participants wanted a conversation with the GP about their illness and the treatment options available. Conclusions Collectively, this research identified the consultation as a priority intervention environment for stimulating change in relation to antibiotics. This paper demonstrates how qualitative research can identify the interacting processes which are instrumental to the decision to prescribe or consume an antibiotic for a suspected UTI. Qualitative research empowers researchers to investigate the what, how and why of interventions in real-life setting. Qualitative research can play a critical and instrumental role in designing behavioural change strategies with high impact on practice. The results of this research were used to design a complex intervention informed by social marketing. Trial registration number NCT01913860; Pre-results. PMID:26754175

Possible ways for Public Health Surveillance practices evaluation.

PubMed

Vilela, Maria Filomena de Gouveia; Santos, Dario Nunes Dos; Kemp, Brigina

2017-10-01

This is an evaluative and qualitative study that proposes to investigate self-assessment evaluation as a device to analyze Health Surveillance practices through a questionnaire built by researchers, adapted from the Self-Assessment of Improved Access and Primary Care Quality (AMAQ) and available on the FORMSUS platform. Forty-one Health Surveillance workers and managers of a large municipality from São Paulo State evaluated the realms of "management", "teamwork" and their respective sub-realms. Two categories were created to analyze the results: "Management" and "Team" in dialogue with references from Management, Evaluation and Health Surveillance. Most "management" and "teamwork" sub-realms were deemed satisfactory. Self-assessment evaluation through an applied evaluation tool was shown to be a powerful resource for the analysis of Health Surveillance practices in combination with other devices adopted by the Unified Health System (SUS). Unlike usual evaluation processes guided by quantitative markers, this self-assessable evaluative process included subjects and enabled the possibility of incorporating a new look at itself to the way Health Surveillance is carried out and support future management contracts between workers and managers.

Meta-Study as Diagnostic: Toward Content Over Form in Qualitative Synthesis.

PubMed

Frost, Julia; Garside, Ruth; Cooper, Chris; Britten, Nicky

2016-02-01

Having previously conducted qualitative syntheses of the diabetes literature, we wanted to explore the changes in theoretical approaches, methodological practices, and the construction of substantive knowledge which have recently been presented in the qualitative diabetes literature. The aim of this research was to explore the feasibility of synthesizing existing qualitative syntheses of patient perspectives of diabetes using meta-study methodology. A systematic review of qualitative literature, published between 2000 and 2013, was conducted. Six articles were identified as qualitative syntheses. The meta-study methodology was used to compare the theoretical, methodological, analytic, and synthetic processes across the six studies, exploring the potential for an overarching synthesis. We identified that while research questions have increasingly concentrated on specific aspects of diabetes, the focus on systematic review processes has led to the neglect of qualitative theory and methods. This can inhibit the production of compelling results with meaningful clinical applications. Although unable to produce a synthesis of syntheses, we recommend that researchers who conduct qualitative syntheses pay equal attention to qualitative traditions and systematic review processes, to produce research products that are both credible and applicable. © The Author(s) 2015.

Qualitative Analysis of an Educational Intervention with HIV-Discordant Heterosexual Latino Couples

PubMed Central

Pérez-Jiménez, David; Orengo-Aguayo, Rosaura E.

2012-01-01

Objective This qualitative analysis elucidates the potential elements of the intervention that may be effective in terms of a) increasing knowledge about HIV/AIDS in the members of this population; b) increasing the use of male condoms and the practice of mutual masturbation; and c) changing opinions toward male condom use and mutual masturbation. Methods Five heterosexual HIV-discordant couples participated in the adapted intervention, which consisted of four three-hour-long sessions. One month after the intervention, we conducted a qualitative semi-structured interview with every participant to evaluate issues related to the process and content of the activities comprising the intervention, the impact of the intervention, logistics, and recruitment and retention as well as to make a more general evaluation. The information was submitted to qualitative content analysis. Results After the intervention, participants reported having better attitudes regarding safer sex, particularly in terms of condom use. A reason given by the participants to feel more positive toward condom use and mutual masturbation was that these practices could prevent the infection of the HIV-negative partner. Conclusion This study provides important evidence of an intervention that promises to be efficacious in preventing some high-risk sexual behaviors among Latino HIV-discordant heterosexual couples. The evidence presented seems to suggest that an intervention that includes basic relevant information about HIV/AIDS, that explains the benefits of condom use and other safer sex options, and that provides effective negotiation and communication strategies could significantly reduce HIV transmission among these couples. PMID:22263299

Qualitative analysis of an educational intervention with HIV-discordant heterosexual Latino couples.

PubMed

Pérez-Jiménez, David; Orengo-Aguayo, Rosaura E

2011-12-01

This qualitative analysis elucidates the potential elements of the intervention that may be effective in terms of a) increasing knowledge about HIV/ AIDS in the members of this population; b) increasing the use of male condoms and the practice of mutual masturbation; and c) changing opinions toward male condom use and mutual masturbation. Five heterosexual HIV-discordant couples participated in the adapted intervention, which consisted of four three-hour-long sessions. One month after the intervention, we conducted a qualitative semi-structured interview with every participant to evaluate issues related to the process and content of the activities comprising the intervention, the impact of the intervention, logistics, and recruitment and retention as well as to make a more general evaluation. The information was submitted to qualitative content analysis. After the intervention, participants reported having better attitudes regarding safer sex, particularly in terms of condom use. A reason given by the participants to feel more positive toward condom use and mutual masturbation was that these practices could prevent the infection of the HIV-negative partner. This study provides important evidence of an intervention that promises to be efficacious in preventing some high-risk sexual behaviors among Latino HIV-discordant heterosexual couples. The evidence presented seems to suggest that an intervention that includes basic relevant information about HIV/AIDS, that explains the benefits of condom use and other safer sex options, and that provides effective negotiation and communication strategies could significantly reduce HIV transmission among these couples.

Systematic evaluation of implementation fidelity of complex interventions in health and social care

PubMed Central

2010-01-01

Background Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes. The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care. Methods A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods. Discussion This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified. Trial Registration Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024. PMID:20815872

FLAMMABLE GAS TECHNICAL BASIS DOCUMENT

DOE Office of Scientific and Technical Information (OSTI.GOV)

KRIPPS, L.J.

2005-02-18

This document describes the qualitative evaluation of frequency and consequences for double shell tank (DST) and single shell tank (SST) representative flammable gas accidents and associated hazardous conditions without controls. The evaluation indicated that safety-significant SSCs and/or TSRS were required to prevent or mitigate flammable gas accidents. Discussion on the resulting control decisions is included. This technical basis document was developed to support of the Tank Farms Documented Safety Analysis (DSA) and describes the risk binning process for the flammable gas representative accidents and associated represented hazardous conditions. The purpose of the risk binning process is to determine the needmore » for safety-significant structures, systems, and components (SSC) and technical safety requirement (TSR)-level controls for a given representative accident or represented hazardous condition based on an evaluation of the event frequency and consequence.« less

Benchmarking nitrogen removal suspended-carrier biofilm systems using dynamic simulation.

PubMed

Vanhooren, H; Yuan, Z; Vanrolleghem, P A

2002-01-01

We are witnessing an enormous growth in biological nitrogen removal from wastewater. It presents specific challenges beyond traditional COD (carbon) removal. A possibility for optimised process design is the use of biomass-supporting media. In this paper, attached growth processes (AGP) are evaluated using dynamic simulations. The advantages of these systems that were qualitatively described elsewhere, are validated quantitatively based on a simulation benchmark for activated sludge treatment systems. This simulation benchmark is extended with a biofilm model that allows for fast and accurate simulation of the conversion of different substrates in a biofilm. The economic feasibility of this system is evaluated using the data generated with the benchmark simulations. Capital savings due to volume reduction and reduced sludge production are weighed out against increased aeration costs. In this evaluation, effluent quality is integrated as well.

Qualitative evaluation of maternal milk and commercial infant formulas via LIBS.

PubMed

Abdel-Salam, Z; Al Sharnoubi, J; Harith, M A

2013-10-15

This study focuses on the use of laser-induced breakdown spectroscopy (LIBS) for the evaluation of the nutrients in maternal milk and some commercially available infant formulas. The results of such evaluation are vital for adequate and healthy feeding for babies during lactation period. Laser-induced breakdown spectroscopy offers special advantages in comparison to the other conventional analytical techniques. Specifically, LIBS is a straightforward technique that can be used in situ to provide qualitative analytical information in few minutes for the samples under investigation without preparation processes. The samples studied in the current work were maternal milk samples collected during the first 3 months of lactation (not colostrum milk) and samples from six different types of commercially available infant formulas. The samples' elemental composition has been compared with respect to the relative abundance of the elements of nutrition importance, namely Mg, Ca, Na, and Fe using their spectral emission lines in the relevant LIBS spectra. In addition, CN and C2 molecular emission bands in the same spectra have been studied as indicators of proteins content in the samples. The obtained analytical results demonstrate the higher elemental contents of the maternal milk compared with the commercial formulas samples. Similar results have been obtained as for the proteins content. It has been also shown that calcium and proteins have similar relative concentration trends in the studied samples. This work demonstrates the feasibility of adopting LIBS as a fast, safe, less costly technique evaluating qualitatively the nutrients content of both maternal and commercial milk samples. Copyright © 2013 Elsevier B.V. All rights reserved.

Conducting qualitative research in mental health: Thematic and content analyses.

PubMed

Crowe, Marie; Inder, Maree; Porter, Richard

2015-07-01

The objective of this paper is to describe two methods of qualitative analysis - thematic analysis and content analysis - and to examine their use in a mental health context. A description of the processes of thematic analysis and content analysis is provided. These processes are then illustrated by conducting two analyses of the same qualitative data. Transcripts of qualitative interviews are analysed using each method to illustrate these processes. The illustration of the processes highlights the different outcomes from the same set of data. Thematic and content analyses are qualitative methods that serve different research purposes. Thematic analysis provides an interpretation of participants' meanings, while content analysis is a direct representation of participants' responses. These methods provide two ways of understanding meanings and experiences and provide important knowledge in a mental health context. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Investigation of Pre-Service Teachers' Opinions about Science in Terms of the Basic Elements of the Education Program

ERIC Educational Resources Information Center

Sengul, Ozge Aydin

2016-01-01

The purpose of the current study is to investigate the pre-service teachers' opinions about science within the context of the basic elements of the education program, such as objectives, content, learning-teaching process and evaluation. The study was designed as a case study, one of the qualitative research methods. The participants of the study…

Health Professionals' Perspectives on Exercise Referral and Physical Activity Promotion in Primary Care: Findings from a Process Evaluation of the National Exercise Referral Scheme in Wales

ERIC Educational Resources Information Center

Din, Nafees U.; Moore, Graham F.; Murphy, Simon; Wilkinson, Clare; Williams, Nefyn H.

2015-01-01

Background and objectives: Referring clinicians' experiences of exercise referral schemes (ERS) can provide valuable insights into their uptake. However, most qualitative studies focus on patient views only. This paper explores health professionals' perceptions of their role in promoting physical activity and experiences of a National Exercise…

Mentors' Perceptions on Effects of Their Mentoring with Higher Education Students in Companies after the Adoption of the Bologna Process

ERIC Educational Resources Information Center

Govekar-Okoliš, Monika

2018-01-01

This article describes the characteristics of mentoring higher education students in companies which is a field the least researched, particularly when evaluateing effects of mentoring. This qualitative study is a response to this concern. The purpose of the study is to determine what mentors working with students in companies in certain European…

Plenty of Blame to Go Around: A Qualitative Approach to Attribution of Moral Responsibility

DTIC Science & Technology

2007-01-01

1 Social psychological research cited in [Mao 2006] indicates that there are differences in the processes used for responsibility for...Mao, W. and Gratch, J. 2005. Social Causality and Responsibility : Modeling and Evaluation. Fifth International Conference on Interactive Virtual...Reasoning Workshop. B. Weiner. 1995. Judgments of Responsibility : A Foundation for a Theory of Social Conduct. Guilford Press. B. Weiner. 2001

Mathematical modeling of PDC bit drilling process based on a single-cutter mechanics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wojtanowicz, A.K.; Kuru, E.

1993-12-01

An analytical development of a new mechanistic drilling model for polycrystalline diamond compact (PDC) bits is presented. The derivation accounts for static balance of forces acting on a single PDC cutter and is based on assumed similarity between bit and cutter. The model is fully explicit with physical meanings given to all constants and functions. Three equations constitute the mathematical model: torque, drilling rate, and bit life. The equations comprise cutter`s geometry, rock properties drilling parameters, and four empirical constants. The constants are used to match the model to a PDC drilling process. Also presented are qualitative and predictive verificationsmore » of the model. Qualitative verification shows that the model`s response to drilling process variables is similar to the behavior of full-size PDC bits. However, accuracy of the model`s predictions of PDC bit performance is limited primarily by imprecision of bit-dull evaluation. The verification study is based upon the reported laboratory drilling and field drilling tests as well as field data collected by the authors.« less

The One or the Many: Quantified Subjectivity and Aggregated Uniqueness in Qualitative Rehabilitation Research.

PubMed

Juritzen, Truls I; Soberg, Helene L; Røe, Cecilie; Saebu, Martin; Engen, Grace; Bliksvaer, Trond; Engebretsen, Eivind

2017-01-01

This article aims to identify and critically assess qualitative intervention studies of rehabilitation processes that target young adults. By applying a meta-epistemological approach inspired by the works of Michel Foucault and Julia Kristeva, we examine how the included studies present qualitative knowledge and whether they adhere to their own stated principles of qualitative knowledge. Through their stated aims and theoretical framing, the articles draw attention to individual processes of meaning making. Nonetheless, we find that the articles to a great extent emphasize frequencies of the qualitative data they present. Individual processes and experiences are subject to subdivisions and categorization and transformed into manageable objects of knowledge. In conclusion, these studies, with one important exception, contribute to self-marginalization of the knowledge they themselves promote: They undermine the uniqueness of the qualitative knowledge they proclaim by focusing on frequency and the general patterns and categories encompassing the unique. © The Author(s) 2016.

Toward Eco Product Development with Qualitative and CAE Design Process - Case Study of Flame Guiding Module

NASA Astrophysics Data System (ADS)

Chen, W. L.; Chao, F. L.

2018-04-01

Sustainable products become increasingly important for company in addressing eco-performance to satisfy global environmental regulations. Case study of flame guiding module reviewed design process and concerns related to the torch design. For enhancing flame height, the torch was embedded with an airflow guidance structure. The design process and design methodologies were investigated as an eco-design case study. Combine qualitative and CAE simulation were proposed to fulfil its main and auxiliary functions including reduction of impact during use. The design guidelines help prevent mistake arrangements, CAE helps understand combustion phenomenon. The flow field simulation enables fine tune of geometric design. Functional test and measurement are carried out to confirm the product features. On Eco-performance, we choose 5 items for evaluation the status of previous and redesign module, namely function need, low impact material, few manufacturing steps, low energy consumption, and safety. The radar diagram indicates that eco-performance of redesign module is better. Life cycle assessment calculated the carbon footprint of the manufacturing and processing stage with Eco-it. By using recycled steel in the flame module, it reduces raw material stage carbon footprint significantly.

Senior Medical Student Mock Interview Program in Pediatrics.

PubMed

Multerer, Sara; Carothers, Becky; Patel, Pradip D; Ziegler, Craig; Rowland, Michael; Davis, Deborah Winders

2016-02-01

Residency interviews play an integral part in medical residency placement. We aimed to develop and evaluate a mock interview program for fourth-year medical students interested in a pediatric specialty. A mock interview program for fourth-year medical students interested in pediatrics was developed and implemented. Preinterview quantitative data and postinterview qualitative data were collected. Fifty-nine students completed the program across three consecutive academic years. Preinterview surveys were completed regarding comfort and confidence levels specific to aspects of the interview process. Descriptive analyses were used. In addition, a focus group was held with nine of the participating students to obtain qualitative data via a paper blog process. Themes in student responses were identified through constant comparative analysis. Before the mock interview, students were most uncomfortable with introductory and closing remarks and their confidence levels varied by topic. A thematic analysis of focus group data identified five themes (preparation, stress reduction, interview process familiarity, confidence of skills, and receiving feedback) for which the mock interviews were most helpful. Implementation of a mock interview program was feasible and acceptable for senior medical students and may improve comfort and confidence levels in the residency interview process. Further longitudinal research is needed.

Formally grounding spatio-temporal thinking.

PubMed

Klippel, Alexander; Wallgrün, Jan Oliver; Yang, Jinlong; Li, Rui; Dylla, Frank

2012-08-01

To navigate through daily life, humans use their ability to conceptualize spatio-temporal information, which ultimately leads to a system of categories. Likewise, the spatial sciences rely heavily on conceptualization and categorization as means to create knowledge when they process spatio-temporal data. In the spatial sciences and in related branches of artificial intelligence, an approach has been developed for processing spatio-temporal data on the level of coarse categories: qualitative spatio-temporal representation and reasoning (QSTR). Calculi developed in QSTR allow for the meaningful processing of and reasoning with spatio-temporal information. While qualitative calculi are widely acknowledged in the cognitive sciences, there is little behavioral assessment whether these calculi are indeed cognitively adequate. This is an astonishing conundrum given that these calculi are ubiquitous, are often intended to improve processes at the human-machine interface, and are on several occasions claimed to be cognitively adequate. We have systematically evaluated several approaches to formally characterize spatial relations from a cognitive-behavioral perspective for both static and dynamically changing spatial relations. This contribution will detail our framework, which is addressing the question how formal characterization of space can help us understand how people think with, in, and about space.

A online credit evaluation method based on AHP and SPA

NASA Astrophysics Data System (ADS)

Xu, Yingtao; Zhang, Ying

2009-07-01

Online credit evaluation is the foundation for the establishment of trust and for the management of risk between buyers and sellers in e-commerce. In this paper, a new credit evaluation method based on the analytic hierarchy process (AHP) and the set pair analysis (SPA) is presented to determine the credibility of the electronic commerce participants. It solves some of the drawbacks found in classical credit evaluation methods and broadens the scope of current approaches. Both qualitative and quantitative indicators are considered in the proposed method, then a overall credit score is achieved from the optimal perspective. In the end, a case analysis of China Garment Network is provided for illustrative purposes.

Fiber tractography using machine learning.

PubMed

Neher, Peter F; Côté, Marc-Alexandre; Houde, Jean-Christophe; Descoteaux, Maxime; Maier-Hein, Klaus H

2017-09-01

We present a fiber tractography approach based on a random forest classification and voting process, guiding each step of the streamline progression by directly processing raw diffusion-weighted signal intensities. For comparison to the state-of-the-art, i.e. tractography pipelines that rely on mathematical modeling, we performed a quantitative and qualitative evaluation with multiple phantom and in vivo experiments, including a comparison to the 96 submissions of the ISMRM tractography challenge 2015. The results demonstrate the vast potential of machine learning for fiber tractography. Copyright © 2017 Elsevier Inc. All rights reserved.

Processing and property evaluation of metal matrix superconducting materials

NASA Technical Reports Server (NTRS)

Rao, Appajosula S.

1995-01-01

Metal - superconductor (YBCO) systems have been prepared and characterized by resistivity, ac susceptibility and dc SQUID magnetic moment measurements. The silver composites showed superconducting transition for all the composites processed and the superconducting transition temperature tends to depend upon the concentration of the silver in the composite. Aluminum composites showed an unusual resistivity results with two transitions around 90 K and 120 K. The superconducting property of silver composites can be explained qualitatively in terms of the proximity theory that has been suggested for the low temperature superconductors.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

A multimedia campaign to improve back beliefs in patients with non-specific low back pain: a process evaluation.

PubMed

Suman, Arnela; Schaafsma, Frederieke G; Bamarni, Jiman; van Tulder, Maurits W; Anema, Johannes R

2017-05-18

Low back pain (LBP) is one of the most prevalent and costly disorders worldwide. To reduce its burden in the Netherlands, implementation of a multidisciplinary guideline for LBP was supported by a multifaceted eHealth campaign for patients with LBP. The current study aims 1) to evaluate whether the implementation strategy was performed as planned; 2) to assess the feasibility, barriers and facilitators of the patient based eHealth campaign; 3) to gain insight into the satisfaction and experiences of patients with various ethnic backgrounds with the implementation strategy and to make a comparison between them; and 4) to explore the association between exposure to and satisfaction with the implementation strategy. This process evaluation was performed using the Linnan and Steckler framework, and used a mixed methods approach for data collection and analysis. The relationship between satisfaction of patients and exposure to the strategy was statistically examined. Semi-structured interviews were analysed using qualitative data analysis methods. Two hundred and fourteen patients participated in the quantitative, and 44 in the qualitative analysis. Most were female and had a high level of education. Many patients did not use the campaign at all or only once, and those that did rated it as reasonable. Patient satisfaction with the campaign increased significantly with an increase in its use. Qualitative analysis showed that four main themes played a role in campaign rating and use: satisfaction with intervention components, perceived benefits of the intervention, usage of the intervention, and satisfaction with the medium used. This process evaluation showed that the eHealth campaign was used only by a small proportion of patients with non-specific LBP. It seemed that the campaign was offered to the patients too late, that the lay-out of the campaign did not meet patient needs, and that healthcare providers rarely discussed the campaign with their patients, while involvement of those providers seemed to improve trustworthiness of the campaign and increase its usage. It is important to invest effort into healthcare providers to motivate patients to use eHealth intervention and to tailor strategies better to the needs of users. Netherlands Trial Register (NTR): NTR4329 . Registered December 20th, 2013.

Cognitive Relativism in Evaluation.

ERIC Educational Resources Information Center

Alexander, H. A.

1986-01-01

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

Using a Systematic Conceptual Model for a Process Evaluation of a Middle School Obesity Risk-Reduction Nutrition Curriculum Intervention: Choice, Control & Change

PubMed Central

Lee, Heewon; Contento, Isobel R.; Koch, Pamela

2012-01-01

Objective To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. Design A process evaluation study based on a systematic conceptual model. Setting Five middle schools in New York City. Participants 562 students in 20 classes and their science teachers (n=8). Main Outcome Measures Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers’ curriculum evaluation, and satisfaction with teaching the curriculum. Analysis Descriptive statistics and Spearman’s Rho Correlation for quantitative analysis and content analysis for qualitative data were used. Results Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teachers’ satisfaction with teaching the curriculum was highly correlated with students’ satisfaction (p <.05). Teachers’ perception of amount of student work was negatively correlated with implementation and with student satisfaction (p<.05). Conclusions and implications Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. PMID:23321021

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change.

PubMed

Lee, Heewon; Contento, Isobel R; Koch, Pamela

2013-03-01

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. A process evaluation study based on a systematic conceptual model. Five middle schools in New York City. Five hundred sixty-two students in 20 classes and their science teachers (n = 8). Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum. Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used. Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05). Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Protocol of a mixed method, randomized controlled study to assess the efficacy of a psychosocial intervention to reduce fatigue in patients with End-Stage Renal Disease (ESRD).

PubMed

van der Borg, Wieke E; Schipper, Karen; Abma, Tineke A

2016-07-08

Patients with end-stage renal disease (ESRD) commonly suffer from severe fatigue, which strongly impacts their quality of life (QoL). Although fatigue is often attributed to disease- and treatment characteristics, research also shows that behavioural, psychological and social factors affect perceived fatigue in dialysis patients. Whereas studies on fatigue in other chronic patient groups suggest that psychological or psychosocial interventions are effective in reducing fatigue, such interventions are not yet available for ESRD patients on dialysis treatment. The objective of this study is to examine the efficacy of a psychosocial intervention for dialysis patients aimed at reducing fatigue (primary outcome) and improving QoL (secondary outcome). The intervention consists of counselling sessions led by a social worker. The implementation process and patients' and social workers' expectations and experiences with the intervention will also be evaluated. This study follows a mixed-methods design in which both quantitative and qualitative data will be collected. A multi-centre, randomised controlled trial (RCT) with repeated measures will be conducted to quantitatively assess the efficacy of the psychosocial intervention in reducing fatigue and improving QoL in ESRD patients. Additional secondary outcomes and medical parameters will be assessed. Outcomes will be compared to patients receiving usual care. A sample of 74 severely fatigued dialysis patients will be recruited from 10 dialysis centres. Patients will be randomly assigned to the intervention or control group. Outcomes will be assessed at baseline, post intervention/16 weeks, and at three and six-month follow-ups. A qualitative process evaluation will be conducted parallel to/following the effectiveness RCT. Interviews and focus groups will be conducted to gain insight into patients' and social workers' perspectives on outcomes and implementation procedures. Implementation fidelity will be assessed by audio-taped and written registrations. Participatory methods ensure the continuous input of experiential knowledge, improving the quality of study procedures and the applicability of outcomes. This is the first mixed method study (including an RCT and qualitative process evaluation) to examine the effect and implementation process of a psychosocial intervention on reducing fatigue and improving QoL in ESRD patients on dialysis treatment. NTR5366 , The Netherlands National Trial Register (NTR), registered August 26, 2015.

Connoisseurship Evaluation in Digital Painting among Art Teachers in Malaysian Secondary School

ERIC Educational Resources Information Center

Samah, Azimah A.; Hussin, Zaharah; Putih, Abu Talib

2016-01-01

Connoisseurship evaluation is a form of evaluation and educational inquiry having qualitative characteristics. In this study, these skills are seen among Malaysian art teachers in secondary schools. Quality assessment depends on the evaluator who has the ability of some aspects. Among these are qualitative nuances experiences as well as ability to…

A Guide to Writing a Qualitative Systematic Review Protocol to Enhance Evidence-Based Practice in Nursing and Health Care.

PubMed

Butler, Ashleigh; Hall, Helen; Copnell, Beverley

2016-06-01

The qualitative systematic review is a rapidly developing area of nursing research. In order to present trustworthy, high-quality recommendations, such reviews should be based on a review protocol to minimize bias and enhance transparency and reproducibility. Although there are a number of resources available to guide researchers in developing a quantitative review protocol, very few resources exist for qualitative reviews. To guide researchers through the process of developing a qualitative systematic review protocol, using an example review question. The key elements required in a systematic review protocol are discussed, with a focus on application to qualitative reviews: Development of a research question; formulation of key search terms and strategies; designing a multistage review process; critical appraisal of qualitative literature; development of data extraction techniques; and data synthesis. The paper highlights important considerations during the protocol development process, and uses a previously developed review question as a working example. This paper will assist novice researchers in developing a qualitative systematic review protocol. By providing a worked example of a protocol, the paper encourages the development of review protocols, enhancing the trustworthiness and value of the completed qualitative systematic review findings. Qualitative systematic reviews should be based on well planned, peer reviewed protocols to enhance the trustworthiness of results and thus their usefulness in clinical practice. Protocols should outline, in detail, the processes which will be used to undertake the review, including key search terms, inclusion and exclusion criteria, and the methods used for critical appraisal, data extraction and data analysis to facilitate transparency of the review process. Additionally, journals should encourage and support the publication of review protocols, and should require reference to a protocol prior to publication of the review results. © 2016 Sigma Theta Tau International.

Commentary: Writing and Evaluating Qualitative Research Reports.

PubMed

Wu, Yelena P; Thompson, Deborah; Aroian, Karen J; McQuaid, Elizabeth L; Deatrick, Janet A

2016-06-01

To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field's ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A Qualitative Analysis of College Women's Leaving Processes in Abusive Relationships

ERIC Educational Resources Information Center

Edwards, Katie M.; Murphy, Megan J.; Tansill, Erin C.; Myrick, Christina; Probst, Danielle R.; Corsa, Rebecca; Gidycz, Christine A.

2012-01-01

Objective: This study assessed the process of leaving an abusive dating relationship utilizing a qualitative design. Methods: Participants included 123 college women in abusive dating relationships who participated at the beginning and end of a 10-week academic quarter. Results: Qualitative content analyses were used to analyze the transcribed…

The Use of a Checklist and Qualitative Notebooks for an Interactive Process of Teaching and Learning Qualitative Research

ERIC Educational Resources Information Center

Frels, Rebecca K.; Sharma, Bipin; Onwuegbuzie, Anthony J.; Leech, Nancy L.; Stark, Marcella D.

2011-01-01

From the perspective of doctoral students and instructors, we explain a developmental, interactive process based upon the Checklist for Qualitative Data Collection, Data Analysis, and Data Interpretation (Onwuegbuzie, 2010) for students' writing assignments regarding: (a) the application of conceptual knowledge for collecting, analyzing, and…

[Qualitative research methodology in health care].

PubMed

Bedregal, Paula; Besoain, Carolina; Reinoso, Alejandro; Zubarew, Tamara

2017-03-01

Health care research requires different methodological approaches such as qualitative and quantitative analyzes to understand the phenomena under study. Qualitative research is usually the least considered. Central elements of the qualitative method are that the object of study is constituted by perceptions, emotions and beliefs, non-random sampling by purpose, circular process of knowledge construction, and methodological rigor throughout the research process, from quality design to the consistency of results. The objective of this work is to contribute to the methodological knowledge about qualitative research in health services, based on the implementation of the study, “The transition process from pediatric to adult services: perspectives from adolescents with chronic diseases, caregivers and health professionals”. The information gathered through the qualitative methodology facilitated the understanding of critical points, barriers and facilitators of the transition process of adolescents with chronic diseases, considering the perspective of users and the health team. This study allowed the design of a transition services model from pediatric to adult health services based on the needs of adolescents with chronic diseases, their caregivers and the health team.

Reasoning process characteristics in the diagnostic skills of beginner, competent, and expert dentists.

PubMed

Crespo, Kathleen E; Torres, José E; Recio, María E

2004-12-01

The purpose of this study was to evaluate qualitative differences in the diagnostic reasoning process at different developmental stages of expertise. A qualitative design was used to study cognitive processes that characterize the diagnosis of oral disease at the stages of beginner (five junior students who had passed the NBDE I), competent (five GPR first-year residents), and expert dentists (five general dentists with ten or more years of experience). Individually, each participant was asked to determine the diagnosis of an oral condition based on a written clinical case, using the think aloud technique and retrospective reports. A subsequent interview was conducted to obtain the participants' diagnostic process model and pathophysiology of the case. The analysis of the verbal protocols indicated that experts referred to the patient's sociomedical context more frequently, demonstrated better organization of ideas, could determine key clinical findings, and had an ability to plan for the search of pertinent information. Fewer diagnostic hypotheses were formulated by participants who used forward reasoning, independent of the stage of development. Beginners requested additional diagnostic aids (radiographs, laboratory tests) more frequently than the competent/expert dentists. Experts recalled typical experiences with patients, while competent/beginner dentists recalled information from didactic courses. Experts evidenced cognitive diagnostic schemas that integrate pathophysiology of disease, while competent and beginner participants had not achieved this integration. We conclude that expert performance is a combination of a knowledge base, reasoning skills, and an accumulation of experiences with patients that is qualitatively different from that of competent and beginner dentists. It is important for dental education to emphasize the teaching of cognitive processes and to incorporate a wide variety of clinical experiences in addition to the teaching of disciplinary content.

Exploring how ward staff engage with the implementation of a patient safety intervention: a UK-based qualitative process evaluation.

PubMed

Sheard, Laura; Marsh, Claire; O'Hara, Jane; Armitage, Gerry; Wright, John; Lawton, Rebecca

2017-07-13

A patient safety intervention was tested in a 33-ward randomised controlled trial. No statistically significant difference between intervention and control wards was found. We conducted a process evaluation of the trial and our aim in this paper is to understand staff engagement across the 17 intervention wards. Large qualitative process evaluation of the implementation of a patient safety intervention. National Health Service staff based on 17 acute hospital wards located at five hospital sites in the North of England. We concentrate on three sources here: (1) analysis of taped discussion between ward staff during action planning meetings; (2) facilitators' field notes and (3) follow-up telephone interviews with staff focusing on whether action plans had been achieved. The analysis involved the use of pen portraits and adaptive theory. First, there were palpable differences in the ways that the 17 ward teams engaged with the key components of the intervention. Five main engagement typologies were evident across the life course of the study: consistent, partial, increasing, decreasing and disengaged. Second, the intensity of support for the intervention at the level of the organisation does not predict the strength of engagement at the level of the individual ward team. Third, the standardisation of facilitative processes provided by the research team does not ensure that implementation standardisation of the intervention occurs by ward staff. A dilution of the intervention occurred during the trial because wards engaged with Patient Reporting and Action for a Safe Environment (PRASE) in divergent ways, despite the standardisation of key components. Facilitative processes were not sufficiently adequate to enable intervention wards to successfully engage with PRASE components. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

1988-01-01

Discusses qualitative research and its application to educational evaluation. Approaches discussed include the following: (1) ethnography; (2) naturalistic inquiry; (3) generic pragmatic (sociological) inquiry; (4) connoisseurship/criticism; (5) metaphors; and (6) phenomenography. (FMW)

Performance evaluation methodology for historical document image binarization.

PubMed

Ntirogiannis, Konstantinos; Gatos, Basilis; Pratikakis, Ioannis

2013-02-01

Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization evaluation methodology for historical handwritten/machine-printed document images. In the proposed evaluation scheme, the recall and precision evaluation measures are properly modified using a weighting scheme that diminishes any potential evaluation bias. Additional performance metrics of the proposed evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based evaluation measures demonstrate the validity of the proposed evaluation scheme.

Telephone-delivered problem-solving training after mild traumatic brain injury: Qualitative analysis of service members' perceptions.

PubMed

Brockway, Jo Ann; St De Lore, Jef; Fann, Jesse R; Hart, Tessa; Hurst, Samantha; Fey-Hinckley, Sara; Savage, Jocelyn; Warren, Michael; Bell, Kathleen R

2016-08-01

The purpose of this study was to identify the specific reasons for service members' satisfaction or dissatisfaction with problem-solving training (PST), telephone delivery, and other aspects of a telephone-delivered PST intervention in order to determine what might enhance this approach for future clinical use. Standard qualitative methods were employed, using a "process" coding strategy to explore the conceptual perceptions of the intervention experience as suggested by the data recorded from final telephone interviews of 80 service members who participated in a randomized controlled trial evaluating the efficacy of telephone-delivered PST after having sustained concussions or mild traumatic brain injuries during recent (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Australian health promotion practitioners' perceptions on evaluation of empowerment and participation.

PubMed

Brandstetter, Susanne; McCool, Megan; Wise, Marilyn; Loss, Julika

2014-03-01

Although participation and empowerment are hallmarks of the WHO vision of health promotion, it is acknowledged that they are difficult to evaluate. Devising adequate study designs, indicators and methods for the assessment of participation and empowerment should consider the experiences, concerns and constraints of health promotion practitioners. The aim of this study was to investigate health promotion practitioners' perspectives on general and methodological aspects of evaluation of empowerment and participation. Semi-structured interviews were conducted with 17 experienced practitioners in community-based health promotion in New South Wales, Australia. The interviews covered benefits of and barriers to the evaluation of participation and empowerment, key indicators and methodological aspects. Interview transcripts were examined using thematic content analysis. The idea of evaluating empowerment and participation is supported by health promotion practitioners. Including indicators of empowerment and participation in the evaluation could also emphasise-to practitioners and citizens alike-the value of involving and enabling community members. The interviews highlighted the importance of a receptive environment for evaluation of empowerment and participation to take root. The resistance of health authorities towards empowerment indicators was seen as a challenge for funding evaluations. Community members should be included in the evaluation process, although interviewees found it difficult to do so in a representative way and empowering approach. Qualitative methods might capture best whether empowerment and participation have occurred in a programme. The positive experiences that the interviewees made with innovative qualitative methods encourage further investment in developing new research designs.

Designing a ticket to ride with the Cognitive Work Analysis Design Toolkit.

PubMed

Read, Gemma J M; Salmon, Paul M; Lenné, Michael G; Jenkins, Daniel P

2015-01-01

Cognitive work analysis has been applied in the design of numerous sociotechnical systems. The process used to translate analysis outputs into design concepts, however, is not always clear. Moreover, structured processes for translating the outputs of ergonomics methods into concrete designs are lacking. This paper introduces the Cognitive Work Analysis Design Toolkit (CWA-DT), a design approach which has been developed specifically to provide a structured means of incorporating cognitive work analysis outputs in design using design principles and values derived from sociotechnical systems theory. This paper outlines the CWA-DT and describes its application in a public transport ticketing design case study. Qualitative and quantitative evaluations of the process provide promising early evidence that the toolkit fulfils the evaluation criteria identified for its success, with opportunities for improvement also highlighted. The Cognitive Work Analysis Design Toolkit has been developed to provide ergonomics practitioners with a structured approach for translating the outputs of cognitive work analysis into design solutions. This paper demonstrates an application of the toolkit and provides evaluation findings.

The Oregon migrant farmworker community: an evolving model for participatory research.

PubMed Central

McCauley, L A; Beltran, M; Phillips, J; Lasarev, M; Sticker, D

2001-01-01

Migrant farmworker communities present distinct challenges that require new approaches for community participation in research. In the State of Oregon an agency that advocates for the migrant farmworker community has collaborated successfully with university researchers to implement a research program directed to reducing pesticide exposures among the children of migrant farmworkers. The research process has included both qualitative research methods with members of the community and quantitative approaches to measure pesticide dust residues in homes, biomarkers of pesticide exposure, and effects on health. A committee of university and community stakeholders advises the research. Evaluative processes have been initiated to assess the effectiveness of the participatory model used in this project. The components of the preliminary process evaluation and results are presented. Evaluative data show that researchers and community members differ on perceptions of community involvement and the extent to which communication problems have been resolved between the two groups. Suggestions for improved community involvement and communication are given. PMID:11427395

Cooking, Healthy Eating, Fitness and Fun (CHEFFs): Qualitative Evaluation of a Nutrition Education Program for Children Living at Urban Family Homeless Shelters

PubMed Central

Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-01-01

Objectives. We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. Methods. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants’ understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. Results. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children’s knowledge and understanding of content, (2) children’s shift in attitudes or intentions, and (3) interpretations through children’s life experience. Food insecurity as well as shelter food service and policies were important influences on children’s choices, hunger, and sense of well-being. Conclusions. Children’s experiences highlighted the need to advocate for shelter policies that adequately provide for children’s nutritional and physical activity requirements and foster academic development. PMID:24148062

Systematic Evaluation and Uncertainty Analysis of the Refuse-Derived Fuel Process in Taiwan.

PubMed

Chang, Ying-Hsi; Chang, Ni-Bin; Chen, W C

1998-06-01

In the last few years, Taiwan has set a bold agenda in solid waste recycling and incineration programs. Not only were the recycling activities and incineration projects promoted by government agencies, but the related laws and regulations were continuously promulgated by the Legislative Yen. The solid waste presorting process that is to be considered prior to the existing incineration facilities has received wide attention. This paper illustrates a thorough evaluation for the first refuse-derived fuel pilot process from both quantitative and qualitative aspects. The process is to be installed and integrated with a large-scale municipal incinerator. This pilot process, developed by an engineering firm in Tainan County, consists of standard unit operations of shredding, magnetic separation, trommel screening, and air classification. A series of sampling and analyses were initialized in order to characterize its potentials in the solid waste management system. The probabilistic modeling for various types o f waste pro perties derived in this analysis may provide a basic understanding of system reliability.

Multi-indicator Evaluation System for Broadsword, Rod, Sword and Spear Athletes Based on Analytic Hierarchy Process

NASA Astrophysics Data System (ADS)

Luo, Lin

2017-08-01

In the practical selection of Wushu athletes, the objective evaluation of the level of athletes lacks sufficient technical indicators and often relies on the coach’s subjective judgments. It is difficult to accurately and objectively reflect the overall quality of the athletes without a fully quantified indicator system, thus affecting the level improvement of Wushu competition. The analytic hierarchy process (AHP) is a systemic analysis method combining quantitative and qualitative analysis. This paper realizes structured, hierarchized and quantified decision-making process of evaluating broadsword, rod, sword and spear athletes in the AHP. Combing characteristics of the athletes, analysis is carried out from three aspects, i.e., the athlete’s body shape, physical function and sports quality and 18 specific evaluation indicators established, and then combining expert advice and practical experience, pairwise comparison matrix is determined, and then the weight of the indicators and comprehensive evaluation coefficient are obtained to establish the evaluation model for the athletes, thus providing a scientific theoretical basis for the selection of Wushu athletes. The evaluation model proposed in this paper has realized the evaluation system of broadsword, rod, sword and spear athletes, which has effectively improved the scientific level of Wushu athletes selection in practical application.

Interdisciplinary Practice Models for Older Adults With Back Pain: A Qualitative Evaluation.

PubMed

Salsbury, Stacie A; Goertz, Christine M; Vining, Robert D; Hondras, Maria A; Andresen, Andrew A; Long, Cynthia R; Lyons, Kevin J; Killinger, Lisa Z; Wallace, Robert B

2018-03-19

Older adults seek health care for low back pain from multiple providers who may not coordinate their treatments. This study evaluated the perceived feasibility of a patient-centered practice model for back pain, including facilitators for interprofessional collaboration between family medicine physicians and doctors of chiropractic. This qualitative evaluation was a component of a randomized controlled trial of 3 interdisciplinary models for back pain management: usual medical care; concurrent medical and chiropractic care; and collaborative medical and chiropractic care with interprofessional education, clinical record exchange, and team-based case management. Data collection included clinician interviews, chart abstractions, and fieldnotes analyzed with qualitative content analysis. An organizational-level framework for dissemination of health care interventions identified norms/attitudes, organizational structures and processes, resources, networks-linkages, and change agents that supported model implementation. Clinicians interviewed included 13 family medicine residents and 6 chiropractors. Clinicians were receptive to interprofessional education, noting the experience introduced them to new colleagues and the treatment approaches of the cooperating profession. Clinicians exchanged high volumes of clinical records, but found the logistics cumbersome. Team-based case management enhanced information flow, social support, and interaction between individual patients and the collaborating providers. Older patients were viewed positively as change agents for interprofessional collaboration between these provider groups. Family medicine residents and doctors of chiropractic viewed collaborative care as a useful practice model for older adults with back pain. Health care organizations adopting medical and chiropractic collaboration can tailor this general model to their specific setting to support implementation.

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies.

PubMed

Esteban, Eva; Coenen, Michaela; Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Leonardi, Matilde; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C; Kovačič, Dare S; Ivandic, Ivana; Sabariego, Carla

2018-05-18

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe.

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies

PubMed Central

Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C.; Kovačič, Dare S.; Ivandic, Ivana

2018-01-01

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe. PMID:29783671

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety

PubMed Central

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative–reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research. PMID:26297629

How do health service professionals consider human factors when purchasing interactive medical devices? A qualitative interview study.

PubMed

Vincent, Christopher James; Blandford, Ann

2017-03-01

We present findings of a UK study into how those involved in purchasing interactive medical devices go about evaluating usability, the challenges that arise, and opportunities for improvement. The study focused on procurement of infusion devices because these are used by various professionals across healthcare. A semi-structured interview study was carried out involving a range of stakeholders (20 in total) involved in or impacted by medical device procurement. Data was analysed using thematic analysis, a qualitative method designed to support the identification, analysis and reporting of patterns. In principle, health service purchasing was found to accommodate consideration of equipment usability. In practice, the evaluation process was driven primarily by engineering standards; assessment of local needs did not accommodate substantive assessment of usability; and choice was limited by the availability of equipment on the marketplace. We discuss ways in which purchasing could be improved through techniques that account for social circumstances. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of an implementation model: a national investigation of VA residential programs.

PubMed

Cook, Joan M; Dinnen, Stephanie; Coyne, James C; Thompson, Richard; Simiola, Vanessa; Ruzek, Josef; Schnurr, Paula P

2015-03-01

This national investigation utilizes qualitative data to evaluate an implementation model regarding factors influencing provider use of two evidence-based treatments for posttraumatic stress disorder (PTSD). Semi-structured qualitative interviews with 198 mental health providers from 38 Department of Veterans Affairs' (VA) residential treatment programs were used to explore these issues regarding prolonged exposure (PE) and cognitive processing therapy (CPT) in VA residential PTSD programs. Several unique and some overlapping predictors emerged. Leadership was viewed as an influence on implementation for both CPT and PE, while a lack of dedicated time and resources was viewed as a deterrent for both. Compatibility of CPT with providers' existing practices and beliefs, the ability to observe noticeable patient improvement, a perceived relative advantage of CPT over alternative treatments, and the presence of a supportive peer network emerged as influential on CPT implementation. Leadership was associated with PE implementation. Implications for the design and improvement of training and implementation efforts are discussed.

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety.

PubMed

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative-reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research.

Exploring Operational Test and Evaluation of Unmanned Aircraft Systems: A Qualitative Case Study

NASA Astrophysics Data System (ADS)

Saliceti, Jose A.

The purpose of this qualitative case study was to explore and identify strategies that may potentially remedy operational test and evaluation procedures used to evaluate Unmanned Aircraft Systems (UAS) technology. The sample for analysis consisted of organizations testing and evaluating UASs (e.g., U.S. Air Force, U.S. Navy, U.S. Army, U.S. Marine Corps, U.S. Coast Guard, and Customs Border Protection). A purposeful sampling technique was used to select 15 subject matter experts in the field of operational test and evaluation of UASs. A questionnaire was provided to participants to construct a descriptive and robust research. Analysis of responses revealed themes related to each research question. Findings revealed operational testers utilized requirements documents to extrapolate measures for testing UAS technology and develop critical operational issues. The requirements documents were (a) developed without the contribution of stakeholders and operational testers, (b) developed with vague or unrealistic measures, and (c) developed without a systematic method to derive requirements from mission tasks. Four approaches are recommended to develop testable operational requirements and assist operational testers: (a) use a mission task analysis tool to derive requirements for mission essential tasks for the system, (b) exercise collaboration among stakeholders and testers to ensure testable operational requirements based on mission tasks, (c) ensure testable measures are used in requirements documents, and (d) create a repository list of critical operational issues by mission areas. The preparation of operational test and evaluation processes for UAS technology is not uniform across testers. The processes in place are not standardized, thus test plan preparation and reporting are different among participants. A standard method to prepare and report UAS technology should be used when preparing and reporting on UAS technology. Using a systematic process, such as mission-based test design, resonated among participants as an analytical method to link UAS mission tasks and measures of performance to the capabilities of the system under test when developing operational test plans. Further research should examine system engineering designs for system requirements traceability matrix of mission tasks and subtasks while using an analysis tool that adequately evaluates UASs with an acceptable level of confidence in the results.

Procedure versus process: ethical paradigms and the conduct of qualitative research

PubMed Central

2012-01-01

Background Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Discussion Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic ‘procedural’ resolution. This is not to say that qualitative studies are ‘unethical’ but that their ethical nature can only be safeguarded through the practice of ‘micro-ethics’ based on the judgement and integrity of researchers in the field. Summary This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of ‘empirical ethics’ as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values. PMID:23016663

Qualitative data collection and analysis methods: the INSTINCT trial.

PubMed

Meurer, William J; Frederiksen, Shirley M; Majersik, Jennifer J; Zhang, Lingling; Sandretto, Annette; Scott, Phillip A

2007-11-01

Patient care practices often lag behind current scientific evidence and professional guidelines. The failure of such knowledge translation (KT) efforts may reflect inadequate assessment and management of specific barriers confronting both physicians and patients at the point of treatment level. Effective KT in this setting may benefit from the use of qualitative methods to identify and overcome these barriers. Qualitative methodology allows in-depth exploration of the barriers involved in adopting practice change and has been infrequently used in emergency medicine research. The authors describe the methodology for qualitative analysis within the INcreasing Stroke Treatment through INteractive behavioral Change Tactics (INSTINCT) trial. This includes processes for valid data collection and reliable analysis of the textual data from focus group and interview transcripts. INSTINCT is a 24-hospital, randomized, controlled study that is designed to evaluate a system-based barrier assessment and interactive educational intervention to increase appropriate tissue plasminogen activator (tPA) use in ischemic stroke. Intervention hospitals undergo baseline barrier assessment using both qualitative as well as quantitative (survey) techniques. Investigators obtain data on local barriers to tPA use, as well as information on local attitudes, knowledge, and beliefs regarding acute stroke treatment. Targeted groups at each site include emergency physicians, emergency nurses, neurologists, radiologists, and hospital administrators. Transcript analysis using NVivo7 with a predefined barrier taxonomy is described. This will provide both qualitative insight on thrombolytic use and importance of specific barrier types for each site. The qualitative findings subsequently direct the form of professional education efforts and system interventions at treatment sites.

Focus group interview: an underutilized research technique for improving theory and practice in health education.

PubMed

Basch, C E

1987-01-01

The purpose of this article is to increase awareness about and stimulate interest in using focus group interviews, a qualitative research technique, to advance the state-of-the-art of education and learning about health. After a brief discussion of small group process in health education, features of focus group interviews are presented, and a theoretical framework for planning a focus group study is summarized. Then, literature describing traditional and health-related applications of focus group interviews is reviewed and a synthesis of methodological limitations and advantages of this technique is presented. Implications are discussed regarding: need for more inductive qualitative research in health education; utility of focus group interviews for research and for formative and summative evaluation of health education programs; applicability of marketing research to understanding and influencing consumer behavior, despite notable distinctions between educational initiatives and marketing; and need for professional preparation faculty to consider increasing emphasis on qualitative research methods.

A grounded theory of positive youth development through sport based on results from a qualitative meta-study

PubMed Central

Holt, Nicholas L.; Neely, Kacey C.; Slater, Linda G.; Camiré, Martin; Côté, Jean; Fraser-Thomas, Jessica; MacDonald, Dany; Strachan, Leisha; Tamminen, Katherine A.

2017-01-01

ABSTRACT The overall purpose of this study was to create a model of positive youth development (PYD) through sport grounded in the extant qualitative literature. More specifically, the first objective was to review and evaluate qualitative studies of PYD in sport. The second objective was to analyze and synthesize findings from these studies. Following record identification and screening, 63 articles were retained for analysis. Meta-method analysis revealed strengths of studies were the use of multiple data collection and validity techniques, which produced high-quality data. Weaknesses were limited use of ‘named’ methodologies and inadequate reporting of sampling procedures. Philosophical perspectives were rarely reported, and theory was used sparingly. Results of an inductive meta-data analysis produced three categories: PYD climate (adult relationships, peer relationships, and parental involvement), life skills program focus (life skill building activities and transfer activities), and PYD outcomes (in personal, social, and physical domains). A model that distinguishes between implicit and explicit processes to PYD is presented. PMID:27695511

Patient-focused goal planning process and outcome after spinal cord injury rehabilitation: quantitative and qualitative audit.

PubMed

Byrnes, Michelle; Beilby, Janet; Ray, Patricia; McLennan, Renee; Ker, John; Schug, Stephan

2012-12-01

To evaluate the process and outcome of a multidisciplinary inpatient goal planning rehabilitation programme on physical, social and psychological functioning for patients with spinal cord injury. Clinical audit: quantitative and qualitative analyses. Specialist spinal injury unit, Perth, Australia. Consecutive series of 100 newly injured spinal cord injury inpatients. MAIN MEASURE(S): The Needs Assessment Checklist (NAC), patient-focused goal planning questionnaire and goal planning progress form. The clinical audit of 100 spinal cord injured patients revealed that 547 goal planning meetings were held with 8531 goals stipulated in total. Seventy-five per cent of the goals set at the first goal planning meeting were achieved by the second meeting and the rate of goal achievements at subsequent goal planning meetings dropped to 56%. Based on quantitative analysis of physical, social and psychological functioning, the 100 spinal cord injury patients improved significantly from baseline to discharge. Furthermore, qualitative analysis revealed benefits consistently reported by spinal cord injury patients of the goal planning rehabilitation programme in improvements to their physical, social and psychological adjustment to injury. The findings of this clinical audit underpin the need for patient-focused goal planning rehabilitation programmes which are tailored to the individual's needs and involve a comprehensive multidisciplinary team.

Embedding technology into inter-professional best practices in home safety evaluation.

PubMed

Burns, Suzanne Perea; Pickens, Noralyn Davel

2017-08-01

To explore inter-professional home evaluators' perspectives and needs for building useful and acceptable decision-support tools for the field of home modifications. Twenty semi-structured interviews were conducted with a range of home modification professionals from different regions of the United States. The interview transcripts were analyzed with a qualitative, descriptive, perspective approach. Technology supports current best practice and has potential to inform decision making through features that could enhance home evaluation processes, quality, efficiency and inter-professional communication. Technological advances with app design have created numerous opportunities for the field of home modifications. Integrating technology and inter-professional best practices will improve home safety evaluation and intervention development to meet client-centred and societal needs. Implications for rehabilitation Understanding home evaluators technology needs for home safety evaluations contributes to the development of app-based assessments. Integrating inter-professional perspectives of best practice and technological needs in an app for home assessments improves processes. Novice and expert home evaluators would benefit from decision support systems embedded in app-based assessments. Adoption of app-based assessment would improve efficiency while remaining client-centred.

Nursing students' spiritual talks with patients - evaluation of a partnership learning programme in clinical practice.

PubMed

Strand, Kari; Carlsen, Liv B; Tveit, Bodil

2017-07-01

To evaluate the impact of a partnership learning programme designed to support undergraduate nursing students' competence in speaking with patients about spiritual issues. Spiritual care is an oft-neglected and underexposed area of nursing practice. Despite the increasing amount of research on spiritual care in educational programmes, little is known about nursing students' experiences with existential/spiritual talks and the process of learning about spiritual care in the clinical placement. The project used a qualitative evaluation design to evaluate the impact of a partnership-initiated intervention focusing on student learning of spiritual care in a hospital ward. Data were collected through three focus group interviews with bachelor of nursing students from one Norwegian university college and supplemented with notes. Data were analysed by means of qualitative interpretative content analysis. The intervention was found to enhance students' competence in spiritual talks. The students developed an extended understanding of spirituality, became more confident in speaking with patients about spiritual issues and more active in grasping opportunities to provide spiritual care. Participating nurses significantly contributed to the students' learning process by being role models, mentoring the students and challenging them to overcome barriers in speaking with patients about spiritual issues. The partnership learning programme proved to be a useful model in terms of enhancing students' confidence in speaking with patients about spiritual concerns. Collaboration between nursing university colleges and clinical placements could help nursing students and clinical nurses to develop competencies in spiritual care and bridge the gap between academic education and clinical education, to the benefit of both. © 2016 John Wiley & Sons Ltd.

The OPERA trial: a protocol for the process evaluation of a randomised trial of an exercise intervention for older people in residential and nursing accommodation

PubMed Central

2011-01-01

Background The OPERA trial is large cluster randomised trial testing a physical activity intervention to address depression amongst people living in nursing and residential homes for older people. A process evaluation was commissioned alongside the trial and we report the protocol for this process evaluation. Challenges included the cognitive and physical ability of the participants, the need to respect the privacy of all home residents, including study non-participants, and the physical structure of the homes. Evaluation activity had to be organised around the structured timetable of homes, leaving limited opportunities for data collection. The aims of this process evaluation are to provide findings that will assist in the interpretation of the clinical trial results, and to inform potential implementation of the physical activity intervention on a wider scale. Methods/design Quantitative data on recruitment of homes and individuals is being collected. For homes in the intervention arm, data on dose and fidelity of the intervention delivered; including individual rates of participation in exercise classes are collected. In the control homes, uptake and delivery of depression awareness training is monitored. These data will be combined with qualitative data from an in-depth study of a purposive sample of eight homes (six intervention and two control). Discussion Although process evaluations are increasingly funded alongside trials, it is still rare to see the findings published, and even rarer to see the protocol for such an evaluation published. Process evaluations have the potential to assist in interpreting and understanding trial results as well as informing future roll-outs of interventions. If such evaluations are funded they should also be reported and reviewed in a similar way to the trial outcome evaluation. Trial Registration ISRCTN No: ISRCTN43769277 PMID:21288341

Making Sense of Alternative Assessment in a Qualitative Evaluation System

ERIC Educational Resources Information Center

Rojas Serrano, Javier

2017-01-01

In a Colombian private English institution, a qualitative evaluation system has been incorporated. This type of evaluation poses challenges to students who have never been evaluated through a system that eliminates exams or quizzes and, as a consequence, these students have to start making sense of it. This study explores the way students face the…

Online versus Paper Evaluations: Differences in Both Quantitative and Qualitative Data

ERIC Educational Resources Information Center

Burton, William B.; Civitano, Adele; Steiner-Grossman, Penny

2012-01-01

This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The…

Research on the use of data fusion technology to evaluate the state of electromechanical equipment

NASA Astrophysics Data System (ADS)

Lin, Lin

2018-04-01

Aiming at the problems of different testing information modes and the coexistence of quantitative and qualitative information in the state evaluation of electromechanical equipment, the paper proposes the use of data fusion technology to evaluate the state of electromechanical equipment. This paper introduces the state evaluation process of mechanical and electrical equipment in detail, uses the D-S evidence theory to fuse the decision-making layers of mechanical and electrical equipment state evaluation and carries out simulation tests. The simulation results show that it is feasible and effective to apply the data fusion technology to the state evaluation of the mechatronic equipment. After the multiple decision-making information provided by different evaluation methods are fused repeatedly and the useful information is extracted repeatedly, the fuzziness of judgment can be reduced and the state evaluation Credibility.

Mastoid foramen, mastoid emissary vein and clinical implications in neurosurgery.

PubMed

Hampl, Martin; Kachlik, David; Kikalova, Katerina; Riemer, Roxane; Halaj, Matej; Novak, Vlastimil; Stejskal, Premysl; Vaverka, Miroslav; Hrabalek, Lumir; Krahulik, David; Nanka, Ondrej

2018-05-20

Mastoid emissary vein is especially important from the neurosurgical point of view, because it is located in variable number in the area of the occipitomastoid suture and it can become a source of significant bleeding in surgical approaches through the mastoid process, especially in retrosigmoid craniotomy, which is used for approaches to pathologies localized in the cerebellopontine angle. Ideal imaging method for diagnosis of these neglected structures when planning a surgical approach is high-resolution computed tomography. The aim of this work was to provide detailed information about this issue. We studied a group of 295 skulls obtained from collections of five anatomy departments and the National Museum. Both quantitative and qualitative parameters of the mastoid foramen were evaluated depending on side of appearance and gender. Individual distances of the mastoid foramen from clearly defined surface landmarks (asterion, apex of mastoid process, foramen magnum) and other anatomical structures closely related to this issue (width of groove for sigmoid sinus, diameters of internal and external openings of mastoid foramen) were statistically processed. The most frequently represented type of the mastoid foramen is type II by Louis (41.2%). The differences between right and left sides were not statistically significant. In men there was a higher number of openings on the right side and in qualitative parameters the type III and IV predominated, whereas in women the types I and II were more frequent. In men, greater distances from the mastoid foramen were observed when evaluating qualitative parameters for defined surface landmarks. Mean size of the external opening diameter was 1.3 mm; however, several openings measured up to 7 mm. Despite excellent knowledge of anatomy, however, good pre-operative examination using imaging methods and mastering of microsurgical techniques create the base for successful treatment of pathological structures in these anatomically complex areas.

Risk management of key issues of FPSO

NASA Astrophysics Data System (ADS)

Sun, Liping; Sun, Hai

2012-12-01

Risk analysis of key systems have become a growing topic late of because of the development of offshore structures. Equipment failures of offloading system and fire accidents were analyzed based on the floating production, storage and offloading (FPSO) features. Fault tree analysis (FTA), and failure modes and effects analysis (FMEA) methods were examined based on information already researched on modules of relex reliability studio (RRS). Equipment failures were also analyzed qualitatively by establishing a fault tree and Boolean structure function based on the shortage of failure cases, statistical data, and risk control measures examined. Failure modes of fire accident were classified according to the different areas of fire occurrences during the FMEA process, using risk priority number (RPN) methods to evaluate their severity rank. The qualitative analysis of FTA gave the basic insight of forming the failure modes of FPSO offloading, and the fire FMEA gave the priorities and suggested processes. The research has practical importance for the security analysis problems of FPSO.

Organizational and training factors that promote team science: A qualitative analysis and application of theory to the National Institutes of Health's BIRCWH career development program.

PubMed

Guise, Jeanne-Marie; Winter, Susan; Fiore, Stephen M; Regensteiner, Judith G; Nagel, Joan

2017-04-01

Research organizations face challenges in creating infrastructures that cultivates and sustains interdisciplinary team science. The objective of this paper is to identify structural elements of organizations and training that promote team science. We qualitatively analyzed the National Institutes of Health's Building Interdisciplinary Research Careers in Women's Health, K12 using organizational psychology and team science theories to identify organizational design factors for successful team science and training. Seven key design elements support team science: (1) semiformal meta-organizational structure, (2) shared context and goals, (3) formal evaluation processes, (4) meetings to promote communication, (5) role clarity in mentoring, (6) building interpersonal competencies among faculty and trainees, and (7) designing promotion and tenure and other organizational processes to support interdisciplinary team science. This application of theory to a long-standing and successful program provides important foundational elements for programs and institutions to consider in promoting team science.

The Concept Maps as a Didactic Resource Tool of Meaningful Learning in Astronomy Themes

NASA Astrophysics Data System (ADS)

Silveira, Felipa Pacífico Ribeiro de Assis; Mendonça, Conceição Aparecida Soares

2015-07-01

This article presents the results of an investigation that sought to understand the performance of the conceptual map (MC) as a teaching resource facilitator of meaningful learning of scientific concepts on astronomical themes, developed with elementary school students. The methodology employed to obtain and process the data was based on a quantitative and qualitative approach. On the quantitative level we designed a quasi-experimental research with a control group that did not use the MC and an experimental group that used the MC, both being evaluated in the beginning and end of the process. In this case, the performance of both groups is displayed in a descriptive and analytical study. In the qualitative approach, the MCs were interpreted using the structuring and assigned meanings shared by the student during his/her presentation. The results demonstrated through the improvement of qualifications that the MC made a difference in conceptual learning and in certain skills revealed by learning indicators.

Refining an intervention for students with emotional disturbance using qualitative parent and teacher data

PubMed Central

Nese, Rhonda N.T.; Palinkas, Lawrence A.; Ruppert, Traci

2017-01-01

Intensive supports are needed for students with emotional disturbance during high-risk transitions. Such interventions are most likely to be successful if they address stakeholder perspectives during the development process. This paper discusses qualitative findings from an iterative intervention development project designed to incorporate parent and teacher feedback early in the development process with applications relevant to the adoption of new programs. Using maximum variation purposive sampling, we solicited feedback from five foster/kinship parents, four biological parents and seven teachers to evaluate the feasibility and utility of the Students With Involved Families and Teachers (SWIFT) intervention in home and school settings. SWIFT provides youth and parent skills coaching in the home and school informed by weekly student behavioral progress monitoring. Participants completed semi-structured interviews that were transcribed and coded via an independent co-coding strategy. The findings provide support for school-based interventions involving family participation and lessons to ensure intervention success. PMID:28966422

Implementation of newly adopted technology in acute care settings: a qualitative analysis of clinical staff

PubMed Central

Langhan, Melissa L.; Riera, Antonio; Kurtz, Jordan C.; Schaeffer, Paula; Asnes, Andrea G.

2015-01-01

Objective Technologies are not always successfully implemented into practise. We elicited experiences of acute care providers with the introduction of technology and identified barriers and facilitators in the implementation process. Methods A qualitative study using one-on-one interviews among a purposeful sample of 19 physicians and nurses within ten emergency departments and intensive care units was performed. Grounded theory, iterative data analysis and the constant comparative method were used to inductively generate ideas and build theories. Results Five major categories emerged: decision-making factors, the impact on practise, technology's perceived value, facilitators and barriers to implementation. Barriers included negative experiences, age, infrequent use, and access difficulties. A positive outlook, sufficient training, support staff, and user friendliness were facilitators. Conclusions This study describes strategies implicated in the successful implementation of newly adopted technology in acute care settings. Improved implementation methods and evaluation of implementation processes are necessary for successful adoption of new technology. PMID:25367721

Development of the pediatric quality of life inventory neurofibromatosis type 1 module items for children, adolescents and young adults: qualitative methods.

PubMed

Nutakki, Kavitha; Varni, James W; Steinbrenner, Sheila; Draucker, Claire B; Swigonski, Nancy L

2017-03-01

Health-related quality of life (HRQOL) is arguably one of the most important measures in evaluating effectiveness of clinical treatments. At present, there is no disease-specific outcome measure to assess the HRQOL of children, adolescents and young adults with Neurofibromatosis Type 1 (NF1). This study aimed to develop the items and support the content validity for the Pediatric Quality of Life Inventory™ (PedsQL™) NF1 Module for children, adolescents and young adults. The iterative process included multiphase qualitative methods including a literature review, survey of expert opinions, semi-structured interviews, cognitive interviews and pilot testing. Fifteen domains were derived from the qualitative methods, with content saturation achieved, resulting in 115 items. The domains include skin, pain, pain impact, pain management, cognitive functioning, speech, fine motor, balance, vision, perceived physical appearance, communication, worry, treatment, medicines and gastrointestinal symptoms. This study is limited because all participants are recruited from a single-site. Qualitative methods support the content validity for the PedsQL™ NF1 Module for children, adolescents and young adults. The PedsQL™ NF1 Module is now undergoing national multisite field testing for the psychometric validation of the instrument development.

The role of stressors and psychosocial variables in the stress process: a study of chronic caregiver stress.

PubMed

Vedhara, K; Shanks, N; Anderson, S; Lightman, S

2000-01-01

An investigation was conducted 1) to examine the relative importance of stressor types (ie, daily hassles, caregiving-specific stressors, and life events) on the stress response, 2) to assess the stability of relationships between psychosocial variables and stress over a 6-month period, and 3) to explore how the nature and magnitude of the contributions made by stressors and psychosocial factors to the stress process varied according to the qualitative characteristics of the stress response (ie, anxiety, depression, and stress). Fifty spousal caregivers of patients with dementia were recruited and asked to participate in a detailed psychosocial evaluation at 3-month intervals; the evaluation involved measurement of stressor frequency, psychosocial variables, and indices of the stress response (ie, anxiety, depression, and stress). The data revealed that the effects of stressors and psychosocial factors on the stress response were considerable (accounting for 49-63% of the variance in stress response measures). Furthermore, there was some evidence of stability in the effects of the stressor and mediator variables on the stress response. Specifically, the contributions of life events and caregiver difficulties were largely consistent at both 3 and 6 months, and the psychosocial factor of "reactive coping and self-appraisal" influenced all three stress response indices at both 3 and 6 months. There is some evidence of stability in the effects of stressors and psychosocial variables on the stress process over a 6-month period. However, it would also seem that the nature of the stress process differs according to the qualitative characteristics of the stress response.

Protocol for process evaluation of a randomised controlled trial of family-led rehabilitation post stroke (ATTEND) in India

PubMed Central

Liu, Hueiming; Lindley, Richard; Alim, Mohammed; Felix, Cynthia; Gandhi, Dorcas B C; Verma, Shweta J; Tugnawat, Deepak Kumar; Syrigapu, Anuradha; Ramamurthy, Ramaprabhu Krishnappa; Pandian, Jeyaraj D; Walker, Marion; Forster, Anne; Anderson, Craig S; Langhorne, Peter; Murthy, Gudlavalleti Venkata Satyanarayana; Shamanna, Bindiganavale Ramaswamy; Hackett, Maree L; Maulik, Pallab K; Harvey, Lisa A; Jan, Stephen

2016-01-01

Introduction We are undertaking a randomised controlled trial (fAmily led rehabiliTaTion aftEr stroke in INDia, ATTEND) evaluating training a family carer to enable maximal rehabilitation of patients with stroke-related disability; as a potentially affordable, culturally acceptable and effective intervention for use in India. A process evaluation is needed to understand how and why this complex intervention may be effective, and to capture important barriers and facilitators to its implementation. We describe the protocol for our process evaluation to encourage the development of in-process evaluation methodology and transparency in reporting. Methods and analysis The realist and RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) frameworks informed the design. Mixed methods include semistructured interviews with health providers, patients and their carers, analysis of quantitative process data describing fidelity and dose of intervention, observations of trial set up and implementation, and the analysis of the cost data from the patients and their families perspective and programme budgets. These qualitative and quantitative data will be analysed iteratively prior to knowing the quantitative outcomes of the trial, and then triangulated with the results from the primary outcome evaluation. Ethics and dissemination The process evaluation has received ethical approval for all sites in India. In low-income and middle-income countries, the available human capital can form an approach to reducing the evidence practice gap, compared with the high cost alternatives available in established market economies. This process evaluation will provide insights into how such a programme can be implemented in practice and brought to scale. Through local stakeholder engagement and dissemination of findings globally we hope to build on patient-centred, cost-effective and sustainable models of stroke rehabilitation. Trial registration number CTRI/2013/04/003557. PMID:27633636

Meta-evaluation of a participatory process in the strengthening of municipal management

PubMed Central

de Almeida, Cristiane Andrea Locatelli; Tanaka, Oswaldo Yoshimi

2017-01-01

ABSTRACT OBJECTIVE To evaluate, with a focus on participation, an evaluation process developed by municipal managers and administrators of a health region in the state of São Paulo, considering the need for theoretical reflection on participatory health practices in the Brazilian context. METHODS Qualitative research that used the framework developed by Daigneault and Jacob (2009) to analyze the empirical material, encompassing three dimensions of participation: control of the evaluation process, diversity of participants, and extent of their involvement. We highlighted decisions or contextual aspects that deepened or limited the participatory option in the process under study. RESULTS We identified the presence and important performance of stakeholders who are “not specialists in evaluation”, through participation both in the direction of the evaluation process and in its distinct stages. The formed group started from their own annoyances added to the need for information and reflection to define the subject and scope of the evaluation; the use of the process planned by them guided the definition of the data to be collected and the format of result dissemination; the empirical material analysis was undertaken jointly by the participants. Regarding the third dimension, a limitation was identified regarding the diversity of actors involved due to the prioritization of the possibility of in-depth work with a fixed group of managers. CONCLUSIONS It is stated that there is no “ideal participation model” for evaluations. In certain contexts and structures, real opportunities for participation – even if they seem fragile at first sight – should be leveraged, and that requires flexibility and critical reflection on the part of those responsible for the evaluation processes to undertake the necessary adjustments. PMID:29166448

A Qualitative Study of Industry and Air Force Commodity Council Processes

DTIC Science & Technology

2005-03-01

comparing the government’s need to those of industry firms is not an apples -to- apples evaluation. Additionally, the report states that not all...contracts, supplier performance, SWOT (Strengths, Weaknesses, Opportunities, and Threats), and purchasing objectives when 85 establishing a desired...separately from large suppliers. Compare apples to apples . Take the consideration of non- procurement goals out of the decision and build it into the

Getting evidence-based pressure ulcer prevention into practice: a process evaluation of a multifaceted intervention in a hospital setting.

PubMed

Sving, Eva; Fredriksson, Lennart; Gunningberg, Lena; Mamhidir, Anna-Greta

2017-10-01

To describe registered nurses', assistant nurses' and first-line managers' experiences and perceptions of a multifaceted hospital setting intervention focused on implementing evidence-based pressure ulcer prevention. Pressure ulcer prevention is deficient. Different models exist to support implementation of evidence-based care. Little is known about implementation processes. A descriptive qualitative approach. Five focus-group nurse interviews and five individual first-line manager interviews were conducted at five Swedish hospital units. Qualitative content analysis was used. The findings support that the intervention and the implementation process changed the understanding and way of working with pressure ulcer prevention: from treating to preventing. This became possible as 'Changed understanding enables changed actions - through one's own performance and reflection on pressure ulcer prevention'. Having a common outlook on pressure ulcer prevention, easy access to pressure-reducing equipment, and external and internal facilitator support were described as important factors for changed practices. Bedside support, feedback and discussions on current results increased the awareness of needed improvements. The multifaceted intervention approach and the participants' positive attitudes seemed to be crucial for changing understanding and working more preventatively. The strategies used and the skills of the facilitators need to be tailored to the problems surrounding the context. Feedback discussions among the staff regarding the results of the care provided also appear to be vital. It is crucial that dedicated facilitators are involved to promote the implementation process. A preventative mindset should be strived for. Creating an implementation plan with an outcome and a process evaluation should be emphasised. It is important to give the staff regular feedback on the quality of care and on those occasions allocate time for discussion and reflection. © 2016 John Wiley & Sons Ltd.

A Case Study on Improving Intensive Care Unit (ICU) Services Reliability: By Using Process Failure Mode and Effects Analysis (PFMEA)

PubMed Central

Yousefinezhadi, Taraneh; Jannesar Nobari, Farnaz Attar; Goodari, Faranak Behzadi; Arab, Mohammad

2016-01-01

Introduction: In any complex human system, human error is inevitable and shows that can’t be eliminated by blaming wrong doers. So with the aim of improving Intensive Care Units (ICU) reliability in hospitals, this research tries to identify and analyze ICU’s process failure modes at the point of systematic approach to errors. Methods: In this descriptive research, data was gathered qualitatively by observations, document reviews, and Focus Group Discussions (FGDs) with the process owners in two selected ICUs in Tehran in 2014. But, data analysis was quantitative, based on failures’ Risk Priority Number (RPN) at the base of Failure Modes and Effects Analysis (FMEA) method used. Besides, some causes of failures were analyzed by qualitative Eindhoven Classification Model (ECM). Results: Through FMEA methodology, 378 potential failure modes from 180 ICU activities in hospital A and 184 potential failures from 99 ICU activities in hospital B were identified and evaluated. Then with 90% reliability (RPN≥100), totally 18 failures in hospital A and 42 ones in hospital B were identified as non-acceptable risks and then their causes were analyzed by ECM. Conclusions: Applying of modified PFMEA for improving two selected ICUs’ processes reliability in two different kinds of hospitals shows that this method empowers staff to identify, evaluate, prioritize and analyze all potential failure modes and also make them eager to identify their causes, recommend corrective actions and even participate in improving process without feeling blamed by top management. Moreover, by combining FMEA and ECM, team members can easily identify failure causes at the point of health care perspectives. PMID:27157162

Surgery resident selection and evaluation. A critical incident study.

PubMed

Edwards, J C; Currie, M L; Wade, T P; Kaminski, D L

1993-03-01

This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general surgery faculty members and four senior residents. The researchers then directed the surgeons in a two-step process of sorting the incidents into categories and naming the categories. The final essential categories of behavior to define surgical competence were derived through discussion among the surgeons until a consensus was formed. Those categories are knowledge/self-education, clinical performance, diagnostic skills, surgical skills, communication skills, reliability, integrity, compassion, organization skills, motivation, emotional control, and personal appearance. These categories were then used to develop an interview evaluation form for selection purposes and a performance evaluation form to be used throughout residency training. Thus a continuum of evaluation was established. The categories and critical incidents were also used to structure the interview process, which has demonstrated increased interview validity and reliability in many other studies. A handbook for structuring the interviews faculty members conduct with applicants was written, and an interview training session was held with the faculty. The process of implementation of the structured selection interviews is being documented currently through qualitative research.

Selection of essential medicines for South Africa - an analysis of in-depth interviews with national essential medicines list committee members.

PubMed

Perumal-Pillay, Velisha Ann; Suleman, Fatima

2017-01-07

The South African (SA) public health system has employed an Essential Medicines List (EML) with Standard Treatment Guidelines (STGs) in the public sector since 1996. To date no studies have reported on the process of selection of essential medicines for SA EMLs and how this may have changed over time. This study reports on the decision making process for the selection of essential medicines for SA EMLs, over the years, as described by various members of the National Essential Medicines List Committee (NEMLC) and their task teams. Qualitative in-depth interviews, guided by an interview questionnaire, were conducted with 11 members of the SA NEMLC and their task teams (both past and present members) during the period January - April 2015. Interviews were recorded and transcribed verbatim. Transcripts were then coded by the first author and verified by the second author before being reconciled and input into NVIVO, a qualitative software, to facilitate analysis of the data. The interviews conducted suggest that the NEMLC process of medicine selection has been refined over the years. This together with the EML review process is now essentially predominantly an evidence based process where quality, safety and efficacy of a medicine is considered first followed by cost considerations which includes pharmacoeconomic evaluations, and pricing of medicines. This is the first study in SA to report on how decisions are taken to include or exclude medicines on SA national EMLs and provides insight into the SA EML medicine selection, review and monitoring processes over time. The results show that the NEMLC has undergone tremendous transformation over the years. Whilst the membership of the committee largely remains unchanged, the committee has developed its policies and processes over the years. However there is still a need to strengthen the monitoring and evaluation aspects of the SA EML policy process.

A novel evaluation method for building construction project based on integrated information entropy with reliability theory.

PubMed

Bai, Xiao-ping; Zhang, Xi-wei

2013-01-01

Selecting construction schemes of the building engineering project is a complex multiobjective optimization decision process, in which many indexes need to be selected to find the optimum scheme. Aiming at this problem, this paper selects cost, progress, quality, and safety as the four first-order evaluation indexes, uses the quantitative method for the cost index, uses integrated qualitative and quantitative methodologies for progress, quality, and safety indexes, and integrates engineering economics, reliability theories, and information entropy theory to present a new evaluation method for building construction project. Combined with a practical case, this paper also presents detailed computing processes and steps, including selecting all order indexes, establishing the index matrix, computing score values of all order indexes, computing the synthesis score, sorting all selected schemes, and making analysis and decision. Presented method can offer valuable references for risk computing of building construction projects.

Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention.

PubMed

Gardner, Benjamin; Sheals, Kate; Wardle, Jane; McGowan, Laura

2014-10-30

Forming 'habit' - defined as a learned process that generates automatic responses to contextual cues - has been suggested as a mechanism for behaviour maintenance, but few studies have applied habit theory to behaviour change. This study used process evaluation data, taken from a randomised controlled trial of a healthy child-feeding intervention for parents previously shown to be effective, to explore the applicability to dietary behaviour change of predictions and recommendations drawn from habit theory. The intervention supported parents in pursuing child-feeding habit goals in three domains (giving fruit and vegetables, water, healthy snacks), over four fortnightly home visits. We explored whether (a) the habit-formation model was acceptable to participants, (b) better-specified habit-formation goals yielded greater habit gains, and (c) habit gains were sustained (d) even when subsequent, new habit goals were pursued. Qualitative and quantitative data were taken from 57 parents randomised to the intervention arm, and so analyses presented here used a pre-post intervention design. Thematic analysis of post-intervention qualitative interviews evaluated acceptability, and self-reported habit goals were content-analysed. ANOVAs explored changes in habit strength, recorded at home visits and one- and two-month follow-ups, across time and goals. Participants understood and engaged positively with the habit-formation approach. Although many seemingly poorly-specified habit goals were set, goal characteristics had minimal impact on habit strength, which were achieved within two weeks for all behaviours (p's < .001), and were maintained or had increased further by the final follow-up. The habit-formation model appears to be an acceptable and fruitful basis for dietary behaviour change.

Conducting Qualitative Data Analysis: Managing Dynamic Tensions within

ERIC Educational Resources Information Center

Chenail, Ronald J.

2012-01-01

In the third of a series of "how-to" essays on conducting qualitative data analysis, Ron Chenail examines the dynamic tensions within the process of qualitative data analysis that qualitative researchers must manage in order to produce credible and creative results. These tensions include (a) the qualities of the data and the qualitative data…

Are campus food environments healthy? A novel perspective for qualitatively evaluating the nutritional quality of food sold at foodservice facilities at a Brazilian university.

PubMed

Pulz, Isadora Santos; Martins, Paula Andréa; Feldman, Charles; Veiros, Marcela Boro

2017-03-01

The purpose of this novel study was to evaluate the food environment at a Brazilian university, encompassing 6 restaurants and 13 snack bars. The investigation uniquely analyses the food environment (barriers, facilitators, type of foods and prices). This was a food-based analysis of the nutritional quality of the products sold on campus. A cross-sectional descriptive design was used, applying the classic Nutrition Environment Measures Survey-Restaurants (NEMS-R) adapted for Brazil and an original methodology to evaluate and classify qualitatively the nutritional quality and characteristics of the food. A census of all campus food environments was applied. The main results show most food and beverage products were made with processed ingredients and had a lower nutritional quality and price when compared with similar products made on premises, that is, processed iced tea compared with fresh tea ( p < .001), fried refined flour salgados compared with baked wholegrain flour salgados ( p < .001) and refined flour biscuits compared with those made with whole grains ( p = .028). Only 16% of the outlets provided food ingredients or nutritional information of products available. The overall options for healthy food choices and good nutritional quality on campus were mostly limited by the availability and higher prices of products. These findings could be used to develop new policy perspectives for the offering of healthy food items and to facilitate better food choices among students in a healthier food environment.

Better movers and thinkers (BMT): A quasi-experimental study into the impact of physical education on children's cognition—A study protocol

PubMed Central

Dalziell, Andrew; Boyle, James; Mutrie, Nanette

2015-01-01

This study will extend on a pilot study and will evaluate the impact of a novel approach to PE, Better Movers and Thinkers (BMT), on students' cognition, physical activity habits, and gross motor coordination (GMC). The study will involve six mainstream state schools with students aged 9–11 years. Three schools will be allocated as the intervention condition and three as the control condition. The design of the study is a 16-week intervention with pre-, post- and 6 month follow-up measurements taken using the ‘Cognitive Assessment System (CAS)’ GMC tests, and the ‘Physical Activity Habits Questionnaire for Children (PAQ-C).’ Qualitative data will be gathered using student focus groups and class teacher interviews in each of the six schools. ANCOVA will be used to evaluate any effect of intervention comparing pre-test scores with post-test scores and then pre-test scores with 6 month follow-up scores. Qualitative data will be analysed through an iterative process using grounded theory. This protocol provides the details of the rationale and design of the study and details of the intervention, outcome measures, and the recruitment process. The study will address gaps within current research by evaluating if a change of approach in the delivery of PE within schools has an effect on children's cognition, PA habits, and GMC within a Scottish setting. PMID:26844172

Delivering digital health and well-being at scale: lessons learned during the implementation of the dallas program in the United Kingdom

PubMed Central

Devlin, Alison M; McGee-Lennon, Marilyn; O’Donnell, Catherine A; Bouamrane, Matt-Mouley; Agbakoba, Ruth; O’Connor, Siobhan; Grieve, Eleanor; Finch, Tracy; Wyke, Sally; Watson, Nicholas; Browne, Susan

2016-01-01

Objective To identify implementation lessons from the United Kingdom Delivering Assisted Living Lifestyles at Scale (dallas) program—a large-scale, national technology program that aims to deliver a broad range of digital services and products to the public to promote health and well-being. Materials and Methods Prospective, longitudinal qualitative research study investigating implementation processes. Qualitative data collected includes semi-structured e-Health Implementation Toolkit–led interviews at baseline/mid-point (n = 38), quarterly evaluation, quarterly technical and barrier and solutions reports, observational logs, quarterly evaluation alignment interviews with project leads, observational data collected during meetings, and ethnographic data from dallas events (n > 200 distinct pieces of qualitative data). Data analysis was guided by Normalization Process Theory, a sociological theory that aids conceptualization of implementation issues in complex healthcare settings. Results Five key challenges were identified: 1) The challenge of establishing and maintaining large heterogeneous, multi-agency partnerships to deliver new models of healthcare; 2) The need for resilience in the face of barriers and set-backs including the backdrop of continually changing external environments; 3) The inherent tension between embracing innovative co-design and achieving delivery at pace and at scale; 4) The effects of branding and marketing issues in consumer healthcare settings; and 5) The challenge of interoperability and information governance, when commercial proprietary models are dominant. Conclusions The magnitude and ambition of the dallas program provides a unique opportunity to investigate the macro level implementation challenges faced when designing and delivering digital health and wellness services at scale. Flexibility, adaptability, and resilience are key implementation facilitators when shifting to new digitally enabled models of care. PMID:26254480

Delivering digital health and well-being at scale: lessons learned during the implementation of the dallas program in the United Kingdom.

PubMed

Devlin, Alison M; McGee-Lennon, Marilyn; O'Donnell, Catherine A; Bouamrane, Matt-Mouley; Agbakoba, Ruth; O'Connor, Siobhan; Grieve, Eleanor; Finch, Tracy; Wyke, Sally; Watson, Nicholas; Browne, Susan; Mair, Frances S

2016-01-01

To identify implementation lessons from the United Kingdom Delivering Assisted Living Lifestyles at Scale (dallas) program-a large-scale, national technology program that aims to deliver a broad range of digital services and products to the public to promote health and well-being. Prospective, longitudinal qualitative research study investigating implementation processes. Qualitative data collected includes semi-structured e-Health Implementation Toolkit-led interviews at baseline/mid-point (n = 38), quarterly evaluation, quarterly technical and barrier and solutions reports, observational logs, quarterly evaluation alignment interviews with project leads, observational data collected during meetings, and ethnographic data from dallas events (n > 200 distinct pieces of qualitative data). Data analysis was guided by Normalization Process Theory, a sociological theory that aids conceptualization of implementation issues in complex healthcare settings. Five key challenges were identified: 1) The challenge of establishing and maintaining large heterogeneous, multi-agency partnerships to deliver new models of healthcare; 2) The need for resilience in the face of barriers and set-backs including the backdrop of continually changing external environments; 3) The inherent tension between embracing innovative co-design and achieving delivery at pace and at scale; 4) The effects of branding and marketing issues in consumer healthcare settings; and 5) The challenge of interoperability and information governance, when commercial proprietary models are dominant. The magnitude and ambition of the dallas program provides a unique opportunity to investigate the macro level implementation challenges faced when designing and delivering digital health and wellness services at scale. Flexibility, adaptability, and resilience are key implementation facilitators when shifting to new digitally enabled models of care. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association.

A General Survey of Qualitative Research Methodology.

ERIC Educational Resources Information Center

Cary, Rick

Current definitions and philosophical foundations of qualitative research are presented; and designs, evaluation methods, and issues in application of qualitative research to education are discussed. The effects of positivism and the post-positivist era on qualitative research are outlined, and naturalist and positivist approaches are contrasted.…

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Teacher Attitudes as Related to the Implementation of the New Jersey Teacher Evaluation System

ERIC Educational Resources Information Center

Gallo, Donna

2016-01-01

The focus of this qualitative case study is on an attitudinal change of teachers towards teacher evaluation with the implementation of a new evaluation system. The goal of this qualitative case study was to gain an understanding of how the implementation of the new New Jersey teacher evaluation system relates to teachers' attitudes toward…

Reflecting on our practice: an evaluation of Balint groups for medical students in psychiatry.

PubMed

Parker, Stephen D; Leggett, Andrew

2014-04-01

This paper qualitatively evaluates a one-year trial of Balint clinical reflection groups for medical students in psychiatry at a large Australian tertiary referral hospital. The trial considered whether clinical reflection groups following the Balint process would be perceived as useful and relevant to the learning needs of the student participants. A grounded theory approach was undertaken. This included survey data, thematic analysis of written feedback, and facilitator reflection on the process. Facilitators adapted the group process in response to participants' needs. These modifications included: increased education regarding the Balint process; the introduction of co-presenters; and the inclusion of a didactic summary following each session. The evaluation suggested that fidelity of the Balint group experience was achieved and that student attitudes were neutral to mildly positive regarding the educational experience. Balint groups are potentially useful to medical students in the Australian context. We suggest that Balint groups may be more useful when applied in less alienating learning environments, such as during general practice rotations. Emphasis is placed on the need to maintain a dynamic approach by adapting the group and the educational processes as the work unfolds.

Reported credibility techniques in higher education evaluation studies that use qualitative methods: A research synthesis.

PubMed

Liao, Hongjing; Hitchcock, John

2018-06-01

This synthesis study examined the reported use of credibility techniques in higher education evaluation articles that use qualitative methods. The sample included 118 articles published in six leading higher education evaluation journals from 2003 to 2012. Mixed methods approaches were used to identify key credibility techniques reported across the articles, document the frequency of these techniques, and describe their use and properties. Two broad sets of techniques were of interest: primary design techniques (i.e., basic), such as sampling/participant recruitment strategies, data collection methods, analytic details, and additional qualitative credibility techniques (e.g., member checking, negative case analyses, peer debriefing). The majority of evaluation articles reported use of primary techniques although there was wide variation in the amount of supporting detail; most of the articles did not describe the use of additional credibility techniques. This suggests that editors of evaluation journals should encourage the reporting of qualitative design details and authors should develop strategies yielding fuller methodological description. Copyright © 2018 Elsevier Ltd. All rights reserved.

Opening the Black Box and Searching for Smoking Guns: Process Causality in Qualitative Research

ERIC Educational Resources Information Center

Bennett, Elisabeth E.; McWhorter, Rochell R.

2016-01-01

Purpose: The purpose of this paper is to explore the role of qualitative research in causality, with particular emphasis on process causality. In one paper, it is not possible to discuss all the issues of causality, but the aim is to provide useful ways of thinking about causality and qualitative research. Specifically, a brief overview of the…

A Qualitative Analysis Framework Using Natural Language Processing and Graph Theory

ERIC Educational Resources Information Center

Tierney, Patrick J.

2012-01-01

This paper introduces a method of extending natural language-based processing of qualitative data analysis with the use of a very quantitative tool--graph theory. It is not an attempt to convert qualitative research to a positivist approach with a mathematical black box, nor is it a "graphical solution". Rather, it is a method to help qualitative…

A Coding System for Qualitative Studies of the Information-Seeking Process in Computer Science Research

ERIC Educational Resources Information Center

Moral, Cristian; de Antonio, Angelica; Ferre, Xavier; Lara, Graciela

2015-01-01

Introduction: In this article we propose a qualitative analysis tool--a coding system--that can support the formalisation of the information-seeking process in a specific field: research in computer science. Method: In order to elaborate the coding system, we have conducted a set of qualitative studies, more specifically a focus group and some…

Are there two processes in reasoning? The dimensionality of inductive and deductive inferences.

PubMed

Stephens, Rachel G; Dunn, John C; Hayes, Brett K

2018-03-01

Single-process accounts of reasoning propose that the same cognitive mechanisms underlie inductive and deductive inferences. In contrast, dual-process accounts propose that these inferences depend upon 2 qualitatively different mechanisms. To distinguish between these accounts, we derived a set of single-process and dual-process models based on an overarching signal detection framework. We then used signed difference analysis to test each model against data from an argument evaluation task, in which induction and deduction judgments are elicited for sets of valid and invalid arguments. Three data sets were analyzed: data from Singmann and Klauer (2011), a database of argument evaluation studies, and the results of an experiment designed to test model predictions. Of the large set of testable models, we found that almost all could be rejected, including all 2-dimensional models. The only testable model able to account for all 3 data sets was a model with 1 dimension of argument strength and independent decision criteria for induction and deduction judgments. We conclude that despite the popularity of dual-process accounts, current results from the argument evaluation task are best explained by a single-process account that incorporates separate decision thresholds for inductive and deductive inferences. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

[Reconsidering evaluation criteria regarding health care research: toward an integrative framework of quantitative and qualitative criteria].

PubMed

Miyata, Hiroaki; Kai, Ichiro

2006-05-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confused and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. It is therefore very important to reconsider evaluation criteria regarding rigor in social science. As Lincoln & Guba have already compared quantitative paradigms (validity, reliability, neutrality, generalizability) with qualitative paradigms (credibility, dependability, confirmability, transferability), we have discuss use of evaluation criteria based on pragmatic perspective. Validity/Credibility is the paradigm concerned to observational framework, while Reliability/Dependability refer to the range of stability in observations, Neutrality/Confirmability reflect influences between observers and subjects, Generalizability/Transferability have epistemological difference in the way findings are applied. Qualitative studies, however, does not always chose the qualitative paradigms. If we assume the stability to some extent, it is better to use the quantitative paradigm (reliability). Moreover as a quantitative study can not always guarantee a perfect observational framework, with stability in all phases of observations, it is useful to use qualitative paradigms to enhance the rigor in the study.

Recommendations for a mixed methods approach to evaluating the patient-centered medical home.

PubMed

Goldman, Roberta E; Parker, Donna R; Brown, Joanna; Walker, Judith; Eaton, Charles B; Borkan, Jeffrey M

2015-03-01

There is a strong push in the United States to evaluate whether the patient-centered medical home (PCMH) model produces desired results. The explanatory and contextually based questions of how and why PCMH succeeds in different practice settings are often neglected. We report the development of a comprehensive, mixed qualitative-quantitative evaluation set for researchers, policy makers, and clinician groups. To develop an evaluation set, the Brown Primary Care Transformation Initiative convened a multidisciplinary group of PCMH experts, reviewed the PCMH literature and evaluation strategies, developed key domains for evaluation, and selected or created methods and measures for inclusion. The measures and methods in the evaluation set (survey instruments, PCMH meta-measures, patient outcomes, quality measures, qualitative interviews, participant observation, and process evaluation) are meant to be used together. PCMH evaluation must be sufficiently comprehensive to assess and explain both the context of transformation in different primary care practices and the experiences of diverse stakeholders. In addition to commonly assessed patient outcomes, quality, and cost, it is critical to include PCMH components integral to practice culture transformation: patient and family centeredness, authentic patient activation, mutual trust among practice employees and patients, and transparency, joy, and collaboration in delivering and receiving care in a changing environment. This evaluation set offers a comprehensive methodology to enable understanding of how PCMH transformation occurs in different practice settings. This approach can foster insights about how transformation affects critical outcomes to achieve meaningful, patient-centered, high-quality, and cost-effective sustainable change among diverse primary care practices. © 2015 Annals of Family Medicine, Inc.

Frameworks for evaluating health research capacity strengthening: a qualitative study

PubMed Central

2013-01-01

Background Health research capacity strengthening (RCS) projects are often complex and hard to evaluate. In order to inform health RCS evaluation efforts, we aimed to describe and compare key characteristics of existing health RCS evaluation frameworks: their process of development, purpose, target users, structure, content and coverage of important evaluation issues. A secondary objective was to explore what use had been made of the ESSENCE framework, which attempts to address one such issue: harmonising the evaluation requirements of different funders. Methods We identified and analysed health RCS evaluation frameworks published by seven funding agencies between 2004 and 2012, using a mixed methods approach involving structured qualitative analyses of documents, a stakeholder survey and consultations with key contacts in health RCS funding agencies. Results The frameworks were intended for use predominantly by the organisations themselves, and most were oriented primarily towards funders’ internal organisational performance requirements. The frameworks made limited reference to theories that specifically concern RCS. Generic devices, such as logical frameworks, were typically used to document activities, outputs and outcomes, but with little emphasis on exploring underlying assumptions or contextual constraints. Usage of the ESSENCE framework appeared limited. Conclusions We believe that there is scope for improving frameworks through the incorporation of more accessible information about how to do evaluation in practice; greater involvement of stakeholders, following evaluation capacity building principles; greater emphasis on explaining underlying rationales of frameworks; and structuring frameworks so that they separate generic and project-specific aspects of health RCS evaluation. The third and fourth of these improvements might assist harmonisation. PMID:24330628

[Methodologic developmental principles of standardized surveys within the scope of social gerontologic studies].

PubMed

Bansemir, G

1987-01-01

The conception and evaluation of standardized oral or written questioning as quantifying instruments of research orientate by the basic premises of Marxist-Leninist theory of recognition and general scientific logic. In the present contribution the socio-gerontological research process is outlined in extracts. By referring to the intrinsic connection between some of its essential components--problem, formation of hypotheses, obtaining indicators/measurement, preliminary examination, evaluation-as well as to typical errors and (fictitious) examples of practical research, this contribution contrasts the natural, apparently uncomplicated course of structured questioning with its qualitative methodological fundamentals and demands.

The evaluation of (social-)psychological comfort in clothing, a possible approach

NASA Astrophysics Data System (ADS)

Matté, L. L.; Broega, A. C.

2017-10-01

This paper presents the first results of a PhD research on psychological comfort of clothing. In order to understand and conceptualize the psychological aspects of clothing comfort, a variation of the Delphi Method was used to seek opinions from experts. This method was chosen because of its consensus-building features. The results were obtained from a qualitative text analysis, conducted over the experts’ responses to the first round of questions. The analytic process shed some light on the formation of the psychological comfort concept as well as the potential attributes to be evaluated when assessing this comfort dimension.

A comparison between findings from the DREEM questionnaire and that from qualitative interviews.

PubMed

Denz-Penhey, Harriet; Murdoch, J Campbell

2009-10-01

The Rural Clinical School of Western Australia educates one quarter of all Western Australian medical students in their first clinical year in rural settings. As part of a comprehensive evaluation programme students give feedback regularly. To identify if the Dundee Ready Education Environment Measurement (DREEM) data could be used qualitatively and descriptively to determine specific problems from the data alone despite the small numbers at some sites. The DREEM questionnaire was administered on the same day as qualitative interviews were undertaken. The qualitative interviews were analysed thematically first and then compared with findings from DREEM. Each major (student related) evaluation issue identified by the qualitative interviews was also identified by the DREEM questionnaire analysis. When the DREEM study was undertaken in the Rural Clinical School of Western Australia there was no real expectation that it would provide sufficient information to identify issues picked up in the extensive and time consuming qualitative study. About half of the work undertaken by the qualitative evaluation, that of the experiences of the students at the site, was picked up by the DREEM questionnaire in a much shorter time frame and at less cost of staff time and resources. The DREEM questionnaire can be used qualitatively to assess very specific issues relating to each of the subscales. These findings extend the use of DREEM from quantitative and statistically significant research to qualitative meaning-filled interpretations. The issues then need to be addressed sensitively.

An educational game for teaching clinical practice guidelines to Internal Medicine residents: development, feasibility and acceptability

PubMed Central

Akl, Elie A; Mustafa, Reem; Slomka, Thomas; Alawneh, Alia; Vedavalli, Abhishek; Schünemann, Holger J

2008-01-01

Background Adherence to Clinical Practice Guidelines (CPGs) remains suboptimal among internal medicine trainees. Educational games are of growing interest and have the potential to improve adherence to CPGs. The objectives of this study were to develop an educational game to teach CPGs in Internal Medicine residency programs and to evaluate its feasibility and acceptability. Methods We developed the Guide-O-Game© in the format of a TV game show with questions based on recommendations of CPGs. The development of the Guide-O-Game© consisted of the creation of a multimedia interactive tool, the development of recommendation-based questions, and the definition of the game's rules. We evaluated its feasibility through pilot testing and its acceptability through a qualitative process. Results The multimedia interactive tool uses a Macromedia Flash web application and consists of a manager interface and a user interface. The user interface allows the choice of two game styles. We created so far 16 sets of questions relating to 9 CPGs. The pilot testing proved that the game was feasible. The qualitative evaluation showed that residents considered the game to be acceptable. Conclusion We developed an educational game to teach CPGs to Internal Medicine residents that is both feasible and acceptable. Future work should evaluate its impact on educational outcomes. PMID:19017400

'Stories' or 'snapshots'? A study directed at comparing qualitative and quantitative approaches to curriculum evaluation.

PubMed

Pateman, B; Jinks, A M

1999-01-01

The focus of this paper is a study designed to explore the validity of quantitative approaches of student evaluation in a pre-registration degree programme. As managers of the students' education we were concerned that the quantitative method, which used lecturer criteria, may not fully represent students' views. The approach taken is that of a process-type strategy for curriculum evaluation as described by Parlett and Hamilton (1972). The aim of the study is to produce illuminative data, or students' 'stories' of their educational experiences through use of semi-structured interviews. The results are then compared to the current quantitative measurement tools designed to obtain 'snapshots' of the educational effectiveness of the curriculum. The quantitative measurement tools use Likert scale measurements of teacher-devised criterion statements. The results of the study give a rich source of qualitative data which can be used to inform future curriculum development. However, complete validation of the current quantitative instruments used was not achieved in this study. Student and teacher agendas in respect of important issues pertaining to the course programme were found to differ. Limitations of the study are given. There is discussion of the options open to the management team with regard to future development of curriculum evaluation systems.

Four challenges in selecting and implementing methods to monitor and evaluate participatory processes: Example from the Rwenzori region, Uganda.

PubMed

Hassenforder, Emeline; Ducrot, Raphaëlle; Ferrand, Nils; Barreteau, Olivier; Anne Daniell, Katherine; Pittock, Jamie

2016-09-15

Participatory approaches are now increasingly recognized and used as an essential element of policies and programs, especially in regards to natural resource management (NRM). Most practitioners, decision-makers and researchers having adopted participatory approaches also acknowledge the need to monitor and evaluate such approaches in order to audit their effectiveness, support decision-making or improve learning. Many manuals and frameworks exist on how to carry out monitoring and evaluation (M&E) for participatory processes. However, few provide guidelines on the selection and implementation of M&E methods, an aspect which is also often obscure in published studies, at the expense of the transparency, reliability and validity of the study. In this paper, we argue that the selection and implementation of M&E methods are particularly strategic when monitoring and evaluating a participatory process. We demonstrate that evaluators of participatory processes have to tackle a quadruple challenge when selecting and implementing methods: using mixed-methods, both qualitative and quantitative; assessing the participatory process, its outcomes, and its context; taking into account both the theory and participants' views; and being both rigorous and adaptive. The M&E of a participatory planning process in the Rwenzori Region, Uganda, is used as an example to show how these challenges unfold on the ground and how they can be tackled. Based on this example, we conclude by providing tools and strategies that can be used by evaluators to ensure that they make utile, feasible, coherent, transparent and adaptive methodological choices when monitoring and evaluating participatory processes for NRM. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Systematic Quantitative-Qualitative Model: How To Evaluate Professional Services

ERIC Educational Resources Information Center

Yoda, Koji

1973-01-01

The proposed evaluation model provides for the assignment of relative weights to each criterion, and establishes a weighting system for calculating a quantitative-qualitative raw score for each service activity of a faculty member being reviewed. (Author)

How Do Contextual Factors Influence Implementation and Receipt of Positive Youth Development Programs Addressing Substance Use and Violence? A Qualitative Meta-Synthesis of Process Evaluations.

PubMed

Dickson, Kelly; Melendez-Torres, G J; Fletcher, Adam; Hinds, Kate; Thomas, James; Stansfield, Claire; Murphy, Simon; Campbell, Rona; Bonell, Chris

2018-05-01

Positive youth development (PYD) often aims to prevent tobacco, alcohol, and drugs use and violence. We systematically reviewed PYD interventions, synthesizing process, and outcomes evidence. Synthesis of outcomes, published elsewhere, found no overall evidence of reducing substance use or violence but notable variability of fidelity. Our synthesis of process evaluations examined how implementation varied and was influenced by context. Process evaluations of PYD aiming to reduce substance use and violence. Study Inclusion Criteria: Overall review published since 1985; written in English; focused on youth aged 11 to 18 years; focused on interventions addressing multiple positive assets; reported on theory, process, or outcomes; and concerned with reducing substance use or violence. Synthesis of process evaluations examined how implementation varies with or is influenced by context. Two reviewers in parallel. Thematic synthesis. We identified 12 reports. Community engagement enhanced program appeal. Collaboration with other agencies could broaden the activities offered. Calm but authoritative staff increased acceptability. Staff continuity underpinned diverse activities and durable relationships. Empowering participants were sometimes in tension with requiring them to engage in diverse activities. Our systematic review identified factors that might help improve the fidelity and acceptability of PYD interventions. Addressing these might enable PYD to fulfill its potential as a means of promoting health.

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

Shared decision-making for psychiatric medication: A mixed-methods evaluation of a UK training programme for service users and clinicians.

PubMed

Ramon, Shulamit; Morant, Nicola; Stead, Ute; Perry, Ben

2017-12-01

Shared decision making (SDM) is recognised as a promising strategy to enhance good collaboration between clinicians and service users, yet it is not practised regularly in mental health. Develop and evaluate a novel training programme to enhance SDM in psychiatric medication management for service users, psychiatrists and care co-ordinators. The training programme design was informed by existing literature and local stakeholders consultations. Parallel group-based training programmes on SDM process were delivered to community mental health service users and providers. Evaluation consisted of quantitative measures at baseline and 12-month follow-up, post-programme participant feedback and qualitative interviews. Training was provided to 47 service users, 35 care-coordinators and 12 psychiatrists. Participant feedback was generally positive. Statistically significant changes in service users' decisional conflict and perceptions of practitioners' interactional style in promoting SDM occurred at the follow-up. Qualitative data suggested positive impacts on service users' and care co-ordinators confidence to explore medication experience, and group-based training was valued. The programme was generally acceptable to service users and practitioners. This indicates the value of conducting a larger study and exploring application for non-medical decisions.

Process and Outcome Evaluation of a Community Intervention for Orphan Adolescents in Western Kenya

PubMed Central

Hallfors, Denise D.; Cho, Hyunsan; Mbai, Isabella; Milimo, Benson; Itindi, Janet

2012-01-01

We conducted a 2-year pilot randomized controlled trial (N = 105) in a high HIV-prevalence area in rural western Kenya to test whether providing young orphan adolescents with uniforms, school fees, and community visitors improves school retention and reduces HIV risk factors. The trial was a community intervention, limited to one community. In this paper, we examined intervention implementation and its association with outcomes using longitudinal data. We used both quantitative and qualitative methods to evaluate the community-based model for orphan HIV prevention, with recommendations for future studies. Despite promising effects after 1 year, GEE analyses showed null effects after 2 years. Volunteer community visitors, a key element of the intervention, showed little of the expected effect although qualitative reports documented active assistance to prevent orphans' school absence. For future research, we recommend capturing the transition to high school, a larger sample size, and biomarker data to add strength to the research design. We also recommend a school-based intervention approach to improve implementation and reduce infrastructure costs. Finally, we recommend evaluating nurses as agents for improving school attendance and preventing dropout because of their unique ability to address critical biopsychosocial problems. PMID:22350730

Process and outcome evaluation of a community intervention for orphan adolescents in western Kenya.

PubMed

Hallfors, Denise D; Cho, Hyunsan; Mbai, Isabella; Milimo, Benson; Itindi, Janet

2012-10-01

We conducted a 2-year pilot randomized controlled trial (N = 105) in a high HIV-prevalence area in rural western Kenya to test whether providing young orphan adolescents with uniforms, school fees, and community visitors improves school retention and reduces HIV risk factors. The trial was a community intervention, limited to one community. In this paper, we examined intervention implementation and its association with outcomes using longitudinal data. We used both quantitative and qualitative methods to evaluate the community-based model for orphan HIV prevention, with recommendations for future studies. Despite promising effects after 1 year, GEE analyses showed null effects after 2 years. Volunteer community visitors, a key element of the intervention, showed little of the expected effect although qualitative reports documented active assistance to prevent orphans' school absence. For future research, we recommend capturing the transition to high school, a larger sample size, and biomarker data to add strength to the research design. We also recommend a school-based intervention approach to improve implementation and reduce infrastructure costs. Finally, we recommend evaluating nurses as agents for improving school attendance and preventing dropout because of their unique ability to address critical biopsychosocial problems.

GoActive: a protocol for the mixed methods process evaluation of a school-based physical activity promotion programme for 13-14year old adolescents.

PubMed

Jong, Stephanie T; Brown, Helen Elizabeth; Croxson, Caroline H D; Wilkinson, Paul; Corder, Kirsten L; van Sluijs, Esther M F

2018-05-21

Process evaluations are critical for interpreting and understanding outcome trial results. By understanding how interventions function across different settings, process evaluations have the capacity to inform future dissemination of interventions. The complexity of Get others Active (GoActive), a 12-week, school-based physical activity intervention implemented in eight schools, highlights the need to investigate how implementation is achieved across a variety of school settings. This paper describes the mixed methods GoActive process evaluation protocol that is embedded within the outcome evaluation. In this detailed process evaluation protocol, we describe the flexible and pragmatic methods that will be used for capturing the process evaluation data. A mixed methods design will be used for the process evaluation, including quantitative data collected in both the control and intervention arms of the GoActive trial, and qualitative data collected in the intervention arm. Data collection methods will include purposively sampled, semi-structured interviews and focus group interviews, direct observation, and participant questionnaires (completed by students, teachers, older adolescent mentors, and local authority-funded facilitators). Data will be analysed thematically within and across datasets. Overall synthesis of findings will address the process of GoActive implementation, and through which this process affects outcomes, with careful attention to the context of the school environment. This process evaluation will explore the experience of participating in GoActive from the perspectives of key groups, providing a greater understanding of the acceptability and process of implementation of the intervention across the eight intervention schools. This will allow for appraisal of the intervention's conceptual base, inform potential dissemination, and help optimise post-trial sustainability. The process evaluation will also assist in contextualising the trial effectiveness results with respect to how the intervention may or may not have worked and, if it was found to be effective, what might be required for it to be sustained in the 'real world'. Furthermore, it will offer suggestions for the development and implementation of future initiatives to promote physical activity within schools. ISRCTN, ISRCTN31583496 . Registered on 18 February 2014.

Approche du Processus d'Auto-Formation Inspiree de la Methode des "Histoires de vie" dans le cadre de la Formation continuee des institutrices maternelles en Communaute francaise de Belgique (Approach to the Process of Self-Instruction Inspired by the "Life History" Method in the Framework of the Continuing Education of Preschool Teachers in the French-Speaking Community in Belgium).

ERIC Educational Resources Information Center

Brandt, Madeleine

1994-01-01

Describes a study of the use of a critical events questionnaire and "educational biography" as means of training preschool teachers to question their role as teachers; to question their relationship with children; and to liberate their consciousness. Discusses the quantitative and qualitative results of the self-evaluation processes. (AC)

A critical review on sustainable biochar system through gasification: Energy and environmental applications.

PubMed

You, Siming; Ok, Yong Sik; Chen, Season S; Tsang, Daniel C W; Kwon, Eilhann E; Lee, Jechan; Wang, Chi-Hwa

2017-12-01

This review lays great emphasis on production and characteristics of biochar through gasification. Specifically, the physicochemical properties and yield of biochar through the diverse gasification conditions associated with various types of biomass were extensively evaluated. In addition, potential application scenarios of biochar through gasification were explored and their environmental implications were discussed. To qualitatively evaluate biochar sustainability through the gasification process, all gasification products (i.e., syngas and biochar) were evaluated via life cycle assessment (LCA). A concept of balancing syngas and biochar production for an economically and environmentally feasible gasification system was proposed and relevant challenges and solutions were suggested in this review. Copyright © 2017 Elsevier Ltd. All rights reserved.

[Advantages and disadvantages of incorporating qualitative methodology in the evaluation of health services. A practical case: evaluation of a high-resolution clinic].

PubMed

Alvarez Del Arco, D; Rodríguez Rieiro, C; Sanchidrián De Blás, C; Alejos, B; Plá Mestre, R

2012-01-01

We examined the usefulness of incorporating a qualitative phase in the evaluation of the quality of care in a high-resolution medical service carried out with quantitative methods. A quantitative research was performed using a structured questionnaire and selecting interviewees by systematic randomized sampling methods (n=320). In addition, a qualitative research was carried on through semi-structured interviews with patients selected by convenience criteria (n=11), observations in the care assistance circuit, and a group interview with health professionals working in the service. A multidisciplinary research team conducted an individual analysis of the information collected in both quantitative and qualitative phases. Subsequently, three meetings based on group brainstorming techniques were held to identify the diverse contributions of each of the methodologies employed to the research, using affinity graphs to analyse the different results obtained in both phases and evaluate possible bias arising from the use of qualitative methods. Qualitative research allowed examining specific aspects of the health care service that had been collected in the quantitative phase, harmonizing the results obtained in the previous phase, giving in-depth data on the reasons for patient dissatisfaction with specific aspects, such as waiting times and available infrastructures, and identifying emerging issues of the service which had not been previously assessed. Overall, the qualitative phase enriched the results of the research. It is appropriate and recommendable to incorporate this methodological approach in research aimed at evaluating the quality of the service in specific health care settings, since it is provided first hand, by the voice of the customer. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Art as Mode and Medium: A Pedagogical Approach to Teaching and Learning about Self-Reflexivity and Artistic Expression in Qualitative Research

ERIC Educational Resources Information Center

Bogumil, Elizabeth; Capous-Desyllas, Moshoula; Lara, Patricia; Reshetnikov, Aleksey

2017-01-01

This article highlights the ways in which arts-based approaches to research can be used in teaching and learning about the qualitative research process. Specifically, in our qualitative research class graduate students used the arts as a form of reflexivity to highlight various aspects of their research process, including their positionality,…

Using media to impact health policy-making: an integrative systematic review.

PubMed

Bou-Karroum, Lama; El-Jardali, Fadi; Hemadi, Nour; Faraj, Yasmine; Ojha, Utkarsh; Shahrour, Maher; Darzi, Andrea; Ali, Maha; Doumit, Carine; Langlois, Etienne V; Melki, Jad; AbouHaidar, Gladys Honein; Akl, Elie A

2017-04-18

Media interventions can potentially play a major role in influencing health policies. This integrative systematic review aimed to assess the effects of planned media interventions-including social media-on the health policy-making process. Eligible study designs included randomized and non-randomized designs, economic studies, process evaluation studies, stakeholder analyses, qualitative methods, and case studies. We electronically searched Medline, EMBASE, Communication and Mass Media Complete, Cochrane Central Register of Controlled Trials, and the WHO Global Health Library. We followed standard systematic review methodology for study selection, data abstraction, and risk of bias assessment. Twenty-one studies met our eligibility criteria: 10 evaluation studies using either quantitative (n = 7) or qualitative (n = 3) designs and 11 case studies. None of the evaluation studies were on social media. The findings of the evaluation studies suggest that media interventions may have a positive impact when used as accountability tools leading to prioritizing and initiating policy discussions, as tools to increase policymakers' awareness, as tools to influence policy formulation, as awareness tools leading to policy adoption, and as awareness tools to improve compliance with laws and regulations. In one study, media-generated attention had a negative effect on policy advocacy as it mobilized opponents who defeated the passage of the bills that the media intervention advocated for. We judged the confidence in the available evidence as limited due to the risk of bias in the included studies and the indirectness of the evidence. There is currently a lack of reliable evidence to guide decisions on the use of media interventions to influence health policy-making. Additional and better-designed, conducted, and reported primary research is needed to better understand the effects of media interventions, particularly social media, on health policy-making processes, and the circumstances under which media interventions are successful. PROSPERO 2015: CRD42015020243.

How is rehabilitation with and without an integrated self-management approach perceived by UK community-dwelling stroke survivors? A qualitative process evaluation to explore implementation and contextual variations

PubMed Central

Jones, Fiona; McKevitt, Christopher; Riazi, Afsane; Liston, Matthew

2017-01-01

Objective Self-management programmes could support long-term needs after stroke and using methods integrated into rehabilitation is one option. To explore theoretical assumptions and possible mechanisms of implementation a process evaluation was delivered alongside a cluster trial which has demonstrated feasibility of an integrated self-management programme (Bridges SMP) in community-dwelling stroke survivors. This paper aims to show the extent to which experiences from stroke survivors receiving rehabilitation in control (usual care) and intervention (integrated self-management) sites reflected the differences in rehabilitation received and whether their understandings aligned with the self-management approach employed. Design Semistructured qualitative interviews carried out as part of a process evaluation analysed thematically. Setting Study was based in South London; all interviews were carried out in participants' home setting. Participants 22 stroke participants recruited; 12 from integrated self-management sites and 10 from usual care sites. Results All participants revealed shared appreciation of knowledge and support from therapists but subtle differences emerged between sites in respect to perceptions about responsibility, control and how previous experiences were used. Accounts depicted a variance regarding who had structured and planned their rehabilitation, with greater flexibility about content and involvement perceived by participants from the integrated self-management sites. They also provided accounts and experiences which aligned with principles of the intervention, such as self-discovery and problem-solving. Conclusions The findings reflect our theoretical assumptions and possible mechanisms of implementation that rehabilitation with a focus on supporting self-management is reflected in accounts and understandings of stroke survivors. Taken together with our previous research this justifies evaluating the effectiveness of Bridges SMP in a larger sample to further contribute to an understanding of the functioning of the intervention, implementation, contextual factors and mechanisms of impact. Trial registration number ISRCTN42534180; Post-results. PMID:28373253

Assimilation of Web-Based Urgent Stroke Evaluation: A Qualitative Study of Two Networks

PubMed Central

Mathiassen, Lars; Switzer, Jeffrey A; Adams, Robert J

2014-01-01

Background Stroke is a leading cause of death and serious, long-term disability across the world. Urgent stroke care treatment is time-sensitive and requires a stroke-trained neurologist for clinical diagnosis. Rural areas, where neurologists and stroke specialists are lacking, have a high incidence of stroke-related death and disability. By virtually connecting emergency department physicians in rural hospitals to regional medical centers for consultations, specialized Web-based stroke evaluation systems (telestroke) have helped address the challenge of urgent stroke care in underserved communities. However, many rural hospitals that have deployed telestroke have not fully assimilated this technology. Objective The objective of this study was to explore potential sources of variations in the utilization of a Web-based telestroke system for urgent stroke evaluation and propose a telestroke assimilation model to improve stroke care performance. Methods An exploratory, qualitative case study of two telestroke networks, each comprising an academic stroke center (hub) and connected rural hospitals (spokes), was conducted. Data were collected from 50 semistructured interviews with 40 stakeholders, telestroke usage logs from 32 spokes, site visits, published papers, and reports. Results The two networks used identical technology (called Remote Evaluation of Acute isCHemic stroke, REACH) and were of similar size and complexity, but showed large variations in telestroke assimilation across spokes. Several observed hub- and spoke-related characteristics can explain these variations. The hub-related characteristics included telestroke institutionalization into stroke care, resources for the telestroke program, ongoing support for stroke readiness of spokes, telestroke performance monitoring, and continuous telestroke process improvement. The spoke-related characteristics included managerial telestroke championship, stroke center certification, dedicated telestroke coordinator, stroke committee of key stakeholders, local neurological expertise, and continuous telestroke process improvement. Conclusions Rural hospitals can improve their stroke readiness with use of telestroke systems. However, they need to integrate the technology into their stroke delivery processes. A telestroke assimilation model may improve stroke care performance. PMID:25601232

Disability Evaluation System and Temporary Limited Duty Assignment Process: A Qualitative Review.

DTIC Science & Technology

1998-03-01

Statement addressing the requirement for monitoring, frequency of treat- ments/ therapy , and the associated operational assignment limitation; Informed...ACC does not exist in the EAIS, ARIS, or the EMF data bases. The system is able to track changes in duty station, but not ACC’s. If a member is on...specific geographic assignment. 4. Requires extensive or prolonged medical therapy . 5. Who through continued military service would probably result in

Reducing the Effects of Background Noise during Auditory Functional Magnetic Resonance Imaging of Speech Processing: Qualitative and Quantitative Comparisons between Two Image Acquisition Schemes and Noise Cancellation

ERIC Educational Resources Information Center

Blackman, Graham A.; Hall, Deborah A.

2011-01-01

Purpose: The intense sound generated during functional magnetic resonance imaging (fMRI) complicates studies of speech and hearing. This experiment evaluated the benefits of using active noise cancellation (ANC), which attenuates the level of the scanner sound at the participant's ear by up to 35 dB around the peak at 600 Hz. Method: Speech and…

[The triad configuration, humanist-existential-personal: a theoretical and methodological approach to psychiatric and mental health nursing].

PubMed

Vietta, E P

1995-01-01

The author establishes a research line based on a theoretical-methodological referential for the qualitative investigation of psychiatric nursing and mental health. Aspects of humanist and existential philosophies and personalism were evaluated integrating them in a unique perspective. In order to maintain the scientific method of research in this referential the categorization process which will be adopted in this kind of investigation was explained.

Evaluating the iterative development of VR/AR human factors tools for manual work.

PubMed

Liston, Paul M; Kay, Alison; Cromie, Sam; Leva, Chiara; D'Cruz, Mirabelle; Patel, Harshada; Langley, Alyson; Sharples, Sarah; Aromaa, Susanna

2012-01-01

This paper outlines the approach taken to iteratively evaluate a set of VR/AR (virtual reality / augmented reality) applications for five different manual-work applications - terrestrial spacecraft assembly, assembly-line design, remote maintenance of trains, maintenance of nuclear reactors, and large-machine assembly process design - and examines the evaluation data for evidence of the effectiveness of the evaluation framework as well as the benefits to the development process of feedback from iterative evaluation. ManuVAR is an EU-funded research project that is working to develop an innovative technology platform and a framework to support high-value, high-knowledge manual work throughout the product lifecycle. The results of this study demonstrate the iterative improvements reached throughout the design cycles, observable through the trending of the quantitative results from three successive trials of the applications and the investigation of the qualitative interview findings. The paper discusses the limitations of evaluation in complex, multi-disciplinary development projects and finds evidence of the effectiveness of the use of the particular set of complementary evaluation methods incorporating a common inquiry structure used for the evaluation - particularly in facilitating triangulation of the data.

Qualitative radiology assessment of tumor response: does it measure up?

PubMed

Gottlieb, Ronald H; Litwin, Alan; Gupta, Bhavna; Taylor, John; Raczyk, Cheryl; Mashtare, Terry; Wilding, Gregory; Fakih, Marwan

2008-01-01

Our purpose was to assess whether a simpler qualitative evaluation of tumor response by computed tomography is as reproducible and predictive of clinical outcome as the Response Evaluation Criteria in Solid Tumors (RECIST) and World Health Organization (WHO) methods. This study was a two-reader retrospective evaluation in which qualitative assessment resulted in agreement in 21 of 23 patients with metastatic colorectal carcinoma (91.3%, kappa=0.78; 95% CI, 0.51-1.00). Hepatic metastases were classified as increased, decreased, or unchanged, compared with agreement in 20 of 23 patients (87.0%) for RECIST (kappa=0.62; 95% CI, 0.23-1.00) and WHO (kappa=0.67; 95% CI, 0.34-1.00) methods. Patients were placed into partial response, stable disease, and disease progression categories. Time to progression of disease was better predicted qualitatively than by RECIST or WHO. Our pilot data suggest that our qualitative scoring system is more reproducible and predictive of patient clinical outcome than the RECIST and WHO methods.

Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series.

PubMed

Lewin, Simon; Booth, Andrew; Glenton, Claire; Munthe-Kaas, Heather; Rashidian, Arash; Wainwright, Megan; Bohren, Meghan A; Tunçalp, Özge; Colvin, Christopher J; Garside, Ruth; Carlsen, Benedicte; Langlois, Etienne V; Noyes, Jane

2018-01-25

The GRADE-CERQual ('Confidence in the Evidence from Reviews of Qualitative research') approach provides guidance for assessing how much confidence to place in findings from systematic reviews of qualitative research (or qualitative evidence syntheses). The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. Confidence in the evidence from qualitative evidence syntheses is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. CERQual provides a systematic and transparent framework for assessing confidence in individual review findings, based on consideration of four components: (1) methodological limitations, (2) coherence, (3) adequacy of data, and (4) relevance. A fifth component, dissemination (or publication) bias, may also be important and is being explored. As with the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach for effectiveness evidence, CERQual suggests summarising evidence in succinct, transparent, and informative Summary of Qualitative Findings tables. These tables are designed to communicate the review findings and the CERQual assessment of confidence in each finding. This article is the first of a seven-part series providing guidance on how to apply the CERQual approach. In this paper, we describe the rationale and conceptual basis for CERQual, the aims of the approach, how the approach was developed, and its main components. We also outline the purpose and structure of this series and discuss the growing role for qualitative evidence in decision-making. Papers 3, 4, 5, 6, and 7 in this series discuss each CERQual component, including the rationale for including the component in the approach, how the component is conceptualised, and how it should be assessed. Paper 2 discusses how to make an overall assessment of confidence in a review finding and how to create a Summary of Qualitative Findings table. The series is intended primarily for those undertaking qualitative evidence syntheses or using their findings in decision-making processes but is also relevant to guideline development agencies, primary qualitative researchers, and implementation scientists and practitioners.

Influences of different thermal processings in milk, bovine meat and frog protein structure.

PubMed

Coura Oliveira, Tatiana; Lopes Lima, Samuel; Bressan, Josefina

2013-01-01

Several studies have associated the digestibility of proteins to its imunogenic potential. Though, it was objectified to evaluate the impact of the thermal processing with high and low temperatures on the proteins structure of three types of foods, by means of the digestibility in vitro and electroforesis en gel de poliacrilamida. The pasteurize was observed in such a way, firing 95 ºC during 15 minutes, how much freeze dried causes qualitative and quantitative modifications of constituent proteins of the food. The most sensible proteins to the increasing thermal processing order were beef, frog meat, and the last, cow milk. Copyright © AULA MEDICA EDICIONES 2013. Published by AULA MEDICA. All rights reserved.

Qualitative Student Models.

ERIC Educational Resources Information Center

Clancey, William J.

The concept of a qualitative model is used as the focus of this review of qualitative student models in order to compare alternative computational models and to contrast domain requirements. The report is divided into eight sections: (1) Origins and Goals (adaptive instruction, qualitative models of processes, components of an artificial…

A Qualitative Evaluation of the Use of Multimedia Case Studies in an Introductory Engineering Course at Two Southeastern Universities

ERIC Educational Resources Information Center

Huett, Kim C.; Kawulich, Barbara

2015-01-01

Collaborating at two universities to improve teaching and learning in undergraduate engineering, an interdisciplinary team of researchers, instructors, and evaluators planned and implemented the use of multimedia case studies with students enrolled in an introductory engineering course. This qualitative action evaluation study focuses on results…

Teacher Evaluation: A Qualitative Study on Growth-Producing Practices in K-8 Schools

ERIC Educational Resources Information Center

Manso, Phoebe Hechanova

2017-01-01

Literature on teacher evaluation describes a flawed system that evokes wide-ranging attempts to "get it right." This qualitative study is another effort that seeks to understand its legal and traditional constructs. The goal of this research is to identify growth-producing practices that will transform teacher evaluation into an organic…

Residential Wilderness Programs: The Role of Social Support in Influencing Self-Evaluations of Male Adolescents

ERIC Educational Resources Information Center

Cook, Emily C.

2008-01-01

This qualitative study explores the aspects of a residential wilderness experience that informed self-evaluations in male adolescents, ages 12-16. To assess change in self-evaluations and program factors associated with change, qualitative interviews were conducted with adolescents upon entry to the program and four months later. Participants'…

Out of the frying pan? Streamlining the ethics review process of multisite qualitative research projects.

PubMed

Iedema, Rick A M; Allen, Suellen; Britton, Kate; Hor, Suyin

2013-05-01

This paper describes the ethics approval processes for two multicentre, nationwide, qualitative health service research projects. The paper explains that the advent of the National Ethics Application Form has brought many improvements, but that attendant processes put in place at local health network and Human Research Ethics Committee levels may have become significantly more complicated, particularly for innovative qualitative research projects. The paper raises several questions based on its analysis of ethics application processes currently in place. WHAT IS KNOWN ABOUT THE TOPIC? The complexity of multicentre research ethics applications for research in health services has been addressed by the introduction of the National Ethics Application Form. Uptake of the form across the country's human research ethics committees has been uneven. WHAT DOES THIS PAPER ADD? This paper adds detailed insight into the ethics application process as it is currently enacted across the country. The paper details this process with reference to difficulties faced by multisite and qualitative studies in negotiating access to research sites, ethics committees' relative unfamiliarity with qualitative research , and apparent tensions between harmonisation and local sites' autonomy in approving research. WHAT ARE THE IMPLICATIONS FOR PRACTITIONERS? Practitioners aiming to engage in research need to be aware that ethics approval takes place in an uneven procedural landscape, made up of variable levels of ethics approval harmonization and intricate governance or site-specific assessment processes.

Appraising Qualitative Research in Health Education: Guidelines for Public Health Educators

PubMed Central

Jeanfreau, Scharalda G.; Jack, Leonard

2010-01-01

Research studies, including qualitative studies, form the basis for evidence-based practice among health professionals. However, many practicing health educators do not feel fully confident in their ability to critically appraise qualitative research studies. This publication presents an overview of qualitative research approaches, defines key terminology used in qualitative research, and provides guidelines for appraising the strengths and weaknesses of published qualitative research. On reading, health educators will be better equipped to evaluate the quality of the evidence through critical appraisals of qualitative research publications. PMID:20817630

Language barriers and qualitative nursing research: methodological considerations.

PubMed

Squires, A

2008-09-01

This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation.

Language barriers and qualitative nursing research: methodological considerations

PubMed Central

Squires, A.

2009-01-01

Aim This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Background Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. Conclusion By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation. PMID:19522941

Evaluation of item candidates for a diabetic retinopathy quality of life item bank.

PubMed

Fenwick, Eva K; Pesudovs, Konrad; Khadka, Jyoti; Rees, Gwyn; Wong, Tien Y; Lamoureux, Ecosse L

2013-09-01

We are developing an item bank assessing the impact of diabetic retinopathy (DR) on quality of life (QoL) using a rigorous multi-staged process combining qualitative and quantitative methods. We describe here the first two qualitative phases: content development and item evaluation. After a comprehensive literature review, items were generated from four sources: (1) 34 previously validated patient-reported outcome measures; (2) five published qualitative articles; (3) eight focus groups and 18 semi-structured interviews with 57 DR patients; and (4) seven semi-structured interviews with diabetes or ophthalmic experts. Items were then evaluated during 3 stages, namely binning (grouping) and winnowing (reduction) based on key criteria and panel consensus; development of item stems and response options; and pre-testing of items via cognitive interviews with patients. The content development phase yielded 1,165 unique items across 7 QoL domains. After 3 sessions of binning and winnowing, items were reduced to a minimally representative set (n = 312) across 9 domains of QoL: visual symptoms; ocular surface symptoms; activity limitation; mobility; emotional; health concerns; social; convenience; and economic. After 8 cognitive interviews, 42 items were amended resulting in a final set of 314 items. We have employed a systematic approach to develop items for a DR-specific QoL item bank. The psychometric properties of the nine QoL subscales will be assessed using Rasch analysis. The resulting validated item bank will allow clinicians and researchers to better understand the QoL impact of DR and DR therapies from the patient's perspective.

Ayurvedic versus conventional dietary and lifestyle counseling for mothers with burnout-syndrome: A randomized controlled pilot study including a qualitative evaluation.

PubMed

Kessler, Christian S; Eisenmann, Clemens; Oberzaucher, Frank; Forster, Martin; Steckhan, Nico; Meier, Larissa; Stapelfeldt, Elmar; Michalsen, Andreas; Jeitler, Michael

2017-10-01

Ayurveda claims to be effective in the treatment of psychosomatic disorders by means of lifestyle and nutritional counseling. In a randomized controlled study mothers with burnout were randomized into two groups: Ayurvedic nutritional counseling (according to tradition), and conventional nutritional counseling (following the recommendations of a family doctor). Patients received five counseling sessions over twelve weeks. Outcomes included levels of burnout, quality of life, sleep, stress, depression/anxiety, and spirituality at three and six months. It also included a qualitative evaluation of the communication processes. We randomized thirty four patients; twenty three participants were included in the per protocol analysis. No significant differences were observed between the groups. However, significant and clinically relevant intra-group mean changes for the primary outcome burnout, and secondary outcomes sleep, stress, depression and mental health were only found in the Ayurveda group. The qualitative part of the study identified different conversational styles and counseling techniques between the two study groups. In conventional consultations questions tended to be category bound, while counseling-advice was predominantly admonitory. The Ayurvedic practitioner used open-ended interrogative forms, devices for displaying understanding, and positive re-evaluation more frequently, leading to an overall less asymmetrical interaction. We found positive effects for both groups, which however were more pronounced in the Ayurvedic group. The conversational and counseling techniques in the Ayurvedic group offered more opportunities for problem description by patients as well as patient-centered practice and resource-oriented recommendations by the physician. NCT01797887. Copyright © 2017 Elsevier Ltd. All rights reserved.

Methods to estimate the transfer of contaminants into recycling products - A case study from Austria.

PubMed

Knapp, Julika; Allesch, Astrid; Müller, Wolfgang; Bockreis, Anke

2017-11-01

Recycling of waste materials is desirable to reduce the consumption of limited primary resources, but also includes the risk of recycling unwanted, hazardous substances. In Austria, the legal framework demands secondary products must not present a higher risk than comparable products derived from primary resources. However, the act provides no definition on how to assess this risk potential. This paper describes the development of different quantitative and qualitative methods to estimate the transfer of contaminants in recycling processes. The quantitative methods comprise the comparison of concentrations of harmful substances in recycling products to corresponding primary products and to existing limit values. The developed evaluation matrix, which considers further aspects, allows for the assessment of the qualitative risk potential. The results show that, depending on the assessed waste fraction, particular contaminants can be critical. Their concentrations were higher than in comparable primary materials and did not comply with existing limit values. On the other hand, the results show that a long-term, well-established quality control system can assure compliance with the limit values. The results of the qualitative assessment obtained with the evaluation matrix support the results of the quantitative assessment. Therefore, the evaluation matrix can be suitable to quickly screen waste streams used for recycling to estimate their potential environmental and health risks. To prevent the transfer of contaminants into product cycles, improved data of relevant substances in secondary resources are necessary. In addition, regulations for material recycling are required to assure adequate quality control measures, including limit values. Copyright © 2017 Elsevier Ltd. All rights reserved.

Series: Practical guidance to qualitative research. Part 2: Context, research questions and designs.

PubMed

Korstjens, Irene; Moser, Albine

2017-12-01

In the course of our supervisory work over the years, we have noticed that qualitative research tends to evoke a lot of questions and worries, so-called frequently asked questions (FAQs). This series of four articles intends to provide novice researchers with practical guidance for conducting high-quality qualitative research in primary care. By 'novice' we mean Master's students and junior researchers, as well as experienced quantitative researchers who are engaging in qualitative research for the first time. This series addresses their questions and provides researchers, readers, reviewers and editors with references to criteria and tools for judging the quality of qualitative research papers. This second article addresses FAQs about context, research questions and designs. Qualitative research takes into account the natural contexts in which individuals or groups function to provide an in-depth understanding of real-world problems. The research questions are generally broad and open to unexpected findings. The choice of a qualitative design primarily depends on the nature of the research problem, the research question(s) and the scientific knowledge one seeks. Ethnography, phenomenology and grounded theory are considered to represent the 'big three' qualitative approaches. Theory guides the researcher through the research process by providing a 'lens' to look at the phenomenon under study. Since qualitative researchers and the participants of their studies interact in a social process, researchers influence the research process. The first article described the key features of qualitative research, the third article will focus on sampling, data collection and analysis, while the last article focuses on trustworthiness and publishing.

How Ontologies are Made: Studying the Hidden Social Dynamics Behind Collaborative Ontology Engineering Projects.

PubMed

Strohmaier, Markus; Walk, Simon; Pöschko, Jan; Lamprecht, Daniel; Tudorache, Tania; Nyulas, Csongor; Musen, Mark A; Noy, Natalya F

2013-05-01

Traditionally, evaluation methods in the field of semantic technologies have focused on the end result of ontology engineering efforts, mainly, on evaluating ontologies and their corresponding qualities and characteristics. This focus has led to the development of a whole arsenal of ontology-evaluation techniques that investigate the quality of ontologies as a product . In this paper, we aim to shed light on the process of ontology engineering construction by introducing and applying a set of measures to analyze hidden social dynamics. We argue that especially for ontologies which are constructed collaboratively, understanding the social processes that have led to its construction is critical not only in understanding but consequently also in evaluating the ontology. With the work presented in this paper, we aim to expose the texture of collaborative ontology engineering processes that is otherwise left invisible. Using historical change-log data, we unveil qualitative differences and commonalities between different collaborative ontology engineering projects. Explaining and understanding these differences will help us to better comprehend the role and importance of social factors in collaborative ontology engineering projects. We hope that our analysis will spur a new line of evaluation techniques that view ontologies not as the static result of deliberations among domain experts, but as a dynamic, collaborative and iterative process that needs to be understood, evaluated and managed in itself. We believe that advances in this direction would help our community to expand the existing arsenal of ontology evaluation techniques towards more holistic approaches.

How Ontologies are Made: Studying the Hidden Social Dynamics Behind Collaborative Ontology Engineering Projects

PubMed Central

Strohmaier, Markus; Walk, Simon; Pöschko, Jan; Lamprecht, Daniel; Tudorache, Tania; Nyulas, Csongor; Musen, Mark A.; Noy, Natalya F.

2013-01-01

Traditionally, evaluation methods in the field of semantic technologies have focused on the end result of ontology engineering efforts, mainly, on evaluating ontologies and their corresponding qualities and characteristics. This focus has led to the development of a whole arsenal of ontology-evaluation techniques that investigate the quality of ontologies as a product. In this paper, we aim to shed light on the process of ontology engineering construction by introducing and applying a set of measures to analyze hidden social dynamics. We argue that especially for ontologies which are constructed collaboratively, understanding the social processes that have led to its construction is critical not only in understanding but consequently also in evaluating the ontology. With the work presented in this paper, we aim to expose the texture of collaborative ontology engineering processes that is otherwise left invisible. Using historical change-log data, we unveil qualitative differences and commonalities between different collaborative ontology engineering projects. Explaining and understanding these differences will help us to better comprehend the role and importance of social factors in collaborative ontology engineering projects. We hope that our analysis will spur a new line of evaluation techniques that view ontologies not as the static result of deliberations among domain experts, but as a dynamic, collaborative and iterative process that needs to be understood, evaluated and managed in itself. We believe that advances in this direction would help our community to expand the existing arsenal of ontology evaluation techniques towards more holistic approaches. PMID:24311994

Expert consensus on best evaluative practices in community-based rehabilitation.

PubMed

Grandisson, Marie; Thibeault, Rachel; Hébert, Michèle; Cameron, Debra

2016-01-01

The objective of this study was to generate expert consensus on best evaluative practices for community-based rehabilitation (CBR). This consensus includes key features of the evaluation process and methods, and discussion of whether a shared framework should be used to report findings and, if so, which framework should play this role. A Delphi study with two predefined rounds was conducted. Experts in CBR from a wide range of geographical areas and disciplinary backgrounds were recruited to complete the questionnaires. Both quantitative and qualitative analyses were performed to generate the recommendations for best practices in CBR evaluation. A panel of 42 experts reached consensus on 13 recommendations for best evaluative practices in CBR. In regard to the critical qualities of sound CBR evaluation processes, panellists emphasized that these processes should be inclusive, participatory, empowering and respectful of local cultures and languages. The group agreed that evaluators should consider the use of mixed methods and participatory tools, and should combine indicators from a universal list of CBR indicators with locally generated ones. The group also agreed that a common framework should guide CBR evaluations, and that this framework should be a flexible combination between the CBR Matrix and the CBR Principles. An expert panel reached consensus on key features of best evaluative practices in CBR. Knowledge transfer initiatives are now required to develop guidelines, tools and training opportunities to facilitate CBR program evaluations. CBR evaluation processes should strive to be inclusive, participatory, empowering and respectful of local cultures and languages. CBR evaluators should strongly consider using mixed methods, participatory tools, a combination of indicators generated with the local community and with others from a bank of CBR indicators. CBR evaluations should be situated within a shared, but flexible, framework. This shared framework could combine the CBR Matrix and the CBR Principles.

Barriers and facilitators to physical activity in people with hip or knee osteoarthritis: protocol for a systematic review of qualitative evidence

PubMed Central

Kanavaki, Archontissa M; Rushton, Alison; Klocke, Rainer; Abhishek, Abhishek; Duda, Joan L

2016-01-01

Introduction This protocol aims to describe the objective and methods to be followed in a systematic review of qualitative studies on barriers and facilitators to physical activity (PA) in people with hip or knee osteoarthritis (OA). Methods and analysis MEDLINE, EMBASE, PhychINFO, Web of Science, CINAHL, SPORTDiscus, Scopus and grey literature sources will be electronically searched. Hand search of qualitative research-centred journals, reference screening of relevant reviews and inquiries to researchers active in the field will complement the search. Studies will be selected if they apply qualitative or mixed-methods designs to directly explore factors that correspond to engagement in PA/exercise or, the perceptions regarding PA/exercise in people with hip or knee OA. The Critical Appraisal Skills Programme Qualitative Checklist and the evaluative criteria of credibility, transferability, dependability and confirmability will be applied for the study appraisal. 2 independent reviewers will perform the search, study selection and study appraisal. Thematic synthesis will be used for synthesising the findings of the primary studies and the process and product of the synthesis will be checked by a second researcher. ConQual approach will be used for assessing the confidence in the qualitative findings. Ethics and dissemination This systematic review will inform our understanding of the PA determinants and how to optimise behaviour change in people living with hip or knee OA. The review findings will be reported in a peer-reviewed journal and presented at national or international conferences. The study raises no ethical issues. Trial registration number CRD42016030024. PMID:27810971

The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems.

PubMed

Lyon, Aaron R; Wasse, Jessica Knaster; Ludwig, Kristy; Zachry, Mark; Bruns, Eric J; Unützer, Jürgen; McCauley, Elizabeth

2016-05-01

Health information technologies have become a central fixture in the mental healthcare landscape, but few frameworks exist to guide their adaptation to novel settings. This paper introduces the contextualized technology adaptation process (CTAP) and presents data collected during Phase 1 of its application to measurement feedback system development in school mental health. The CTAP is built on models of human-centered design and implementation science and incorporates repeated mixed methods assessments to guide the design of technologies to ensure high compatibility with a destination setting. CTAP phases include: (1) Contextual evaluation, (2) Evaluation of the unadapted technology, (3) Trialing and evaluation of the adapted technology, (4) Refinement and larger-scale implementation, and (5) Sustainment through ongoing evaluation and system revision. Qualitative findings from school-based practitioner focus groups are presented, which provided information for CTAP Phase 1, contextual evaluation, surrounding education sector clinicians' workflows, types of technologies currently available, and influences on technology use. Discussion focuses on how findings will inform subsequent CTAP phases, as well as their implications for future technology adaptation across content domains and service sectors.

Psychiatric service staff perceptions of implementing a shared decision-making tool: a process evaluation study

PubMed Central

Schön, Ulla-Karin; Grim, Katarina; Wallin, Lars; Rosenberg, David; Svedberg, Petra

2018-01-01

ABSTRACT Purpose: Shared decision making, SDM, in psychiatric services, supports users to experience a greater sense of involvement in treatment, self-efficacy, autonomy and reduced coercion. Decision tools adapted to the needs of users have the potential to support SDM and restructure how users and staff work together to arrive at shared decisions. The aim of this study was to describe and analyse the implementation process of an SDM intervention for users of psychiatric services in Sweden. Method: The implementation was studied through a process evaluation utilizing both quantitative and qualitative methods. In designing the process evaluation for the intervention, three evaluation components were emphasized: contextual factors, implementation issues and mechanisms of impact. Results: The study addresses critical implementation issues related to decision-making authority, the perceived decision-making ability of users and the readiness of the service to increase influence and participation. It also emphasizes the importance of facilitation, as well as suggesting contextual adaptations that may be relevant for the local organizations. Conclusion: The results indicate that staff perceived the decision support tool as user-friendly and useful in supporting participation in decision-making, and suggest that such concrete supports to participation can be a factor in implementation if adequate attention is paid to organizational contexts and structures. PMID:29405889

Modeling and evaluating user behavior in exploratory visual analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reda, Khairi; Johnson, Andrew E.; Papka, Michael E.

Empirical evaluation methods for visualizations have traditionally focused on assessing the outcome of the visual analytic process as opposed to characterizing how that process unfolds. There are only a handful of methods that can be used to systematically study how people use visualizations, making it difficult for researchers to capture and characterize the subtlety of cognitive and interaction behaviors users exhibit during visual analysis. To validate and improve visualization design, however, it is important for researchers to be able to assess and understand how users interact with visualization systems under realistic scenarios. This paper presents a methodology for modeling andmore » evaluating the behavior of users in exploratory visual analysis. We model visual exploration using a Markov chain process comprising transitions between mental, interaction, and computational states. These states and the transitions between them can be deduced from a variety of sources, including verbal transcripts, videos and audio recordings, and log files. This model enables the evaluator to characterize the cognitive and computational processes that are essential to insight acquisition in exploratory visual analysis, and reconstruct the dynamics of interaction between the user and the visualization system. We illustrate this model with two exemplar user studies, and demonstrate the qualitative and quantitative analytical tools it affords.« less

Psychiatric service staff perceptions of implementing a shared decision-making tool: a process evaluation study.

PubMed

Schön, Ulla-Karin; Grim, Katarina; Wallin, Lars; Rosenberg, David; Svedberg, Petra

2018-12-01

Shared decision making, SDM, in psychiatric services, supports users to experience a greater sense of involvement in treatment, self-efficacy, autonomy and reduced coercion. Decision tools adapted to the needs of users have the potential to support SDM and restructure how users and staff work together to arrive at shared decisions. The aim of this study was to describe and analyse the implementation process of an SDM intervention for users of psychiatric services in Sweden. The implementation was studied through a process evaluation utilizing both quantitative and qualitative methods. In designing the process evaluation for the intervention, three evaluation components were emphasized: contextual factors, implementation issues and mechanisms of impact. The study addresses critical implementation issues related to decision-making authority, the perceived decision-making ability of users and the readiness of the service to increase influence and participation. It also emphasizes the importance of facilitation, as well as suggesting contextual adaptations that may be relevant for the local organizations. The results indicate that staff perceived the decision support tool as user-friendly and useful in supporting participation in decision-making, and suggest that such concrete supports to participation can be a factor in implementation if adequate attention is paid to organizational contexts and structures.

Rationale, design and methods for process evaluation in the HEALTHY study.

PubMed

Schneider, M; Hall, W J; Hernandez, A E; Hindes, K; Montez, G; Pham, T; Rosen, L; Sleigh, A; Thompson, D; Volpe, S L; Zeveloff, A; Steckler, A

2009-08-01

The HEALTHY study was a multi-site randomized trial designed to determine whether a 3-year school-based intervention targeting nutrition and physical activity behaviors could effectively reduce risk factors associated with type 2 diabetes in middle school children. Pilot and formative studies were conducted to inform the development of the intervention components and the process evaluation methods for the main trial. During the main trial, both qualitative and quantitative assessments monitored the fidelity of the intervention and motivated modifications to improve intervention delivery. Structured observations of physical education classes, total school food environments, classroom-based educational modules, and communications and promotional campaigns provided verification that the intervention was delivered as intended. Interviews and focus groups yielded a multidimensional assessment of how the intervention was delivered and received, as well as identifying the barriers to and facilitators of the intervention across and within participating schools. Interim summaries of process evaluation data were presented to the study group as a means of ensuring standardization and quality of the intervention across the seven participating centers. Process evaluation methods and procedures documented the fidelity with which the HEALTHY study was implemented across 21 intervention schools and identified ways in which the intervention delivery might be enhanced throughout the study.

Augmenting Qualitative Text Analysis with Natural Language Processing: Methodological Study.

PubMed

Guetterman, Timothy C; Chang, Tammy; DeJonckheere, Melissa; Basu, Tanmay; Scruggs, Elizabeth; Vydiswaran, V G Vinod

2018-06-29

Qualitative research methods are increasingly being used across disciplines because of their ability to help investigators understand the perspectives of participants in their own words. However, qualitative analysis is a laborious and resource-intensive process. To achieve depth, researchers are limited to smaller sample sizes when analyzing text data. One potential method to address this concern is natural language processing (NLP). Qualitative text analysis involves researchers reading data, assigning code labels, and iteratively developing findings; NLP has the potential to automate part of this process. Unfortunately, little methodological research has been done to compare automatic coding using NLP techniques and qualitative coding, which is critical to establish the viability of NLP as a useful, rigorous analysis procedure. The purpose of this study was to compare the utility of a traditional qualitative text analysis, an NLP analysis, and an augmented approach that combines qualitative and NLP methods. We conducted a 2-arm cross-over experiment to compare qualitative and NLP approaches to analyze data generated through 2 text (short message service) message survey questions, one about prescription drugs and the other about police interactions, sent to youth aged 14-24 years. We randomly assigned a question to each of the 2 experienced qualitative analysis teams for independent coding and analysis before receiving NLP results. A third team separately conducted NLP analysis of the same 2 questions. We examined the results of our analyses to compare (1) the similarity of findings derived, (2) the quality of inferences generated, and (3) the time spent in analysis. The qualitative-only analysis for the drug question (n=58) yielded 4 major findings, whereas the NLP analysis yielded 3 findings that missed contextual elements. The qualitative and NLP-augmented analysis was the most comprehensive. For the police question (n=68), the qualitative-only analysis yielded 4 primary findings and the NLP-only analysis yielded 4 slightly different findings. Again, the augmented qualitative and NLP analysis was the most comprehensive and produced the highest quality inferences, increasing our depth of understanding (ie, details and frequencies). In terms of time, the NLP-only approach was quicker than the qualitative-only approach for the drug (120 vs 270 minutes) and police (40 vs 270 minutes) questions. An approach beginning with qualitative analysis followed by qualitative- or NLP-augmented analysis took longer time than that beginning with NLP for both drug (450 vs 240 minutes) and police (390 vs 220 minutes) questions. NLP provides both a foundation to code qualitatively more quickly and a method to validate qualitative findings. NLP methods were able to identify major themes found with traditional qualitative analysis but were not useful in identifying nuances. Traditional qualitative text analysis added important details and context. ©Timothy C Guetterman, Tammy Chang, Melissa DeJonckheere, Tanmay Basu, Elizabeth Scruggs, VG Vinod Vydiswaran. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 29.06.2018.

Constraining Distributed Catchment Models by Incorporating Perceptual Understanding of Spatial Hydrologic Behaviour

NASA Astrophysics Data System (ADS)

Hutton, Christopher; Wagener, Thorsten; Freer, Jim; Han, Dawei

2016-04-01

Distributed models offer the potential to resolve catchment systems in more detail, and therefore simulate the hydrological impacts of spatial changes in catchment forcing (e.g. landscape change). Such models tend to contain a large number of poorly defined and spatially varying model parameters which are therefore computationally expensive to calibrate. Insufficient data can result in model parameter and structural equifinality, particularly when calibration is reliant on catchment outlet discharge behaviour alone. Evaluating spatial patterns of internal hydrological behaviour has the potential to reveal simulations that, whilst consistent with measured outlet discharge, are qualitatively dissimilar to our perceptual understanding of how the system should behave. We argue that such understanding, which may be derived from stakeholder knowledge across different catchments for certain process dynamics, is a valuable source of information to help reject non-behavioural models, and therefore identify feasible model structures and parameters. The challenge, however, is to convert different sources of often qualitative and/or semi-qualitative information into robust quantitative constraints of model states and fluxes, and combine these sources of information together to reject models within an efficient calibration framework. Here we present the development of a framework to incorporate different sources of data to efficiently calibrate distributed catchment models. For each source of information, an interval or inequality is used to define the behaviour of the catchment system. These intervals are then combined to produce a hyper-volume in state space, which is used to identify behavioural models. We apply the methodology to calibrate the Penn State Integrated Hydrological Model (PIHM) at the Wye catchment, Plynlimon, UK. Outlet discharge behaviour is successfully simulated when perceptual understanding of relative groundwater levels between lowland peat, upland peat and valley slopes within the catchment are used to identify behavioural models. The process of converting qualitative information into quantitative constraints forces us to evaluate the assumptions behind our perceptual understanding in order to derive robust constraints, and therefore fairly reject models and avoid type II errors. Likewise, consideration needs to be given to the commensurability problem when mapping perceptual understanding to constrain model states.

A process evaluation accompanying an attempted randomized controlled trial of an evidence service for health system policymakers.

PubMed

Wilson, Michael G; Grimshaw, Jeremy M; Haynes, R Brian; Hanna, Steven E; Raina, Parminder; Gruen, Russell; Ouimet, Mathieu; Lavis, John N

2015-12-12

We developed an evidence service that draws inputs from Health Systems Evidence (HSE), which is a comprehensive database of research evidence about governance, financial and delivery arrangements within health systems and about implementation strategies relevant to health systems. Our goal was to evaluate whether, how and why a 'full-serve' evidence service increases the use of synthesized research evidence by policy analysts and advisors in the Ontario Ministry of Health and Long-Term Care as compared to a 'self-serve' evidence service. We attempted to conduct a two-arm, 10-month randomized controlled trial (RCT), along with a follow-up qualitative process evaluation, but we terminated the RCT when we failed to reach our recruitment target. For the qualitative process evaluation we modified the original interview guide to allow us to explore the (1) factors influencing participation in the trial; (2) usage of HSE, factors explaining usage patterns, and strategies to increase usage; (3) participation in training workshops and use of other supports; and (4) views about and experiences with key HSE features. We terminated the RCT given our 15% recruitment rate. Six factors were identified by those who had agreed to participate in the trial as encouraging their participation: relevance of the study to participants' own work; familiarity with the researchers; personal view of the importance of using research evidence in policymaking; academic background; support from supervisors; and participation of colleagues. Most reported that they never, infrequently or inconsistently used HSE and suggested strategies to increase its use, including regular email reminders and employee training. However, only two participants indicated that employee training, in the form of a workshop about finding and using research evidence, had influenced their use of HSE. Most participants found HSE features to be intuitive and helpful, although registration/sign-in and some page formats (particularly the advanced search page and detailed search results page) discouraged their use or did not optimize the user experience. The qualitative findings informed a re-design of HSE, which allows users to more efficiently find and use research evidence about how to strengthen or reform health systems or in how to get cost-effective programs, services and drugs to those who need them. Our experience with RCT recruitment suggests the need to consider changing the unit of allocation to divisions instead of individuals within divisions, among other lessons. This protocol for this study is published in Implementation Science and registered with ClinicalTrials.gov ( HHS/FHS REB 10-267 ).

Problem-Solving Phase Transitions During Team Collaboration.

PubMed

Wiltshire, Travis J; Butner, Jonathan E; Fiore, Stephen M

2018-01-01

Multiple theories of problem-solving hypothesize that there are distinct qualitative phases exhibited during effective problem-solving. However, limited research has attempted to identify when transitions between phases occur. We integrate theory on collaborative problem-solving (CPS) with dynamical systems theory suggesting that when a system is undergoing a phase transition it should exhibit a peak in entropy and that entropy levels should also relate to team performance. Communications from 40 teams that collaborated on a complex problem were coded for occurrence of problem-solving processes. We applied a sliding window entropy technique to each team's communications and specified criteria for (a) identifying data points that qualify as peaks and (b) determining which peaks were robust. We used multilevel modeling, and provide a qualitative example, to evaluate whether phases exhibit distinct distributions of communication processes. We also tested whether there was a relationship between entropy values at transition points and CPS performance. We found that a proportion of entropy peaks was robust and that the relative occurrence of communication codes varied significantly across phases. Peaks in entropy thus corresponded to qualitative shifts in teams' CPS communications, providing empirical evidence that teams exhibit phase transitions during CPS. Also, lower average levels of entropy at the phase transition points predicted better CPS performance. We specify future directions to improve understanding of phase transitions during CPS, and collaborative cognition, more broadly. Copyright © 2017 Cognitive Science Society, Inc.

Effects of an Advocacy Trial on Food Industry Salt Reduction Efforts—An Interim Process Evaluation

PubMed Central

Trevena, Helen; Petersen, Kristina; Thow, Anne Marie; Neal, Bruce

2017-01-01

The decisions made by food companies are a potent factor shaping the nutritional quality of the food supply. A number of non-governmental organizations (NGOs) advocate for corporate action to reduce salt levels in foods, but few data define the effectiveness of advocacy. This present report describes the process evaluation of an advocacy intervention delivered by one Australian NGO directly to food companies to reduce the salt content of processed foods. Food companies were randomly assigned to intervention (n = 22) or control (n = 23) groups. Intervention group companies were exposed to pre-planned and opportunistic communications, and control companies to background activities. Seven pre-defined interim outcome measures provided an indication of the effect of the intervention and were assessed using intention-to-treat analysis. These were supplemented by qualitative data from nine semi-structured interviews. The mean number of public communications supporting healthy food made by intervention companies was 1.5 versus 1.8 for control companies (p = 0.63). Other outcomes, including the mean number of news articles, comments and reports (1.2 vs. 1.4; p = 0.72), a published nutrition policy (23% vs. 44%; p = 0.21), public commitment to the Australian government’s Food and Health Dialogue (FHD) (41% vs. 61%; p = 0.24), evidence of a salt reduction plan (23% vs. 30%; p = 0.56), and mean number of communications with the NGO (15 vs. 11; p = 0.28) were also not significantly different. Qualitative data indicated the advocacy trial had little effect. The absence of detectable effects of the advocacy intervention on the interim markers indicates there may be no impact of the NGO advocacy trial on the primary outcome of salt reduction in processed foods. PMID:29039802

Effects of an Advocacy Trial on Food Industry Salt Reduction Efforts-An Interim Process Evaluation.

PubMed

Trevena, Helen; Petersen, Kristina; Thow, Anne Marie; Dunford, Elizabeth K; Wu, Jason H Y; Neal, Bruce

2017-10-17

The decisions made by food companies are a potent factor shaping the nutritional quality of the food supply. A number of non-governmental organizations (NGOs) advocate for corporate action to reduce salt levels in foods, but few data define the effectiveness of advocacy. This present report describes the process evaluation of an advocacy intervention delivered by one Australian NGO directly to food companies to reduce the salt content of processed foods. Food companies were randomly assigned to intervention ( n = 22) or control ( n = 23) groups. Intervention group companies were exposed to pre-planned and opportunistic communications, and control companies to background activities. Seven pre-defined interim outcome measures provided an indication of the effect of the intervention and were assessed using intention-to-treat analysis. These were supplemented by qualitative data from nine semi-structured interviews. The mean number of public communications supporting healthy food made by intervention companies was 1.5 versus 1.8 for control companies ( p = 0.63). Other outcomes, including the mean number of news articles, comments and reports (1.2 vs. 1.4; p = 0.72), a published nutrition policy (23% vs. 44%; p = 0.21), public commitment to the Australian government's Food and Health Dialogue (FHD) (41% vs. 61%; p = 0.24), evidence of a salt reduction plan (23% vs. 30%; p = 0.56), and mean number of communications with the NGO (15 vs. 11; p = 0.28) were also not significantly different. Qualitative data indicated the advocacy trial had little effect. The absence of detectable effects of the advocacy intervention on the interim markers indicates there may be no impact of the NGO advocacy trial on the primary outcome of salt reduction in processed foods.

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

The Urban Adaptation and Adaptation Process of Urban Migrant Children: A Qualitative Study

ERIC Educational Resources Information Center

Liu, Yang; Fang, Xiaoyi; Cai, Rong; Wu, Yang; Zhang, Yaofang

2009-01-01

This article employs qualitative research methods to explore the urban adaptation and adaptation processes of Chinese migrant children. Through twenty-one in-depth interviews with migrant children, the researchers discovered: The participant migrant children showed a fairly high level of adaptation to the city; their process of urban adaptation…

Adolescents' Use of Self-Regulatory Processes and Their Relation to Qualitative Mental Model Shifts while Using Hypermedia

ERIC Educational Resources Information Center

Greene, Jeffrey Alan; Azevedo, Roger

2007-01-01

This study examined 148 adolescents' use of self-regulated learning (SRL) processes when learning about the circulatory system using hypermedia. We examined participants' verbal protocols to determine the relationship between SRL processes and qualitative shifts in students' mental models from pretest to posttest. Results indicated that…

The state of the art in evaluating the performance of department chairs and division heads.

PubMed

Dunning, David G; Durham, Timothy M; Aksu, Mert N; Lange, Brian M

2007-04-01

This study explores the little understood process of evaluating the performance of department chairs/division heads in dental schools. Specifically, this research aimed to elucidate the methods, processes, and outcomes related to the job performance of department chairs/division heads. Forty-three deans and 306 chairs completed surveys with both close-ended and open-ended questions. In addition, ten deans and ten chairs were interviewed. Results indicate that 80 to 90 percent of department chairs are formally evaluated, although as many as 50 percent may lack job descriptions. Recommended best practices for performance appraisal--such as having at least yearly appraisals, holding face-to-face meetings, and setting specific, personal performance objectives/benchmarks for chairs--are being used in most schools. Still, there is much room to improve appraisals by incorporating other recommended practices. Overall high levels of satisfaction were reported by both chairs and deans for the process and outcomes of appraisals. Qualitative data showed some convergence of opinions about appraisals with the notable exception of informal feedback. We explore some implications of these results, especially as they relate to improving performance appraisals.

Improving contraceptive choice: fidelity of implementation and the gap between effectiveness and efficacy.

PubMed

Garbers, Samantha; Flandrick, Kathleen; Bermudez, Dayana; Meserve, Allison; Chiasson, Mary Ann

2014-11-01

Interventions to reduce unintended pregnancy through improved contraceptive use are a public health priority. A comprehensive process evaluation of a contraceptive assessment module intervention with demonstrated efficacy was undertaken. The 12-month process evaluation goal was to describe the extent to which the intervention was implemented as intended over time, and to identify programmatic adjustments to improve implementation fidelity. Quantitative and qualitative methods included staff surveys, electronic health record data, usage monitoring, and observations. Fidelity of implementation was low overall (<10% of eligible patients completed the entire module [dose received]). Although a midcourse correction making the module available in clinical areas led to increased dose delivered (23% vs. 30%, chi-square test p = .006), dose received did not increase significantly after this adjustment. Contextual factors including competing organizational and staff priorities and staff buy-in limited the level of implementation and precluded adoption of some strategies such as adjusting patient flow. Using a process evaluation framework enabled the research team to identify and address complexities inherent in effectiveness studies and facilitated the alignment of program and context. © 2014 Society for Public Health Education.

Older adults' perspectives on the process of becoming users of assistive technology: a qualitative systematic review and meta-synthesis.

PubMed

Larsen, Stina Meyer; Mortensen, Rikke Falgreen; Kristensen, Hanne Kaae; Hounsgaard, Lise

2018-04-22

To identify, synthesize, and evaluate existing literature concerning the process of becoming a user of assistive technology (AT). A systematic review and meta-synthesis were carried out. Five bibliographic databases (MEDLINE via PubMed, CINAHL, Web of Science, PsycINFO and SocINDEX) were systematically searched up to 13 th of March 2017, using two sets of search terms: (i) elderly and synonyms and (ii) assistive technology and similar words, and combined with a qualitative research filter. Articles were screened, read and critically assessed. The meta-synthesis was guided by Ricoeur's theory of interpretation. Seventeen out of 4645 articles were included. Five phases emerged relating to the process of becoming a user of AT: phase A: Evaluating need, phase B: Acknowledging need, phase C: Incorporating the AT into daily life, phase D: Using the AT, and phase E: Future use. Three transitions, describing factors essential to moving from one phase to the next, were identified; from phase A-B: Valued activities are threatened, from phase B-C: Obtaining the AT and from phase C-D: Trust in the AT. No transition was identified from phase D-E. The meta-synthesis led to a deeper understanding of the process of older adults becoming users of AT, by exploring findings across the included articles. The identified phases and transitions in the systematic review serve as an analytical framework for understanding the process from the older adult's perspective. This review advocates for using a client-centred approach throughout the entire delivery process. Implications for rehabilitation The process of the older adult becoming a user of AT involves an individualized time factor, and this supports the practice of individualized follow-up. The process of becoming a user of AT is closely related to self-image; healthcare professionals should support not only the use of AT but also the older adult's emotional adjustment to a new self-image. The process is highly influenced by the older adult's social context; healthcare professionals should consider involving the client's social network in the AT delivery process.

How qualitative research can contribute to research in the intensive care unit.

PubMed

Sinuff, Tasnim; Cook, Deborah J; Giacomini, Mita

2007-06-01

A qualitative research design can provide unique contributions to research in the intensive care unit. Qualitative research includes the entire process of research: the methodology (conceptualization of the research question, choosing the appropriate qualitative strategy, designing the protocol), methods (conducting the research using qualitative methods within the chosen qualitative strategy, analysis of the data, verification of the findings), and writing the narrative. The researcher is the instrument and the data are the participants' words and experiences that are collected and coded to present experiences, discover themes, or build theories. A number of strategies are available to conduct qualitative research and include grounded theory, phenomenology, case study, and ethnography. Qualitative methods can be used to understand complex phenomena that do not lend themselves to quantitative methods of formal hypothesis testing. Qualitative research may be used to gain insights about organizational and cultural issues within the intensive care unit and to improve our understanding of social interaction and processes of health care delivery. In this article, we outline the rationale for, and approaches to, using qualitative research to inform critical care issues. We provide an overview of qualitative methods available and how they can be used alone or in concert with quantitative methods. To illustrate how our understanding of social phenomena such as patient safety and behavior change has been enhanced we use recent qualitative studies in acute care medicine.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

PubMed

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Practice guidelines in the context of primary care, learning and usability in the physicians' decision-making process--a qualitative study.

PubMed

Ingemansson, Maria; Bastholm-Rahmner, Pia; Kiessling, Anna

2014-08-20

Decision-making is central for general practitioners (GP). Practice guidelines are important tools in this process but implementation of them in the complex context of primary care is a challenge. The purpose of this study was to explore how GPs approach, learn from and use practice guidelines in their day-to-day decision-making process in primary care. A qualitative approach using focus-group interviews was chosen in order to provide in-depth information. The participants were 22 GPs with a median of seven years of experience in primary care, representing seven primary healthcare centres in Stockholm, Sweden in 2011. The interviews focused on how the GPs use guidelines in their decision-making, factors that influence their decision how to approach these guidelines, and how they could encourage the learning process in routine practice.Data were analysed by qualitative content analysis. Meaning units were condensed and grouped in categories. After interpreting the content in the categories, themes were created. Three themes were conceptualized. The first theme emphasized to use guidelines by interactive contextualized dialogues. The categories underpinning this theme: 1. Feedback by peer-learning 2. Feedback by collaboration, mutual learning, and equality between specialties, identified important ways to achieve this learning dialogue. Confidence was central in the second theme, learning that establishes confidence to provide high quality care. Three aspects of confidence were identified in the categories of this theme: 1. Confidence by confirmation, 2. Confidence by reliability and 3. Confidence by evaluation of own results. In the third theme, learning by use of relevant evidence in the decision-making process, we identified two categories: 1. Design and lay-out visualizing the evidence 2. Accessibility adapted to the clinical decision-making process as prerequisites for using the practice guidelines. Decision-making in primary care is a dual process that involves use of intuitive and analytic thinking in a balanced way in order to provide high quality care. Key aspects of effective learning in this clinical decision-making process were: contextualized dialogue, which was based on the GPs' own experiences, feedback on own results and easy access to short guidelines perceived as trustworthy.

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Rapid Delivery of Cyber Capabilities: Evaluation of the Requirement for a Rapid Cyber Acquisition Process

DTIC Science & Technology

2012-06-01

record (PoR) to give both a quantitative and qualitative perspective on the rapid cyber acquisitions framework . It also investigates if cyber operations...acquisition is a complex topic that does not yet have a solidified framework . To scope this research, a comprehensive review of past, present and...for AT&L is working with the DoD cyberspace community to develop a common framework for Services and Agencies to acquire capabilities for cyberspace

Use of Evidence in the Implementation of Social Programs: A Qualitative Study from Chile.

PubMed

Flores, Rodrigo; Naranjo, Carola; Hein, Andreas

2016-01-01

Through this qualitative, empirical study the authors aim to explore and describe the sources of knowledge that are used to guide intervention practice by social workers in Chile. Particular attention was paid to factors that may facilitate or hinder the use of research-based evidence to guide social interventions design, implementation, and outcome evaluation. In order to explore these issues, 25 semi-structured interviews with social workers from Chilean social service non-profit organizations were conducted. The main findings suggest that social workers do not use research-based evidence to support their social interventions due to various personal organizational constraints (e.g., lack of time, lack of access to resources for disseminating evidence, lack of English command). In addition, no evaluation processes of social programs which will support evidence-based effectiveness could be found. One key barrier to support use of evidence and evidence production may be related to the fact that most non-governmental organizations maintain a hierarchical and vertical relationship with state agencies (program design, oversight, and funding) for social program development.

Using Signal Detection Theory and Time Window-based Human-In-The-Loop simulation as a tool for assessing the effectiveness of different qualitative shapes in continuous monitoring tasks.

PubMed

Kim, Jung Hyup; Rothrock, Ling; Laberge, Jason

2014-05-01

This paper provides a case study of Signal Detection Theory (SDT) as applied to a continuous monitoring dual-task environment. Specifically, SDT was used to evaluate the independent contributions of sensitivity and bias to different qualitative gauges used in process control. To assess detection performance in monitoring the gauges, we developed a Time Window-based Human-In-The-Loop (TWHITL) simulation bed. Through this test bed, we were able to generate a display similar to those monitored by console operators in oil and gas refinery plants. By using SDT and TWHITL, we evaluated the sensitivity, operator bias, and response time of flow, level, pressure, and temperature gauge shapes developed by Abnormal Situation Management(®) (ASM(®)) Consortium (www.asmconsortium.org). Our findings suggest that display density influences the effectiveness of participants in detecting abnormal shapes. Furthermore, results suggest that some shapes elicit better detection performance than others. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

The syphilis elimination project: targeting the Hispanic community of Baltimore city.

PubMed

Endyke-Doran, Cara; Gonzalez, Rosa Maria; Trujillo, Marangellie; Solera, Angelo; Vigilance, Pierre N; Edwards, Lori A; Groves, Sara L

2007-01-01

The objective of the Syphilis Elimination Project was to decrease the incidence of syphilis in the Hispanic community of Baltimore City through a culturally appropriate health initiative. Both qualitative and quantitative methods were used in the study design. Surveillance data were used to collect testing information. Comparisons at the start and end of the project measured change in individual knowledge about syphilis. Cross-sectional data from interviews with business owners and qualitative comments from outreach workers evaluated perception of program effectiveness. The local health department collected surveillance data. A convenience sample of 63 Hispanic community members, 12 business owners/managers, and 8 outreach workers was utilized throughout the evaluation process. The project was a culturally appropriate approach to health promotion with street and business outreach. Post intervention there was a statistically significant increase in knowledge about syphilis within the Hispanic community and an increase in testing behaviors. The Syphilis Elimination Project was created in response to a marked increase in syphilis in Baltimore among the Hispanic population and a health disparity that existed within the city. It increased community members' knowledge of syphilis and positively influenced testing behaviors.

Simulation of the regional groundwater-flow system of the Menominee Indian Reservation, Wisconsin

USGS Publications Warehouse

Juckem, Paul F.; Dunning, Charles P.

2015-01-01

The likely extent of the Neopit wastewater plume was simulated by using the groundwater-flow model and Monte Carlo techniques to evaluate the sensitivity of predictive simulations to a range of model parameter values. Wastewater infiltrated from the currently operating lagoons flows predominantly south toward Tourtillotte Creek. Some of the infiltrated wastewater is simulated as having a low probability of flowing beneath Tourtillotte Creek to the nearby West Branch Wolf River. Results for the probable extent of the wastewater plume are considered to be qualitative because the method only considers advective flow and does not account for processes affecting contaminant transport in porous media. Therefore, results for the probable extent of the wastewater plume are sensitive to the number of particles used to represent flow from the lagoon and the resolution of a synthetic grid used for the analysis. Nonetheless, it is expected that the qualitative results may be of use for identifying potential downgradient areas of concern that can then be evaluated using the quantitative “area contributing recharge to wells” method or traditional contaminant-transport simulations.

Statins and Voriconazole Induce Programmed Cell Death in Acanthamoeba castellanii

PubMed Central

López-Arencibia, Atteneri; Sifaoui, Ines; Reyes-Batlle, María; Valladares, Basilio; Martínez-Carretero, Enrique; Piñero, José E.; Maciver, Sutherland K.; Lorenzo-Morales, Jacob

2015-01-01

Members of the genus Acanthamoeba are facultative pathogens of humans, causing a sight-threatening keratitis and a life-threatening encephalitis. In order to treat those infections properly, it is necessary to target the treatment not only to the trophozoite but also to the cyst. Furthermore, it may be advantageous to avoid parasite killing by necrosis, which may induce local inflammation. We must also avoid toxicity of host tissue. Many drugs which target eukaryotes are known to induce programmed cell death (PCD), but this process is poorly characterized in Acanthamoeba. Here, we study the processes of programmed cell death in Acanthamoeba, induced by several drugs, such as statins and voriconazole. We tested atorvastatin, fluvastatin, simvastatin, and voriconazole at the 50% inhibitory concentrations (IC50s) and IC90s that we have previously established. In order to evaluate this phenomenon, we investigated the DNA fragmentation, one of the main characteristics of PCD, with quantitative and qualitative techniques. Also, the changes related to phosphatidylserine exposure on the external cell membrane and cell permeability were studied. Finally, because caspases are key to PCD pathways, caspase activity was evaluated in Acanthamoeba. All the drugs assayed in this study induced PCD in Acanthamoeba. To the best of our knowledge, this is the first study where PCD induced by drugs is described quantitatively and qualitatively in Acanthamoeba. PMID:25733513

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

[Criteria of scientific validity in research].

PubMed

Pelletier, Céline; Pagé, Ginette

2002-03-01

The purpose of this article is to present the evaluative criteria of qualitative and quantitative research. Philosophical foundations of positivism, postpositivism and constructivism are explored. Triangulation and crystallization expose the controversies about them. Finally, Lincoln and Guba criteria are retained for the evaluation of qualitative and quantitative research.

Formative Qualitative Evaluation for "Exploratory" ITS Research.

ERIC Educational Resources Information Center

Murray, Tom

1993-01-01

Discusses evaluation methods applicable to exploratory research areas, provides an overview of qualitative and formative methods for exploratory research on intelligent tutoring systems (ITS) and describes an exploratory study in ITS knowledge acquisition which involved working with three educators to build an ITS for high school physics.…

Developing a change model for peer worker interventions in mental health services: a qualitative research study.

PubMed

Gillard, S; Gibson, S L; Holley, J; Lucock, M

2015-10-01

A range of peer worker roles are being introduced into mental health services internationally. There is some evidence that attests to the benefits of peer workers for the people they support but formal trial evidence in inconclusive, in part because the change model underpinning peer support-based interventions is underdeveloped. Complex intervention evaluation guidance suggests that understandings of how an intervention is associated with change in outcomes should be modelled, theoretically and empirically, before the intervention can be robustly evaluated. This paper aims to model the change mechanisms underlying peer worker interventions. In a qualitative, comparative case study of ten peer worker initiatives in statutory and voluntary sector mental health services in England in-depth interviews were carried out with 71 peer workers, service users, staff and managers, exploring their experiences of peer working. Using a Grounded Theory approach we identified core processes within the peer worker role that were productive of change for service users supported by peer workers. Key change mechanisms were: (i) building trusting relationships based on shared lived experience; (ii) role-modelling individual recovery and living well with mental health problems; (iii) engaging service users with mental health services and the community. Mechanisms could be further explained by theoretical literature on role-modelling and relationship in mental health services. We were able to model process and downstream outcomes potentially associated with peer worker interventions. An empirically and theoretically grounded change model can be articulated that usefully informs the development, evaluation and planning of peer worker interventions.

Comparative evaluation of the remineralizing efficacy of calcium sodium phosphosilicate agent and fluoride based on quantitative and qualitative analysis.

PubMed

Mony, Saranya; Rao, Arathi; Shenoy, Ramya; Suprabha, Baranya Srikrishna

2015-01-01

Calcium sodium phosphosilicate (NovaMin) is an agent that is claimed to release calcium and phosphate ions intraorally to help the self-repair process of enamel. It is used extensively as a desensitizing agent, but the chemical reactions that occur may promote apatite formation enhancing remineralization. The present study was undertaken to evaluate the ability of NovaMin to remineralize an experimentally induced demineralized lesion. The evaluation was done based on the quantitative and qualitative analysis of enamel over the period of 15 and 30 days. A sample of 120 noncarious premolar teeth extracted for orthodontic reasons were used for the study. Baseline data for hardness, Ca/PO 4 , and surface characteristics before and after demineralization process was obtained. All the teeth were brushed twice daily at 12 h interval with the test agents using a powered toothbrush for 2 min. The samples were tested on the 15 th and 30 th day. Calcium phosphate ratio and hardness in both the groups improved during the study period. Fluoride group showed higher values for Ca/PO 4 and hardness but was not statistically significant with the P > 0.05. Scanning electron microscope pictures showed that the deposition of the material over the decalcified enamel is more smoother and uniform with NovaMin and more irregular with fluoride. NovaMin is found to be as effective in improving the Ca/PO 4 ratio and hardness in a demineralized enamel as fluoride. Hence, it can be a new alternate material for remineralization of enamel with less toxic effects compared to fluorides.

Comparisons of in vitro root caries models.

PubMed

Wefel, J S; Heilman, J R; Jordan, T H

1995-01-01

The purpose of this article is to compare various model systems for the production of in vitro root caries and to assess their ability to simulate the naturally occurring root caries process. Partially saturated buffer models and gel models were evaluated using polarized light microscopy and both qualitative and quantitative microradiography. All model systems showed very similar lesion formation when examined under polarized light. When microradiographs were compared, the systems which contained fluoride, showed clear radiopaque bands within the lesion. The bands, which occurred only in the presence of fluoride, appeared to be due to remineralization. When using an in vitro system that simulates the natural root caries process, it is imperative to understand the components of the particular model, as well as its limitations, and to be aware of the need for more than one evaluative technique.

Autonomy through identification: a qualitative study of the process of identification used by people with type 2 diabetes.

PubMed

Moser, Albine; van der Bruggen, Harry; Spreeuwenberg, Cor; Widdershoven, Guy

2008-04-01

The aim of this study is to clarify the process of identification with diabetes as a dimension of autonomy as described by people with type 2 diabetes. People with type 2 diabetes view autonomy as competency in shaping one's life. This concept of autonomy has seven dimensions, which emerged as categories in prior research. Dynamic processes shape these dimensions of autonomy. One of the dimensions of autonomy is identification. This study has a qualitative descriptive and exploratory design and an inductive approach as described in grounded theory. Data were collected by means of in-depth interviews. The sample consisted of 15 people with type 2 diabetes mellitus in a nurse-led, shared-care setting in the Netherlands. The phases of identification are comprehending, struggling, evaluating and mastering. Each phase has its own characteristics. Identifying with the diabetes is a non-linear, cyclical and continuous process because people with diabetes have to deal with changing conditions. The dynamics of identification is directed to a process of identifying with diabetes and its care requirement. Recognizing identification as an element of autonomy enables nurses to adopt a more patient-oriented view of autonomy. Nursing that fosters the process of identification promotes autonomy. This implies that a person with diabetes should be able to identify with the nurse's interventions. Hence it is vital that nurses build supportive partnerships when providing care for such a patient.

Are we ready to accept the challenge? Addressing the shortcomings of contemporary qualitative health research.

PubMed

Lau, Sofie Rosenlund; Traulsen, Janine M

Qualitative approaches represent an important contributor to health care research. However, several researchers argue that contemporary qualitative research does not live up to its full potential. By presenting a snapshot of contemporary qualitative research in the field of social and administrative pharmacy, this study challenges contributors to the field by asking: Are we ready to accept the challenge and take qualitative research one step further? The purpose of this study was to initiate a constructive dialogue on the need for increased transparency in qualitative data analysis, including explicitly reflecting upon theoretical perspectives affecting the research process. Content analysis was used to evaluate levels of theoretical visibility and analysis transparency in selected qualitative research articles published in Research in Social and Administrative Pharmacy between January 2014 and January 2015. In 14 out of 21 assessed papers, the use of theory was found to be Seemingly Absent (lowest level of theory use), and the data analyses did not include any interpretive endeavors. Only two papers consistently applied theory throughout the entire study and clearly took the data analyses from a descriptive to an interpretive level. It was found that the aim of the majority of assessed papers was to change or modify a given practice, which however, resulted in a lack of both theoretical underpinnings and analysis transparency. This study takes the standpoint that theory and high-quality analysis go hand-in-hand. Based on the content analysis, articles that were deemed to be high in quality were explicit about the theoretical framework of their study and transparent in how they analyzed their data. It was found that theory contributed to the transparency of how the data were analyzed and interpreted. Two ways of improving contemporary qualitative research in the field of social and administrative pharmacy are discussed: engaging with social theory and establishing close collaboration with social scientists. Copyright © 2016 Elsevier Inc. All rights reserved.

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review. PMID:17325406

Process and impact evaluation of the Greater Christchurch Urban Development Strategy Health Impact Assessment

PubMed Central

Mathias, Kaaren R; Harris-Roxas, Ben

2009-01-01

Background despite health impact assessment (HIA) being increasingly widely used internationally, fundamental questions about its impact on decision-making, implementation and practices remain. In 2005 a collaboration between public health and local government authorities performed an HIA on the Christchurch Urban Development Strategy Options paper in New Zealand. The findings of this were incorporated into the Greater Christchurch Urban Development Strategy; Methods using multiple qualitative methodologies including key informant interviews, focus groups and questionnaires, this study performs process and impact evaluations of the Christchurch HIA including evaluation of costs and resource use; Results the evaluation found that the HIA had demonstrable direct impacts on planning and implementation of the final Urban Development Strategy as well as indirect impacts on understandings and ways of working within and between organisations. It also points out future directions and ways of working in this successful collaboration between public health and local government authorities. It summarises the modest resource use and discusses the important role HIA can play in urban planning with intersectoral collaboration and enhanced relationships as both catalysts and outcomes of the HIA process; Conclusion as one of the few evaluations of HIA that have been published to date, this paper makes a substantial contribution to the literature on the impact, utility and effectiveness of HIA. PMID:19344529

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study).

PubMed

Haynes, Abby; Brennan, Sue; Carter, Stacy; O'Connor, Denise; Schneider, Carmen Huckel; Turner, Tari; Gallego, Gisselle

2014-09-27

Process evaluation is vital for understanding how interventions function in different settings, including if and why they have different effects or do not work at all. This is particularly important in trials of complex interventions in 'real world' organisational settings where causality is difficult to determine. Complexity presents challenges for process evaluation, and process evaluations that tackle complexity are rarely reported. This paper presents the detailed protocol for a process evaluation embedded in a randomised trial of a complex intervention known as SPIRIT (Supporting Policy In health with Research: an Intervention Trial). SPIRIT aims to build capacity for using research in health policy and program agencies. We describe the flexible and pragmatic methods used for capturing, managing and analysing data across three domains: (a) the intervention as it was implemented; (b) how people participated in and responded to the intervention; and (c) the contextual characteristics that mediated this relationship and may influence outcomes. Qualitative and quantitative data collection methods include purposively sampled semi-structured interviews at two time points, direct observation and coding of intervention activities, and participant feedback forms. We provide examples of the data collection and data management tools developed. This protocol provides a worked example of how to embed process evaluation in the design and evaluation of a complex intervention trial. It tackles complexity in the intervention and its implementation settings. To our knowledge, it is the only detailed example of the methods for a process evaluation of an intervention conducted as part of a randomised trial in policy organisations. We identify strengths and weaknesses, and discuss how the methods are functioning during early implementation. Using 'insider' consultation to develop methods is enabling us to optimise data collection while minimising discomfort and burden for participants. Embedding the process evaluation within the trial design is facilitating access to data, but may impair participants' willingness to talk openly in interviews. While it is challenging to evaluate the process of conducting a randomised trial of a complex intervention, our experience so far suggests that it is feasible and can add considerably to the knowledge generated.

The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research.

PubMed

Boyce, Maria B; Browne, John P; Greenhalgh, Joanne

2014-06-01

To synthesise qualitative studies that investigated the experiences of healthcare professionals with using information from patient-reported outcome measures (PROMs) to improve the quality of care. A qualitative systematic review was conducted by searching PubMed, PsycINFO and CINAHL with no time restrictions. Hand searching was also performed. Eligible studies were evaluated using the Critical Appraisal Skills Programme toolkit for qualitative studies. A thematic synthesis identified common themes across studies. Study characteristics were examined to explain differences in findings. All healthcare settings. Healthcare professionals. Professionals' views of PROMs after receiving PROMs feedback about individual patients or groups of patients. Sixteen studies met the inclusion criteria. Barriers and facilitators to the use of PROMs emerged within four main themes: collecting and incorporating the data (practical), valuing the data (attitudinal), making sense of the data (methodological) and using the data to make changes to patient care (impact). Professionals value PROMs when they are useful for the clinical decision-making process. Practical barriers to the routine use of PROMs are prominent when the correct infrastructure is not in place before commencing data collection and when their use is disruptive to normal work routines. Technology can play a greater role in processing the information in the most efficient manner. Improvements to the interpretability of PROMs should increase their use. Attitudes to the use of PROMs may be improved by engaging professionals in the planning stage of the intervention and by ensuring a high level of transparency around the rationale for data collection. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Public involvement in research within care homes: benefits and challenges in the APPROACH study.

PubMed

Froggatt, Katherine; Goodman, Claire; Morbey, Hazel; Davies, Sue L; Masey, Helen; Dickinson, Angela; Martin, Wendy; Victor, Christina

2016-12-01

Public involvement in research (PIR) can improve research design and recruitment. Less is known about how PIR enhances the experience of participation and enriches the data collection process. In a study to evaluate how UK care homes and primary health-care services achieve integrated working to promote older people's health, PIR was integrated throughout the research processes. This paper aims to present one way in which PIR has been integrated into the design and delivery of a multisite research study based in care homes. A prospective case study design, with an embedded qualitative evaluation of PIR activity. Data collection was undertaken in six care homes in three sites in England. Six PIR members participated: all had prior personal or work experience in care homes. Qualitative data collection involved discussion groups, and site-specific meetings to review experiences of participation, benefits and challenges, and completion of structured fieldwork notes after each care home visit. PIR members supported recruitment, resident and staff interviews and participated in data interpretation. Benefits of PIR work were resident engagement that minimized distress and made best use of limited research resources. Challenges concerned communication and scheduling. Researcher support for PIR involvement was resource intensive. Clearly defined roles with identified training and support facilitated involvement in different aspects of the data collection process. This can also ensure that vulnerable older people who participate in research have a positive experience that reinforces the value of their views. © 2015 The Authors Health Expectations Published by John Wiley & Sons Ltd.

Peer support for parents of disabled children part 2: how organizational and process factors influenced shared experience in a one-to-one service, a qualitative study.

PubMed

Shilling, V; Bailey, S; Logan, S; Morris, C

2015-07-01

Parents of disabled children often seek support from their peers. The shared experience between parents appears to be a crucial mediating factor. Understanding how a sense of shared experience is fostered can help to design and evaluate services that seek to provide peer support. We carried out a qualitative study involving semi-structured interviews and focus groups. Participants were 12 parents and 23 befrienders who had contact with the Face2Face one-to-one befriending service in Devon and Cornwall during a 12-month period, and 10 professionals from health, social care and education. Formal structures and processes in place such as training and ongoing supervision and support were highly valued as was the highly personalized, confidential, flexible, one-to-one at-home nature of the service. Crucial to establishing rapport was putting the right people together and ensuring a good match between befrienders and parents. Clearly, the befriending parent has to be emotionally prepared to provide help. However, if the parent being offered support was not ready to accept help at the time it was offered or the type of support was not right for them, they are less likely to engage with the service. Organizational and process factors as well as characteristics of the parents offering and receiving support contribute to the sense of shared experience in one-to-one peer support. These factors interact to influence whether peer support is effective and should be explicitly considered when designing and evaluating services. © 2015 John Wiley & Sons Ltd.

Exposure assessment and risk management of engineered nanoparticles: Investigation in semiconductor wafer processing

NASA Astrophysics Data System (ADS)

Shepard, Michele N.

Engineered nanomaterials (ENMs) are currently used in hundreds of commercial products and industrial processes, with more applications being investigated. Nanomaterials have unique properties that differ from bulk materials. While these properties may enable technological advancements, the potential risks of ENMs to people and the environment are not yet fully understood. Certain low solubility nanoparticles are more toxic than their bulk material, such that existing occupational exposure limits may not be sufficiently protective for workers. Risk assessments are currently challenging due to gaps in data on the numerous emerging materials and applications as well as method uncertainties and limitations. Chemical mechanical planarization (CMP) processes with engineered nanoparticle abrasives are used for research and commercial manufacturing applications in the semiconductor and related industries. Despite growing use, no published studies addressed occupational exposures to nanoparticles associated with CMP or risk assessment and management practices for these scenarios. Additional studies are needed to evaluate potential sources of workplace exposure or emission, as well as to help test and refine assessment methods. This research was conducted to: identify the lifecycle stages and potential exposure sources for ENMs in CMP processes; characterize worker exposure; determine recommended engineering controls and compare risk assessment models. The study included workplace air and surface sampling and an evaluation of qualitative risk banding approaches. Exposure assessment results indicated the potential for worker contact with ENMs on workplace surfaces but did not identify nanoparticles readily dispersed in air during work tasks. Some increases in respirable particle concentrations were identified, but not consistently. Measured aerosol concentrations by number and mass were well below current reference values for poorly soluble low toxicity nanoparticles. From application and evaluation of qualitative risk assessment approaches, differences in control banding models and results were identified, although output generally agreed with conclusions from air sampling as to whether an upgrade in site engineering controls was recommended. This research helped to improve understanding of potential worker exposures to ENMs in CMP processes, as well as the methods for risk assessment and management of metal oxide nanoparticles in occupational environments.

Cognitive Processing Therapy for Spanish-speaking Latinos: A Formative Study of a Model-Driven Cultural Adaptation of the Manual to Enhance Implementation in a Usual Care Setting.

PubMed

Valentine, Sarah E; Borba, Christina P C; Dixon, Louise; Vaewsorn, Adin S; Guajardo, Julia Gallegos; Resick, Patricia A; Wiltsey Stirman, Shannon; Marques, Luana

2017-03-01

As part of a larger implementation trial for cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) in a community health center, we used formative evaluation to assess relations between iterative cultural adaption (for Spanish-speaking clients) and implementation outcomes (appropriateness and acceptability) for CPT. Qualitative data for the current study were gathered through multiple sources (providers: N = 6; clients: N = 22), including CPT therapy sessions, provider fieldnotes, weekly consultation team meetings, and researcher fieldnotes. Findings from conventional and directed content analysis of the data informed refinements to the CPT manual. Data-driven refinements included adaptations related to cultural context (i.e., language, regional variation in wording), urban context (e.g., crime/violence), and literacy level. Qualitative findings suggest improved appropriateness and acceptability of CPT for Spanish-speaking clients. Our study reinforces the need for dual application of cultural adaptation and implementation science to address the PTSD treatment needs of Spanish-speaking clients. © 2016 Wiley Periodicals, Inc.

Qualitative modeling of the decision-making process using electrooculography.

PubMed

Zargari Marandi, Ramtin; Sabzpoushan, S H

2015-12-01

A novel method based on electrooculography (EOG) has been introduced in this work to study the decision-making process. An experiment was designed and implemented wherein subjects were asked to choose between two items from the same category that were presented within a limited time. The EOG and voice signals of the subjects were recorded during the experiment. A calibration task was performed to map the EOG signals to their corresponding gaze positions on the screen by using an artificial neural network. To analyze the data, 16 parameters were extracted from the response time and EOG signals of the subjects. Evaluation and comparison of the parameters, together with subjects' choices, revealed functional information. On the basis of this information, subjects switched their eye gazes between items about three times on average. We also found, according to statistical hypothesis testing-that is, a t test, t(10) = 71.62, SE = 1.25, p < .0001-that the correspondence rate of a subjects' gaze at the moment of selection with the selected item was significant. Ultimately, on the basis of these results, we propose a qualitative choice model for the decision-making task.

Cognitive Processing Therapy for Spanish-speaking Latinos: A formative study of a model-driven cultural adaptation of the manual to enhance implementation in a usual care setting

PubMed Central

Valentine, Sarah E.; Borba, Christina P. C.; Dixon, Louise; Vaewsorn, Adin S.; Guajardo, Julia Gallegos; Resick, Patricia A.; Wiltsey-Stirman, Shannon; Marques, Luana

2016-01-01

Objective As part of a larger implementation trial for Cognitive Processing Therapy (CPT) for posttraumatic stress disorder (PTSD) in a community health center, we used formative evaluation to assess relations between iterative cultural adaption (for Spanish-speaking clients) and implementation outcomes (appropriateness & acceptability) for CPT. Method Qualitative data for the current study were gathered through multiple sources (providers: N=6; clients: N=22), including CPT therapy sessions, provider field notes, weekly consultation team meetings, and researcher field notes. Findings from conventional and directed content analysis of the data informed refinements to the CPT manual. Results Data-driven refinements included adaptations related to cultural context (i.e., language, regional variation in wording), urban context (e.g., crime/violence), and literacy level. Qualitative findings suggest improved appropriateness and acceptability of CPT for Spanish-speaking clients. Conclusion Our study reinforces the need for dual application of cultural adaptation and implementation science to address the PTSD treatment needs of Spanish-speaking clients. PMID:27378013

Breast cancer patients' narrative experiences about communication during the oncology care process: a qualitative study.

PubMed

Abt Sacks, A; Perestelo-Perez, L; Rodriguez-Martin, B; Cuellar-Pompa, L; Algara López, M; González Hernández, N; Serrano-Aguilar, P

2016-09-01

To analyse the perception about the information and communication received to evaluate oncologic care of breast cancer patients in Spain. Qualitative study based on conducting in-depth interviews. An inductive thematic analysis of the illness narratives was performed. Intentional theoretical sampling of 41 people diagnosed with breast cancer. The information provided during care process is assessed as appropriate, as it includes personalised skills focused on communication and considers organisational and contextual issues. In some cases, the information was considered partial, heterogeneous and at times contradictory, which revealed a lack of continuity. To provide and adequately cover information needs from the patient perspective, it is necessary to ensure access, both in its physical (material) and intellectual (comprehension) dimension, keeping in mind elements of social capital (social networks) and cultural capital (values, beliefs, non-verbal language) that facilitate or hinder access. The current state of transition to a horizontal model in the doctor-patient relationship, could account for the difficulties, deficits and contradictions in communication and information that breast cancer patients perceive in many contexts. © 2015 John Wiley & Sons Ltd.

Swiss Armed Forces Organizational Level Leader Development: A Qualitative Case Study

DTIC Science & Technology

2017-06-09

chapter, divided in five distinct parts, describes the chosen research methodology , explain why the qualitative case study is appropriate to conduct...research study uses a qualitative methodology by performing a qualitative case study on the organizational level leader’s development process within...develop an in-depth understsanding of the phenomen.”82 Summary This research study uses a qualitative methodology by performing a case study on the

Latina food patterns in the United States: a qualitative metasynthesis.

PubMed

Gerchow, Lauren; Tagliaferro, Barbara; Squires, Allison; Nicholson, Joey; Savarimuthu, Stella M; Gutnick, Damara; Jay, Melanie

2014-01-01

Obesity disproportionately affects Latinas living in the United States, and cultural food patterns contribute to this health concern. The aim of this study was to synthesize the qualitative results of research regarding Latina food patterns in order to (a) identify common patterns across Latino culture and within Latino subcultures and (b) inform future research by determining gaps in the literature. A systematic search of three databases produced 13 studies (15 manuscripts) that met the inclusion criteria for review. The Critical Appraisal Skills Program tool and the recommendations of Squires for evaluating translation methods in qualitative research were applied to appraise study quality. Authors coded through directed content analysis and an adaptation of the Joanna Briggs Institute Qualitative Assessment and Review Instrument coding template to extract themes. Coding focused on food patterns, obesity, population breakdown, immigration, acculturation, and barriers and facilitators to healthy eating. Other themes and categories emerged from this process to complement this approach. Major findings included the following: (a) Immigration driven changes in scheduling, food choice, socioeconomic status, and family dynamics shape the complex psychology behind healthy food choices for Latina women; (b) in Latina populations, barriers and facilitators to healthy lifestyle choices around food are complex; and (c) there is a clear need to differentiate Latino populations by country of origin in future qualitative studies on eating behavior. Healthcare providers need to recognize the complex influences behind eating behaviors among immigrant Latinas in order to design effective behavior change and goal-setting programs to support healthy lifestyles.

Maintenance = reuse-oriented software development

NASA Technical Reports Server (NTRS)

Basili, Victor R.

1989-01-01

Maintenance is viewed as a reuse process. In this context, a set of models that can be used to support the maintenance process is discussed. A high level reuse framework is presented that characterizes the object of reuse, the process for adapting that object for its target application, and the reused object within its target application. Based upon this framework, a qualitative comparison is offered of the three maintenance process models with regard to their strengths and weaknesses and the circumstances in which they are appropriate. To provide a more systematic, quantitative approach for evaluating the appropriateness of the particular maintenance model, a measurement scheme is provided, based upon the reuse framework, in the form of an organized set of questions that need to be answered. To support the reuse perspective, a set of reuse enablers are discussed.

Implementation of integration strategies between primary care units and a regional general hospital in Brazil to update and connect health care professionals: a quasi-experimental study protocol.

PubMed

Bracco, Mario Maia; Mafra, Ana Carolina Cintra Nunes; Abdo, Alexandre Hannud; Colugnati, Fernando Antonio Basile; Dalla, Marcello Dala Bernardina; Demarzo, Marcelo Marcos Piva; Abrahamsohn, Ises; Rodrigues, Aline Pacífico; Delgado, Ana Violeta Ferreira de Almeida; Dos Prazeres, Glauber Alves; Teixeira, José Carlos; Possa, Silvio

2016-08-12

Better communication among field health care teams and points of care, together with investments focused on improving teamwork, individual management, and clinical skills, are strategies for achieving better outcomes in patient-oriented care. This research aims to implement and evaluate interventions focused on improving communication and knowledge among health teams based on points of care in a regional public health outreach network, assessing the following hypotheses: 1) A better-working communication process between hospitals and primary health care providers can improve the sharing of information on patients as well as patients' outcomes. 2) A skill-upgrading education tool offered to health providers at their work sites can improve patients' care and outcomes. A quasi-experimental study protocol with a mixed-methods approach (quantitative and qualitative) was developed to evaluate communication tools for health care professionals based in primary care units and in a general hospital in the southern region of São Paulo City, Brazil. The usefulness and implementation processes of the integration strategies will be evaluated, considering: 1) An Internet-based communication platform that facilitates continuity and integrality of care to patients, and 2) A tailored updating distance-learning course on ambulatory care sensitive conditions for clinical skills improvements. The observational study will evaluate a non-randomized cohort of adult patients, with historical controls. Hospitalized patients diagnosed with an ambulatory care sensitive condition will be selected and followed for 1 year after hospital discharge. Data will be collected using validated questionnaires and from patients' medical records. Health care professionals will be evaluated related to their use of education and communication tools and their demographic and psychological profiles. The primary outcome measured will be the patients' 30-day hospital readmission rates. A sample size of 560 patients was calculated to fit a valid logistic model. In addition, qualitative approaches will be used to identify subjective perceptions of providers about the implementation process and of patients about health system use. This research project will gather relevant information about implementation processes for education and communication tools and their impact on human resources training, rates of readmission, and patient-related outcomes.

Enhancing the quality and credibility of qualitative analysis.

PubMed

Patton, M Q

1999-12-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems.

Qualitative Analysis of Information Communication Technology Use on Teaching-Learning Process.

ERIC Educational Resources Information Center

Akahori, Kanji

This paper describes some of the features of Information Communication Technology (ICT) and its uses in the teaching-learning process in elementary schools. In most schools, it is difficult for ICT to be used effectively in the teaching-learning process. The author observed many classes using ICT in elementary schools. Qualitative data, such as…

Near infrared spectroscopy combined with multivariate analysis for monitoring the ethanol precipitation process of fraction I + II + III supernatant in human albumin separation

NASA Astrophysics Data System (ADS)

Li, Can; Wang, Fei; Zang, Lixuan; Zang, Hengchang; Alcalà, Manel; Nie, Lei; Wang, Mingyu; Li, Lian

2017-03-01

Nowadays, as a powerful process analytical tool, near infrared spectroscopy (NIRS) has been widely applied in process monitoring. In present work, NIRS combined with multivariate analysis was used to monitor the ethanol precipitation process of fraction I + II + III (FI + II + III) supernatant in human albumin (HA) separation to achieve qualitative and quantitative monitoring at the same time and assure the product's quality. First, a qualitative model was established by using principal component analysis (PCA) with 6 of 8 normal batches samples, and evaluated by the remaining 2 normal batches and 3 abnormal batches. The results showed that the first principal component (PC1) score chart could be successfully used for fault detection and diagnosis. Then, two quantitative models were built with 6 of 8 normal batches to determine the content of the total protein (TP) and HA separately by using partial least squares regression (PLS-R) strategy, and the models were validated by 2 remaining normal batches. The determination coefficient of validation (Rp2), root mean square error of cross validation (RMSECV), root mean square error of prediction (RMSEP) and ratio of performance deviation (RPD) were 0.975, 0.501 g/L, 0.465 g/L and 5.57 for TP, and 0.969, 0.530 g/L, 0.341 g/L and 5.47 for HA, respectively. The results showed that the established models could give a rapid and accurate measurement of the content of TP and HA. The results of this study indicated that NIRS is an effective tool and could be successfully used for qualitative and quantitative monitoring the ethanol precipitation process of FI + II + III supernatant simultaneously. This research has significant reference value for assuring the quality and improving the recovery ratio of HA in industrialization scale by using NIRS.

Near infrared spectroscopy combined with multivariate analysis for monitoring the ethanol precipitation process of fraction I+II+III supernatant in human albumin separation.

PubMed

Li, Can; Wang, Fei; Zang, Lixuan; Zang, Hengchang; Alcalà, Manel; Nie, Lei; Wang, Mingyu; Li, Lian

2017-03-15

Nowadays, as a powerful process analytical tool, near infrared spectroscopy (NIRS) has been widely applied in process monitoring. In present work, NIRS combined with multivariate analysis was used to monitor the ethanol precipitation process of fraction I+II+III (FI+II+III) supernatant in human albumin (HA) separation to achieve qualitative and quantitative monitoring at the same time and assure the product's quality. First, a qualitative model was established by using principal component analysis (PCA) with 6 of 8 normal batches samples, and evaluated by the remaining 2 normal batches and 3 abnormal batches. The results showed that the first principal component (PC1) score chart could be successfully used for fault detection and diagnosis. Then, two quantitative models were built with 6 of 8 normal batches to determine the content of the total protein (TP) and HA separately by using partial least squares regression (PLS-R) strategy, and the models were validated by 2 remaining normal batches. The determination coefficient of validation (R p 2 ), root mean square error of cross validation (RMSECV), root mean square error of prediction (RMSEP) and ratio of performance deviation (RPD) were 0.975, 0.501g/L, 0.465g/L and 5.57 for TP, and 0.969, 0.530g/L, 0.341g/L and 5.47 for HA, respectively. The results showed that the established models could give a rapid and accurate measurement of the content of TP and HA. The results of this study indicated that NIRS is an effective tool and could be successfully used for qualitative and quantitative monitoring the ethanol precipitation process of FI+II+III supernatant simultaneously. This research has significant reference value for assuring the quality and improving the recovery ratio of HA in industrialization scale by using NIRS. Copyright © 2016 Elsevier B.V. All rights reserved.

A comprehensive model to evaluate implementation of the world health organization framework convention of tobacco control

PubMed Central

Sarrafzadegan, Nizal; Kelishad, Roya; Rabiei, Katayoun; Abedi, Heidarali; Mohaseli, Khadijeh Fereydoun; Masooleh, Hasan Azaripour; Alavi, Mousa; Heidari, Gholamreza; Ghaffari, Mostafa; O’Loughlin, Jennifer

2012-01-01

Background: Iran is one of the countries that has ratified the World Health Organization Framework Convention of Tobacco Control (WHO-FCTC), and has implemented a series of tobacco control interventions including the Comprehensive Tobacco Control Law. Enforcement of this legislation and assessment of its outcome requires a dedicated evaluation system. This study aimed to develop a generic model to evaluate the implementation of the Comprehensive Tobacco Control Law in Iran that was provided based on WHO-FCTC articles. Materials and Methods: Using a grounded theory approach, qualitative data were collected from 265 subjects in individual interviews and focus group discussions with policymakers who designed the legislation, key stakeholders, and members of the target community. In addition, field observations data in supermarkets/shops, restaurants, teahouses and coffee shops were collected. Data were analyzed in two stages through conceptual theoretical coding. Findings: Overall, 617 open codes were extracted from the data into tables; 72 level-3 codes were retained from the level-2 code series. Using a Model Met paradigm, the relationships between the components of each paradigm were depicted graphically. The evaluation model entailed three levels, namely: short-term results, process evaluation and long-term results. Conclusions: Central concept of the process of evaluation is that enforcing the law influences a variety of internal and environmental factors including legislative changes. These factors will be examined during the process evaluation and context evaluation. The current model can be applicable for providing FCTC evaluation tools across other jurisdictions. PMID:23833621