Commentary: Writing and Evaluating Qualitative Research Reports

PubMed Central

Thompson, Deborah; Aroian, Karen J.; McQuaid, Elizabeth L.; Deatrick, Janet A.

2016-01-01

Objective To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. Methods A question and answer format is used to address considerations for writing and evaluating qualitative research. Results and Conclusions When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field’s ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. PMID:27118271

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

1988-01-01

Discusses qualitative research and its application to educational evaluation. Approaches discussed include the following: (1) ethnography; (2) naturalistic inquiry; (3) generic pragmatic (sociological) inquiry; (4) connoisseurship/criticism; (5) metaphors; and (6) phenomenography. (FMW)

Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

PubMed

Wang, Karen E; Fitzpatrick, Caroline; George, David; Lane, Lindsey

2012-01-01

Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their effectiveness as evaluators. The objective is to examine affiliate faculty members' attitudes toward clinical clerkship evaluation using primarily qualitative research methods. The study used a nonexperimental research design and employed mixed methods. Data were collected through interviews, focus groups, and a questionnaire from 11 affiliate faculty members. Themes emerging from the data fell into three broad categories: (a) factors that influence grading, (b) consequences of negative evaluations, and (c) disconnections in the grading process. The quantitative portion of the study revealed important discrepancies supporting the use of qualitative methods. The study highlights faculty members' struggles with the evaluative process and emphasizes the need for improvements in evaluation tools and faculty development.

Methodological Reflections on the Contribution of Qualitative Research to the Evaluation of Clinical Ethics Support Services.

PubMed

Wäscher, Sebastian; Salloch, Sabine; Ritter, Peter; Vollmann, Jochen; Schildmann, Jan

2017-05-01

This article describes a process of developing, implementing and evaluating a clinical ethics support service intervention with the goal of building up a context-sensitive structure of minimal clinical-ethics in an oncology department without prior clinical ethics structure. Scholars from different disciplines have called for an improvement in the evaluation of clinical ethics support services (CESS) for different reasons over several decades. However, while a lot has been said about the concepts and methodological challenges of evaluating CESS up to the present time, relatively few empirical studies have been carried out. The aim of this article is twofold. On the one hand, it describes a process of development, modifying and evaluating a CESS intervention as part of the ETHICO research project, using the approach of qualitative-formative evaluation. On the other hand, it provides a methodological analysis which specifies the contribution of qualitative empirical methods to the (formative) evaluation of CESS. We conclude with a consideration of the strengths and limitations of qualitative evaluation research with regards to the evaluation and development of context sensitive CESS. We further discuss our own approach in contrast to rather traditional consult or committee models. © 2017 John Wiley & Sons Ltd.

[Qualitative Research in Health Services Research - Discussion Paper, Part 3: Quality of Qualitative Research].

PubMed

Stamer, M; Güthlin, C; Holmberg, C; Karbach, U; Patzelt, C; Meyer, T

2015-12-01

The third and final discussion paper of the German Network of Health Services Research's (DNVF) "Qualitative Methods Working Group" demonstrates methods for the evaluation and quality of qualitative research in health services research. In this paper we discuss approaches described in evaluating qualitative studies, including: an orientation to the general principles of empirical research, an approach-specific course of action, as well as procedures based on the research-process and criteria-oriented approaches. Divided into general and specific aspects to be considered in a qualitative study quality evaluation, the central focus of the discussion paper undertakes an extensive examination of the process and criteria-oriented approaches. The general aspects include the participation of relevant groups in the research process as well as ethical aspects of the research and data protection issues. The more specific aspects in evaluating the quality of qualitative research include considerations about the research interest, research questions, and the selection of data collection methods and types of analyses. The formulated questions are intended to guide reviewers and researchers to evaluate and to develop qualitative research projects appropriately. The intention of this discussion paper is to ensure a transparent research culture, and to reflect on and discuss the methodological and research approach of qualitative studies in health services research. With this paper we aim to initiate a discussion on high quality evaluation of qualitative health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Ethnographic methods for process evaluations of complex health behaviour interventions.

PubMed

Morgan-Trimmer, Sarah; Wood, Fiona

2016-05-04

This article outlines the contribution that ethnography could make to process evaluations for trials of complex health-behaviour interventions. Process evaluations are increasingly used to examine how health-behaviour interventions operate to produce outcomes and often employ qualitative methods to do this. Ethnography shares commonalities with the qualitative methods currently used in health-behaviour evaluations but has a distinctive approach over and above these methods. It is an overlooked methodology in trials of complex health-behaviour interventions that has much to contribute to the understanding of how interventions work. These benefits are discussed here with respect to three strengths of ethnographic methodology: (1) producing valid data, (2) understanding data within social contexts, and (3) building theory productively. The limitations of ethnography within the context of process evaluations are also discussed.

[Reconstituting evaluation methods based on both qualitative and quantitative paradigms].

PubMed

Miyata, Hiroaki; Okubo, Suguru; Yoshie, Satoru; Kai, Ichiro

2011-01-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confusing and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. In this study we conducted content analysis regarding evaluation methods of qualitative healthcare research. We extracted descriptions on four types of evaluation paradigm (validity/credibility, reliability/credibility, objectivity/confirmability, and generalizability/transferability), and classified them into subcategories. In quantitative research, there has been many evaluation methods based on qualitative paradigms, and vice versa. Thus, it might not be useful to consider evaluation methods of qualitative paradigm are isolated from those of quantitative methods. Choosing practical evaluation methods based on the situation and prior conditions of each study is an important approach for researchers.

Commentary: Writing and Evaluating Qualitative Research Reports.

PubMed

Wu, Yelena P; Thompson, Deborah; Aroian, Karen J; McQuaid, Elizabeth L; Deatrick, Janet A

2016-06-01

To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field's ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Neonatal Intensive Care Nursing Curriculum Challenges based on Context, Input, Process, and Product Evaluation Model: A Qualitative Study.

PubMed

Ashghali-Farahani, Mansoureh; Ghaffari, Fatemeh; Hoseini-Esfidarjani, Sara-Sadat; Hadian, Zahra; Qomi, Robabeh; Dargahi, Helen

2018-01-01

Weakness of curriculum development in nursing education results in lack of professional skills in graduates. This study was done on master's students in nursing to evaluate challenges of neonatal intensive care nursing curriculum based on context, input, process, and product (CIPP) evaluation model. This study was conducted with qualitative approach, which was completed according to the CIPP evaluation model. The study was conducted from May 2014 to April 2015. The research community included neonatal intensive care nursing master's students, the graduates, faculty members, neonatologists, nurses working in neonatal intensive care unit (NICU), and mothers of infants who were hospitalized in such wards. Purposeful sampling was applied. The data analysis showed that there were two main categories: "inappropriate infrastructure" and "unknown duties," which influenced the context formation of NICU master's curriculum. The input was formed by five categories, including "biomedical approach," "incomprehensive curriculum," "lack of professional NICU nursing mentors," "inappropriate admission process of NICU students," and "lack of NICU skill labs." Three categories were extracted in the process, including "more emphasize on theoretical education," "the overlap of credits with each other and the inconsistency among the mentors," and "ineffective assessment." Finally, five categories were extracted in the product, including "preferring routine work instead of professional job," "tendency to leave the job," "clinical incompetency of graduates," "the conflict between graduates and nursing staff expectations," and "dissatisfaction of graduates." Some changes are needed in NICU master's curriculum by considering the nursing experts' comments and evaluating the consequences of such program by them.

Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

Using new media to build social capital for health: a qualitative process evaluation study of participation in the CityNet project.

PubMed

Bolam, Bruce; McLean, Carl; Pennington, Andrew; Gillies, Pamela

2006-03-01

The present article presents an exploratory qualitative process evaluation study of 'Ambassador' participation in CityNet, an innovative information-communication technology-based (ICT) project that aims to build aspects of social capital and improve access to information and services among disadvantaged groups in Nottingham, UK. A purposive sample of 40 'Ambassadors' interviewees was gathered in three waves of data collection. The two emergent analytic themes highlighted how improvements in confidence, self-esteem and social networks produced via participation were mitigated by structural problems in devolving power within the project. This illustrates how concepts of power are important for understanding the process of health promotion interventions using new media.

Using qualitative and quantitative methods to evaluate small-scale disease management pilot programs.

PubMed

Esposito, Dominick; Taylor, Erin Fries; Gold, Marsha

2009-02-01

Interest in disease management programs continues to grow as managed care plans, the federal and state governments, and other organizations consider such efforts as a means to improve health care quality and reduce costs. These efforts vary in size, scope, and target population. While large-scale programs provide the means to measure impacts, evaluation of smaller interventions remains valuable as they often represent the early planning stages of larger initiatives. This paper describes a multi-method approach for evaluating small interventions that sought to improve the quality of care for Medicaid beneficiaries with multiple chronic conditions. Our approach relied on quantitative and qualitative methods to develop a complete understanding of each intervention. Quantitative data in the form of both process measures, such as case manager contacts, and outcome measures, such as hospital use, were reported and analyzed. Qualitative information was collected through interviews and the development of logic models to document the flow of intervention activities and how they were intended to affect outcomes. The logic models helped us to understand the underlying reasons for the success or lack thereof of each intervention. The analysis provides useful information on several fronts. First, qualitative data provided valuable information about implementation. Second, process measures helped determine whether implementation occurred as anticipated. Third, outcome measures indicated the potential for favorable results later, possibly suggesting further study. Finally, the evaluation of qualitative and quantitative data in combination helped us assess the potential promise of each intervention and identify common themes and challenges across all interventions.

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Toward an agenda for evaluation of qualitative research.

PubMed

Stige, Brynjulf; Malterud, Kirsti; Midtgarden, Torjus

2009-10-01

Evaluation is essential for research quality and development, but the diversity of traditions that characterize qualitative research suggests that general checklists or shared criteria for evaluation are problematic. We propose an approach to research evaluation that encourages reflexive dialogue through use of an evaluation agenda. In proposing an evaluation agenda we shift attention from rule-based judgment to reflexive dialogue. Unlike criteria, an agenda may embrace pluralism, and does not request consensus on ontological, epistemological, and methodological issues, only consensus on what themes warrant discussion. We suggest an evaluation agenda-EPICURE-with two dimensions communicated through use of two acronyms.The first, EPIC, refers to the challenge of producing rich and substantive accounts based on engagement, processing, interpretation, and (self-)critique. The second-CURE-refers to the challenge of dealing with preconditions and consequences of research, with a focus on (social) critique, usefulness, relevance, and ethics. The seven items of the composite agenda EPICURE are presented and exemplified. Features and implications of the agenda approach to research evaluation are then discussed.

Neonatal Intensive Care Nursing Curriculum Challenges based on Context, Input, Process, and Product Evaluation Model: A Qualitative Study

PubMed Central

Ashghali-Farahani, Mansoureh; Ghaffari, Fatemeh; Hoseini-Esfidarjani, Sara-Sadat; Hadian, Zahra; Qomi, Robabeh; Dargahi, Helen

2018-01-01

Background: Weakness of curriculum development in nursing education results in lack of professional skills in graduates. This study was done on master's students in nursing to evaluate challenges of neonatal intensive care nursing curriculum based on context, input, process, and product (CIPP) evaluation model. Materials and Methods: This study was conducted with qualitative approach, which was completed according to the CIPP evaluation model. The study was conducted from May 2014 to April 2015. The research community included neonatal intensive care nursing master's students, the graduates, faculty members, neonatologists, nurses working in neonatal intensive care unit (NICU), and mothers of infants who were hospitalized in such wards. Purposeful sampling was applied. Results: The data analysis showed that there were two main categories: “inappropriate infrastructure” and “unknown duties,” which influenced the context formation of NICU master's curriculum. The input was formed by five categories, including “biomedical approach,” “incomprehensive curriculum,” “lack of professional NICU nursing mentors,” “inappropriate admission process of NICU students,” and “lack of NICU skill labs.” Three categories were extracted in the process, including “more emphasize on theoretical education,” “the overlap of credits with each other and the inconsistency among the mentors,” and “ineffective assessment.” Finally, five categories were extracted in the product, including “preferring routine work instead of professional job,” “tendency to leave the job,” “clinical incompetency of graduates,” “the conflict between graduates and nursing staff expectations,” and “dissatisfaction of graduates.” Conclusions: Some changes are needed in NICU master's curriculum by considering the nursing experts' comments and evaluating the consequences of such program by them. PMID:29628958

Qualitative simulation for process modeling and control

NASA Technical Reports Server (NTRS)

Dalle Molle, D. T.; Edgar, T. F.

1989-01-01

A qualitative model is developed for a first-order system with a proportional-integral controller without precise knowledge of the process or controller parameters. Simulation of the qualitative model yields all of the solutions to the system equations. In developing the qualitative model, a necessary condition for the occurrence of oscillatory behavior is identified. Initializations that cannot exhibit oscillatory behavior produce a finite set of behaviors. When the phase-space behavior of the oscillatory behavior is properly constrained, these initializations produce an infinite but comprehensible set of asymptotically stable behaviors. While the predictions include all possible behaviors of the real system, a class of spurious behaviors has been identified. When limited numerical information is included in the model, the number of predictions is significantly reduced.

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

PubMed

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines. The synthesis of studies of lay experiences of living with rheumatoid arthritis began with 29 papers. Four could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with rheumatoid arthritis. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory. In both topic areas, only a minority of the studies included in the syntheses were found to have referenced each other, suggesting that unnecessary replication had occurred. We only evaluated meta-ethnography as a method for synthesising qualitative research, but there are other methods being employed. Further research is required to investigate how different methods of qualitative synthesis influence the outcome of the synthesis. Meta-ethnography is an effective method for synthesising qualitative research. The process of reciprocally translating the findings from each individual study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a 'line of argument' that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, but not all meta-ethnographic syntheses do so. Instead, some will identify fields in which saturation has been reached and in which no theoretical development has taken place for some time. Both outcomes are helpful in either moving research forward or avoiding wasted resources. Meta-ethnography is a highly interpretative method requiring considerable

Augmenting Qualitative Text Analysis with Natural Language Processing: Methodological Study.

PubMed

Guetterman, Timothy C; Chang, Tammy; DeJonckheere, Melissa; Basu, Tanmay; Scruggs, Elizabeth; Vydiswaran, V G Vinod

2018-06-29

Qualitative research methods are increasingly being used across disciplines because of their ability to help investigators understand the perspectives of participants in their own words. However, qualitative analysis is a laborious and resource-intensive process. To achieve depth, researchers are limited to smaller sample sizes when analyzing text data. One potential method to address this concern is natural language processing (NLP). Qualitative text analysis involves researchers reading data, assigning code labels, and iteratively developing findings; NLP has the potential to automate part of this process. Unfortunately, little methodological research has been done to compare automatic coding using NLP techniques and qualitative coding, which is critical to establish the viability of NLP as a useful, rigorous analysis procedure. The purpose of this study was to compare the utility of a traditional qualitative text analysis, an NLP analysis, and an augmented approach that combines qualitative and NLP methods. We conducted a 2-arm cross-over experiment to compare qualitative and NLP approaches to analyze data generated through 2 text (short message service) message survey questions, one about prescription drugs and the other about police interactions, sent to youth aged 14-24 years. We randomly assigned a question to each of the 2 experienced qualitative analysis teams for independent coding and analysis before receiving NLP results. A third team separately conducted NLP analysis of the same 2 questions. We examined the results of our analyses to compare (1) the similarity of findings derived, (2) the quality of inferences generated, and (3) the time spent in analysis. The qualitative-only analysis for the drug question (n=58) yielded 4 major findings, whereas the NLP analysis yielded 3 findings that missed contextual elements. The qualitative and NLP-augmented analysis was the most comprehensive. For the police question (n=68), the qualitative-only analysis

Qualitative dynamics semantics for SBGN process description.

PubMed

Rougny, Adrien; Froidevaux, Christine; Calzone, Laurence; Paulevé, Loïc

2016-06-16

Qualitative dynamics semantics provide a coarse-grain modeling of networks dynamics by abstracting away kinetic parameters. They allow to capture general features of systems dynamics, such as attractors or reachability properties, for which scalable analyses exist. The Systems Biology Graphical Notation Process Description language (SBGN-PD) has become a standard to represent reaction networks. However, no qualitative dynamics semantics taking into account all the main features available in SBGN-PD had been proposed so far. We propose two qualitative dynamics semantics for SBGN-PD reaction networks, namely the general semantics and the stories semantics, that we formalize using asynchronous automata networks. While the general semantics extends standard Boolean semantics of reaction networks by taking into account all the main features of SBGN-PD, the stories semantics allows to model several molecules of a network by a unique variable. The obtained qualitative models can be checked against dynamical properties and therefore validated with respect to biological knowledge. We apply our framework to reason on the qualitative dynamics of a large network (more than 200 nodes) modeling the regulation of the cell cycle by RB/E2F. The proposed semantics provide a direct formalization of SBGN-PD networks in dynamical qualitative models that can be further analyzed using standard tools for discrete models. The dynamics in stories semantics have a lower dimension than the general one and prune multiple behaviors (which can be considered as spurious) by enforcing the mutual exclusiveness between the activity of different nodes of a same story. Overall, the qualitative semantics for SBGN-PD allow to capture efficiently important dynamical features of reaction network models and can be exploited to further refine them.

Qualitative Parameters for Evaluation Procedures of Non-Formal and Informal Learning Achievements

ERIC Educational Resources Information Center

Stasiunaitiene, Egle; Kaminskiene, Lina

2009-01-01

The article introduces evaluation principles of non-formal and informal learning that determine the quality of evaluation, describes stages of the evaluation procedure, differentiates their qualitative parameters and defines their criteria and indicators. It also brings in the discussion that consideration of qualitative parameters for the…

Bridging the qualitative-quantitative divide: Experiences from conducting a mixed methods evaluation in the RUCAS programme.

PubMed

Makrakis, Vassilios; Kostoulas-Makrakis, Nelly

2016-02-01

Quantitative and qualitative approaches to planning and evaluation in education for sustainable development have often been treated by practitioners from a single research paradigm. This paper discusses the utility of mixed method evaluation designs which integrate qualitative and quantitative data through a sequential transformative process. Sequential mixed method data collection strategies involve collecting data in an iterative process whereby data collected in one phase contribute to data collected in the next. This is done through examples from a programme addressing the 'Reorientation of University Curricula to Address Sustainability (RUCAS): A European Commission Tempus-funded Programme'. It is argued that the two approaches are complementary and that there are significant gains from combining both. Using methods from both research paradigms does not, however, mean that the inherent differences among epistemologies and methodologies should be neglected. Based on this experience, it is recommended that using a sequential transformative mixed method evaluation can produce more robust results than could be accomplished using a single approach in programme planning and evaluation focussed on education for sustainable development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Exploring how ward staff engage with the implementation of a patient safety intervention: a UK-based qualitative process evaluation

PubMed Central

Sheard, Laura; Marsh, Claire; O’Hara, Jane; Armitage, Gerry; Wright, John; Lawton, Rebecca

2017-01-01

Objectives A patient safety intervention was tested in a 33-ward randomised controlled trial. No statistically significant difference between intervention and control wards was found. We conducted a process evaluation of the trial and our aim in this paper is to understand staff engagement across the 17 intervention wards. Design Large qualitative process evaluation of the implementation of a patient safety intervention. Setting and participants National Health Service staff based on 17 acute hospital wards located at five hospital sites in the North of England. Data We concentrate on three sources here: (1) analysis of taped discussion between ward staff during action planning meetings; (2) facilitators’ field notes and (3) follow-up telephone interviews with staff focusing on whether action plans had been achieved. The analysis involved the use of pen portraits and adaptive theory. Findings First, there were palpable differences in the ways that the 17 ward teams engaged with the key components of the intervention. Five main engagement typologies were evident across the life course of the study: consistent, partial, increasing, decreasing and disengaged. Second, the intensity of support for the intervention at the level of the organisation does not predict the strength of engagement at the level of the individual ward team. Third, the standardisation of facilitative processes provided by the research team does not ensure that implementation standardisation of the intervention occurs by ward staff. Conclusions A dilution of the intervention occurred during the trial because wards engaged with Patient Reporting and Action for a Safe Environment (PRASE) in divergent ways, despite the standardisation of key components. Facilitative processes were not sufficiently adequate to enable intervention wards to successfully engage with PRASE components. PMID:28710206

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

The qualitative research proposal.

PubMed

Klopper, H

2008-12-01

Qualitative research in the health sciences has had to overcome many prejudices and a number of misunderstandings, but today qualitative research is as acceptable as quantitative research designs and is widely funded and published. Writing the proposal of a qualitative study, however, can be a challenging feat, due to the emergent nature of the qualitative research design and the description of the methodology as a process. Even today, many sub-standard proposals at post-graduate evaluation committees and application proposals to be considered for funding are still seen. This problem has led the researcher to develop a framework to guide the qualitative researcher in writing the proposal of a qualitative study based on the following research questions: (i) What is the process of writing a qualitative research proposal? and (ii) What does the structure and layout of a qualitative proposal look like? The purpose of this article is to discuss the process of writing the qualitative research proposal, as well as describe the structure and layout of a qualitative research proposal. The process of writing a qualitative research proposal is discussed with regards to the most important questions that need to be answered in your research proposal with consideration of the guidelines of being practical, being persuasive, making broader links, aiming for crystal clarity and planning before you write. While the structure of the qualitative research proposal is discussed with regards to the key sections of the proposal, namely the cover page, abstract, introduction, review of the literature, research problem and research questions, research purpose and objectives, research paradigm, research design, research method, ethical considerations, dissemination plan, budget and appendices.

Formative Qualitative Evaluation for "Exploratory" ITS Research.

ERIC Educational Resources Information Center

Murray, Tom

1993-01-01

Discusses evaluation methods applicable to exploratory research areas, provides an overview of qualitative and formative methods for exploratory research on intelligent tutoring systems (ITS) and describes an exploratory study in ITS knowledge acquisition which involved working with three educators to build an ITS for high school physics.…

Exploring how ward staff engage with the implementation of a patient safety intervention: a UK-based qualitative process evaluation.

PubMed

Sheard, Laura; Marsh, Claire; O'Hara, Jane; Armitage, Gerry; Wright, John; Lawton, Rebecca

2017-07-13

A patient safety intervention was tested in a 33-ward randomised controlled trial. No statistically significant difference between intervention and control wards was found. We conducted a process evaluation of the trial and our aim in this paper is to understand staff engagement across the 17 intervention wards. Large qualitative process evaluation of the implementation of a patient safety intervention. National Health Service staff based on 17 acute hospital wards located at five hospital sites in the North of England. We concentrate on three sources here: (1) analysis of taped discussion between ward staff during action planning meetings; (2) facilitators' field notes and (3) follow-up telephone interviews with staff focusing on whether action plans had been achieved. The analysis involved the use of pen portraits and adaptive theory. First, there were palpable differences in the ways that the 17 ward teams engaged with the key components of the intervention. Five main engagement typologies were evident across the life course of the study: consistent, partial, increasing, decreasing and disengaged. Second, the intensity of support for the intervention at the level of the organisation does not predict the strength of engagement at the level of the individual ward team. Third, the standardisation of facilitative processes provided by the research team does not ensure that implementation standardisation of the intervention occurs by ward staff. A dilution of the intervention occurred during the trial because wards engaged with Patient Reporting and Action for a Safe Environment (PRASE) in divergent ways, despite the standardisation of key components. Facilitative processes were not sufficiently adequate to enable intervention wards to successfully engage with PRASE components. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

A Qualitative Analysis of College Women's Leaving Processes in Abusive Relationships

ERIC Educational Resources Information Center

Edwards, Katie M.; Murphy, Megan J.; Tansill, Erin C.; Myrick, Christina; Probst, Danielle R.; Corsa, Rebecca; Gidycz, Christine A.

2012-01-01

Objective: This study assessed the process of leaving an abusive dating relationship utilizing a qualitative design. Methods: Participants included 123 college women in abusive dating relationships who participated at the beginning and end of a 10-week academic quarter. Results: Qualitative content analyses were used to analyze the transcribed…

Health professionals in the process of vaccination against hepatitis B in two basic units of Belo Horizonte: a qualitative evaluation.

PubMed

Lages, Annelisa Santos; França, Elisabeth Barboza; Freitas, Maria Imaculada de Fátima

2013-06-01

According to the Vaccine Coverage Survey, performed in 2007, the immunization coverage against hepatitis B in Belo Horizonte, for infants under one year old, was below the level proposed by the Brazilian National Program of Immunization. This vaccine was used as basis for evaluating the involvement of health professionals in the process of vaccination in two Basic Health Units (UBS, acronym in Portuguese) in the city. This study is qualitative and uses the notions of Social Representations Theory and the method of Structural Analysis of Narrative to carry out the interviews and data analysis. The results show flaws related to controlling and use of the mirror card and the parent orientation, and also the monitoring of vaccination coverage (VC) and use of VC data as input for planning health actions. It was observed that the working process in the UBS is focused on routine tasks, with low creativity of the professionals, which includes representations that maintain strong tendency to value activities focused on the health of individuals to the detriment of public health actions. In conclusion, the vaccination process fault can be overcome with a greater appreciation of everyday actions and with a much better use of local information about vaccination, and some necessary adjustments within the UBS to improve public health actions.

School Psychology as a Relational Enterprise: The Role and Process of Qualitative Methodology

ERIC Educational Resources Information Center

Newman, Daniel S.; Clare, Mary M.

2016-01-01

The purpose of this article is to explore the application of qualitative research to establishing a more complete understanding of relational processes inherent in school psychology practice. We identify the building blocks of rigorous qualitative research design through a conceptual overview of qualitative paradigms, methodologies, methods (i.e.,…

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

Qualitative Analysis for Maintenance Process Assessment

NASA Technical Reports Server (NTRS)

Brand, Lionel; Kim, Yong-Mi; Melo, Walcelio; Seaman, Carolyn; Basili, Victor

1996-01-01

In order to improve software maintenance processes, we first need to be able to characterize and assess them. These tasks must be performed in depth and with objectivity since the problems are complex. One approach is to set up a measurement-based software process improvement program specifically aimed at maintenance. However, establishing a measurement program requires that one understands the problems to be addressed by the measurement program and is able to characterize the maintenance environment and processes in order to collect suitable and cost-effective data. Also, enacting such a program and getting usable data sets takes time. A short term substitute is therefore needed. We propose in this paper a characterization process aimed specifically at maintenance and based on a general qualitative analysis methodology. This process is rigorously defined in order to be repeatable and usable by people who are not acquainted with such analysis procedures. A basic feature of our approach is that actual implemented software changes are analyzed in order to understand the flaws in the maintenance process. Guidelines are provided and a case study is shown that demonstrates the usefulness of the approach.

A Qualitative Analysis Framework Using Natural Language Processing and Graph Theory

ERIC Educational Resources Information Center

Tierney, Patrick J.

2012-01-01

This paper introduces a method of extending natural language-based processing of qualitative data analysis with the use of a very quantitative tool--graph theory. It is not an attempt to convert qualitative research to a positivist approach with a mathematical black box, nor is it a "graphical solution". Rather, it is a method to help qualitative…

Making Sense of Alternative Assessment in a Qualitative Evaluation System

ERIC Educational Resources Information Center

Rojas Serrano, Javier

2017-01-01

In a Colombian private English institution, a qualitative evaluation system has been incorporated. This type of evaluation poses challenges to students who have never been evaluated through a system that eliminates exams or quizzes and, as a consequence, these students have to start making sense of it. This study explores the way students face the…

Clinical orientation program for new medical registrars--a qualitative evaluation.

PubMed

Rosemergy, Ian; Bell, Damon A; Jayathissa, Sisira K

2009-02-01

We present a qualitative evaluation of a clinical orientation program for medical registrars within the Wellington region in New Zealand, designed and implemented by current advanced registrars. This program was intended to improve the transition from house officer to medical registrar. The program was qualitatively evaluated using focus groups comprising participants, presenters and senior nursing staff. Purposive samples were drawn from each of these groups. The most significant finding was the perception of enhanced professional collegiality among medical staff. There were benefits to participants and presenters with improved communication between medical registrars. We believe there are individual, institutional and patient care benefits with a region-specific, clinical orientation for new medical registrars.

Qualitative evaluation of maternal milk and commercial infant formulas via LIBS.

PubMed

Abdel-Salam, Z; Al Sharnoubi, J; Harith, M A

2013-10-15

This study focuses on the use of laser-induced breakdown spectroscopy (LIBS) for the evaluation of the nutrients in maternal milk and some commercially available infant formulas. The results of such evaluation are vital for adequate and healthy feeding for babies during lactation period. Laser-induced breakdown spectroscopy offers special advantages in comparison to the other conventional analytical techniques. Specifically, LIBS is a straightforward technique that can be used in situ to provide qualitative analytical information in few minutes for the samples under investigation without preparation processes. The samples studied in the current work were maternal milk samples collected during the first 3 months of lactation (not colostrum milk) and samples from six different types of commercially available infant formulas. The samples' elemental composition has been compared with respect to the relative abundance of the elements of nutrition importance, namely Mg, Ca, Na, and Fe using their spectral emission lines in the relevant LIBS spectra. In addition, CN and C2 molecular emission bands in the same spectra have been studied as indicators of proteins content in the samples. The obtained analytical results demonstrate the higher elemental contents of the maternal milk compared with the commercial formulas samples. Similar results have been obtained as for the proteins content. It has been also shown that calcium and proteins have similar relative concentration trends in the studied samples. This work demonstrates the feasibility of adopting LIBS as a fast, safe, less costly technique evaluating qualitatively the nutrients content of both maternal and commercial milk samples. Copyright © 2013 Elsevier B.V. All rights reserved.

Dyadic Interviews as a Tool for Qualitative Evaluation

ERIC Educational Resources Information Center

Morgan, David L.; Eliot, Susan; Lowe, Robert A.; Gorman, Paul

2016-01-01

Although evaluation researchers frequently make use of focus groups and individual interviews as sources of qualitative data, there has been far less attention to dyadic interviews that create a conversation between two research participants. This article describes dyadic interviews as a format that shares many of the advantages of focus groups,…

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example

PubMed Central

Mair, Frances S; Dowrick, Christopher; Brún, Mary O’Reilly-de; de Brún, Tomas; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; van den Muijsenbergh, Maria; van Weel-Baumgarten, Evelyn; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-01-01

Objectives To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Design Participatory research approach using qualitative methods. Setting Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. Participants RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Primary outcome measures Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Results Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE’s methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork. Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. Conclusion A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised

Universal Free School Breakfast: A Qualitative Process Evaluation According to the Perspectives of Senior Stakeholders.

PubMed

Harvey-Golding, Louise; Donkin, Lynn Margaret; Defeyter, Margaret Anne

2016-01-01

In the last decade, the provision of school breakfast has increased significantly in the UK. However, there is an absence of knowledge regarding senior stakeholder views on the processes and potential outcomes on different groups, within the communities served by school breakfast programs. The purpose of this study was to examine the views and experiences of senior level stakeholders and thereby provide an original qualitative contribution to the research. A sample of senior level stakeholders was recruited, including senior officers, directors, and elected members, from within a Local Authority (LA) involved in the leadership, implementation and delivery of a council-wide universal free school breakfast (UFSB) program, and from the senior staff body of mainstream primary and special schools, participating in the program. A grounded theory analysis of the data collected identified issues encountered in the implementation and delivery, and views on the funding and future of a USFB program, in addition to perceived outcomes for children, parents, families, schools, and the wider community. The results refer to both positive and negative issues and implications associated with the program, according to the perspectives of senior level stakeholders. Perceived positive outcomes included benefits to children, families, schools, and the community. For instance, alleviating hunger, improving health outcomes, and conferring financial benefits, with the potential to cumulate in overall improvements in educational, social, and behavioral outcomes. Reported negative implications included the absence of an effective communication strategy in implementing the USFB program; in addition to concerns about the impacts of "double-breakfasting" on obesity levels among children, particularly in less deprived communities. Findings were validated using theoretical sampling and saturation, triangulation methods, member checks, and inter-rater reliability measures. In presenting these

Elementary Teachers' Views on the Creative Writing Process: An Evaluation

ERIC Educational Resources Information Center

Akkaya, Nevin

2014-01-01

The goal of this study is to discover and evaluate both the areas of personal interest and the views of 4th and 5th grade classroom teachers regarding the creative writing process. In this study, one of the qualitative study methods, state study, and related to this, single state design which refers to the whole has been chosen. Research was…

Tools for evaluating Veterinary Services: an external auditing model for the quality assurance process.

PubMed

Melo, E Correa

2003-08-01

The author describes the reasons why evaluation processes should be applied to the Veterinary Services of Member Countries, either for trade in animals and animal products and by-products between two countries, or for establishing essential measures to improve the Veterinary Service concerned. The author also describes the basic elements involved in conducting an evaluation process, including the instruments for doing so. These basic elements centre on the following:--designing a model, or desirable image, against which a comparison can be made--establishing a list of processes to be analysed and defining the qualitative and quantitative mechanisms for this analysis--establishing a multidisciplinary evaluation team and developing a process for standardising the evaluation criteria.

Evaluation methodology for comparing memory and communication of analytic processes in visual analytics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ragan, Eric D; Goodall, John R

2014-01-01

Provenance tools can help capture and represent the history of analytic processes. In addition to supporting analytic performance, provenance tools can be used to support memory of the process and communication of the steps to others. Objective evaluation methods are needed to evaluate how well provenance tools support analyst s memory and communication of analytic processes. In this paper, we present several methods for the evaluation of process memory, and we discuss the advantages and limitations of each. We discuss methods for determining a baseline process for comparison, and we describe various methods that can be used to elicit processmore » recall, step ordering, and time estimations. Additionally, we discuss methods for conducting quantitative and qualitative analyses of process memory. By organizing possible memory evaluation methods and providing a meta-analysis of the potential benefits and drawbacks of different approaches, this paper can inform study design and encourage objective evaluation of process memory and communication.« less

Frameworks for evaluating health research capacity strengthening: a qualitative study

PubMed Central

2013-01-01

Background Health research capacity strengthening (RCS) projects are often complex and hard to evaluate. In order to inform health RCS evaluation efforts, we aimed to describe and compare key characteristics of existing health RCS evaluation frameworks: their process of development, purpose, target users, structure, content and coverage of important evaluation issues. A secondary objective was to explore what use had been made of the ESSENCE framework, which attempts to address one such issue: harmonising the evaluation requirements of different funders. Methods We identified and analysed health RCS evaluation frameworks published by seven funding agencies between 2004 and 2012, using a mixed methods approach involving structured qualitative analyses of documents, a stakeholder survey and consultations with key contacts in health RCS funding agencies. Results The frameworks were intended for use predominantly by the organisations themselves, and most were oriented primarily towards funders’ internal organisational performance requirements. The frameworks made limited reference to theories that specifically concern RCS. Generic devices, such as logical frameworks, were typically used to document activities, outputs and outcomes, but with little emphasis on exploring underlying assumptions or contextual constraints. Usage of the ESSENCE framework appeared limited. Conclusions We believe that there is scope for improving frameworks through the incorporation of more accessible information about how to do evaluation in practice; greater involvement of stakeholders, following evaluation capacity building principles; greater emphasis on explaining underlying rationales of frameworks; and structuring frameworks so that they separate generic and project-specific aspects of health RCS evaluation. The third and fourth of these improvements might assist harmonisation. PMID:24330628

Online versus Paper Evaluations: Differences in Both Quantitative and Qualitative Data

ERIC Educational Resources Information Center

Burton, William B.; Civitano, Adele; Steiner-Grossman, Penny

2012-01-01

This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The…

Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, Enhanced Pearson eText with Loose-Leaf Version--Access Card Package. Fifth Edition

ERIC Educational Resources Information Center

Creswell, John W.

2015-01-01

"Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research" offers a truly balanced, inclusive, and integrated overview of the processes involved in educational research. This text first examines the general steps in the research process and then details the procedures for conducting specific types…

A Systematic Quantitative-Qualitative Model: How To Evaluate Professional Services

ERIC Educational Resources Information Center

Yoda, Koji

1973-01-01

The proposed evaluation model provides for the assignment of relative weights to each criterion, and establishes a weighting system for calculating a quantitative-qualitative raw score for each service activity of a faculty member being reviewed. (Author)

Processes that Inform Multicultural Supervision: A Qualitative Meta-Analysis.

PubMed

Tohidian, Nilou B; Quek, Karen Mui-Teng

2017-10-01

As the fields of counseling and psychotherapy have become more cognizant that individuals, couples, and families bring with them a myriad of diversity factors into therapy, multicultural competency has also become a crucial component in the development of clinicians during clinical supervision and training. We employed a qualitative meta-analysis to provide a detailed and comprehensive description of similar themes identified in primary qualitative studies that have investigated supervisory practices with an emphasis on diversity. Findings revealed six meta-categories, namely: (a) Supervisor's Multicultural Stances; (b) Supervisee's Multicultural Encounters; (c) Competency-Based Content in Supervision; (d) Processes Surrounding Multicultural Supervision; (e) Culturally Attuned Interventions; and (f) Multicultural Supervisory Alliance. Implications for practice are discussed. © 2017 American Association for Marriage and Family Therapy.

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Applying a Qualitative Modeling Shell to Process Diagnosis: The Caster System.

DTIC Science & Technology

1986-03-01

Process Diagnosis: The Caster System by Timothy F. Thompson and William J. Clancey Department of Computer Science Stanford University Stanford, CA 94303...MODELING SHELL TO PROCESS DIAGNOSIS: THE CASTER SYSTEM 12 PERSONAL AUTHOR(S) TIMOTHY F. THOMPSON. WESTINGHOUSE R&D CENTER, WILLIAM CLANCEY, STANFORD...editions are obsolete. Applying a Qualitative Modeling Shell to Process Diagnosis: The Caster System by Timothy F. Thompson, Westinghouse R&D Center

A Qualitative Evaluation of Ethics Educational Program in Health Science.

PubMed

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-06-01

This paper originates from a panel discussion on the evaluation of "Ethics Educational Program in Health Sciences" held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs.

Qualitative and quantitative interpretation of SEM image using digital image processing.

PubMed

Saladra, Dawid; Kopernik, Magdalena

2016-10-01

The aim of the this study is improvement of qualitative and quantitative analysis of scanning electron microscope micrographs by development of computer program, which enables automatic crack analysis of scanning electron microscopy (SEM) micrographs. Micromechanical tests of pneumatic ventricular assist devices result in a large number of micrographs. Therefore, the analysis must be automatic. Tests for athrombogenic titanium nitride/gold coatings deposited on polymeric substrates (Bionate II) are performed. These tests include microshear, microtension and fatigue analysis. Anisotropic surface defects observed in the SEM micrographs require support for qualitative and quantitative interpretation. Improvement of qualitative analysis of scanning electron microscope images was achieved by a set of computational tools that includes binarization, simplified expanding, expanding, simple image statistic thresholding, the filters Laplacian 1, and Laplacian 2, Otsu and reverse binarization. Several modifications of the known image processing techniques and combinations of the selected image processing techniques were applied. The introduced quantitative analysis of digital scanning electron microscope images enables computation of stereological parameters such as area, crack angle, crack length, and total crack length per unit area. This study also compares the functionality of the developed computer program of digital image processing with existing applications. The described pre- and postprocessing may be helpful in scanning electron microscopy and transmission electron microscopy surface investigations. © 2016 The Authors Journal of Microscopy © 2016 Royal Microscopical Society.

Qualitative Analysis of Information Communication Technology Use on Teaching-Learning Process.

ERIC Educational Resources Information Center

Akahori, Kanji

This paper describes some of the features of Information Communication Technology (ICT) and its uses in the teaching-learning process in elementary schools. In most schools, it is difficult for ICT to be used effectively in the teaching-learning process. The author observed many classes using ICT in elementary schools. Qualitative data, such as…

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example.

PubMed

O'Donnell, Catherine A; Mair, Frances S; Dowrick, Christopher; Brún, Mary O'Reilly-de; Brún, Tomas de; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; Muijsenbergh, Maria van den; Weel-Baumgarten, Evelyn van; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-08-21

To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Participatory research approach using qualitative methods. Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE's methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork.Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any

Procedure versus process: ethical paradigms and the conduct of qualitative research.

PubMed

Pollock, Kristian

2012-09-27

Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic 'procedural' resolution. This is not to say that qualitative studies are 'unethical' but that their ethical nature can only be safeguarded through the practice of 'micro-ethics' based on the judgement and integrity of researchers in the field. This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of 'empirical ethics' as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values.

Active thermography in qualitative evaluation of protective materials.

PubMed

Gralewicz, Grzegorz; Wiecek, Bogusław

2009-01-01

This is a study of the possibilities of a qualitative evaluation of protective materials with active thermography. It presents a simulation of a periodic excitation of a multilayer composite material. Tests were conducted with lock-in thermography on Kevlar composite consisting of 16 layers of Kevlar fabric reinforced with formaldehyde resin with implanted delamination defects. Lock-in thermography is a versatile tool for nondestructive evaluation. It is a fast, remote and nondestructive procedure. Hence, it was used to detect delaminations in the composite structure of materials used in the production of components designed for personal protection. This method directly contributes to an improvement in safety.

Emerging Uses of Computer Technology in Qualitative Research.

ERIC Educational Resources Information Center

Parker, D. Randall

The application of computer technology in qualitative research and evaluation ranges from simple word processing to doing sophisticated data sorting and retrieval. How computer software can be used for qualitative research is discussed. Researchers should consider the use of computers in data analysis in light of their own familiarity and comfort…

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

PubMed

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Out of the frying pan? Streamlining the ethics review process of multisite qualitative research projects.

PubMed

Iedema, Rick A M; Allen, Suellen; Britton, Kate; Hor, Suyin

2013-05-01

This paper describes the ethics approval processes for two multicentre, nationwide, qualitative health service research projects. The paper explains that the advent of the National Ethics Application Form has brought many improvements, but that attendant processes put in place at local health network and Human Research Ethics Committee levels may have become significantly more complicated, particularly for innovative qualitative research projects. The paper raises several questions based on its analysis of ethics application processes currently in place. WHAT IS KNOWN ABOUT THE TOPIC? The complexity of multicentre research ethics applications for research in health services has been addressed by the introduction of the National Ethics Application Form. Uptake of the form across the country's human research ethics committees has been uneven. WHAT DOES THIS PAPER ADD? This paper adds detailed insight into the ethics application process as it is currently enacted across the country. The paper details this process with reference to difficulties faced by multisite and qualitative studies in negotiating access to research sites, ethics committees' relative unfamiliarity with qualitative research , and apparent tensions between harmonisation and local sites' autonomy in approving research. WHAT ARE THE IMPLICATIONS FOR PRACTITIONERS? Practitioners aiming to engage in research need to be aware that ethics approval takes place in an uneven procedural landscape, made up of variable levels of ethics approval harmonization and intricate governance or site-specific assessment processes.

The Use of a Checklist and Qualitative Notebooks for an Interactive Process of Teaching and Learning Qualitative Research

ERIC Educational Resources Information Center

Frels, Rebecca K.; Sharma, Bipin; Onwuegbuzie, Anthony J.; Leech, Nancy L.; Stark, Marcella D.

2011-01-01

From the perspective of doctoral students and instructors, we explain a developmental, interactive process based upon the Checklist for Qualitative Data Collection, Data Analysis, and Data Interpretation (Onwuegbuzie, 2010) for students' writing assignments regarding: (a) the application of conceptual knowledge for collecting, analyzing, and…

Procedure versus process: ethical paradigms and the conduct of qualitative research

PubMed Central

2012-01-01

Background Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Discussion Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic ‘procedural’ resolution. This is not to say that qualitative studies are ‘unethical’ but that their ethical nature can only be safeguarded through the practice of ‘micro-ethics’ based on the judgement and integrity of researchers in the field. Summary This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of ‘empirical ethics’ as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values. PMID:23016663

'Healthy Eating and Lifestyle in Pregnancy (HELP)' trial: Process evaluation framework.

PubMed

Simpson, Sharon A; Cassidy, Dunla; John, Elinor

2014-07-01

We developed and tested in a cluster RCT a theory-driven group-based intervention for obese pregnant women. It was designed to support women to moderate weight gain during pregnancy and reduce BMI one year after birth, in addition to targeting secondary health and wellbeing outcomes. In line with MRC guidance on developing and evaluating complex interventions in health, we conducted a process evaluation alongside the trial. This paper describes the development of the process evaluation framework. This cluster RCT recruited 598 pregnant women. Women in the intervention group were invited to attend a weekly weight-management group. Following a review of relevant literature, we developed a process evaluation framework which outlined key process indicators that we wanted to address and how we would measure these. Central to the process evaluation was to understand the mechanism of effect of the intervention. We utilised a logic-modelling approach to describe the intervention which helped us focus on what potential mediators of intervention effect to measure, and how. The resulting process evaluation framework was designed to address 9 core elements; context, reach, exposure, recruitment, fidelity, recruitment, retention, contamination and theory-testing. These were assessed using a variety of qualitative and quantitative approaches. The logic model explained the processes by which intervention components bring about change in target outcomes through various mediators and theoretical pathways including self-efficacy, social support, self-regulation and motivation. Process evaluation is a key element in assessing the effect of any RCT. We developed a process evaluation framework and logic model, and the results of analyses using these will offer insights into why the intervention is or is not effective. Copyright © 2014.

Qualitative modeling of the decision-making process using electrooculography.

PubMed

Zargari Marandi, Ramtin; Sabzpoushan, S H

2015-12-01

A novel method based on electrooculography (EOG) has been introduced in this work to study the decision-making process. An experiment was designed and implemented wherein subjects were asked to choose between two items from the same category that were presented within a limited time. The EOG and voice signals of the subjects were recorded during the experiment. A calibration task was performed to map the EOG signals to their corresponding gaze positions on the screen by using an artificial neural network. To analyze the data, 16 parameters were extracted from the response time and EOG signals of the subjects. Evaluation and comparison of the parameters, together with subjects' choices, revealed functional information. On the basis of this information, subjects switched their eye gazes between items about three times on average. We also found, according to statistical hypothesis testing-that is, a t test, t(10) = 71.62, SE = 1.25, p < .0001-that the correspondence rate of a subjects' gaze at the moment of selection with the selected item was significant. Ultimately, on the basis of these results, we propose a qualitative choice model for the decision-making task.

Incorporating Translation in Qualitative Studies: Two Case Studies in Education

ERIC Educational Resources Information Center

Sutrisno, Agustian; Nguyen, Nga Thanh; Tangen, Donna

2014-01-01

Cross-language qualitative research in education continues to increase. However, there has been inadequate discussion in the literature concerning the translation process that ensures research trustworthiness applicable for bilingual researchers. Informed by the literature on evaluation criteria for qualitative data translation, this paper…

A Qualitative Evaluation of Ethics Educational Program in Health Science1

PubMed Central

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-01-01

This paper originates from a panel discussion on the evaluation of “Ethics Educational Program in Health Sciences” held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs. PMID:26664129

Reported credibility techniques in higher education evaluation studies that use qualitative methods: A research synthesis.

PubMed

Liao, Hongjing; Hitchcock, John

2018-06-01

This synthesis study examined the reported use of credibility techniques in higher education evaluation articles that use qualitative methods. The sample included 118 articles published in six leading higher education evaluation journals from 2003 to 2012. Mixed methods approaches were used to identify key credibility techniques reported across the articles, document the frequency of these techniques, and describe their use and properties. Two broad sets of techniques were of interest: primary design techniques (i.e., basic), such as sampling/participant recruitment strategies, data collection methods, analytic details, and additional qualitative credibility techniques (e.g., member checking, negative case analyses, peer debriefing). The majority of evaluation articles reported use of primary techniques although there was wide variation in the amount of supporting detail; most of the articles did not describe the use of additional credibility techniques. This suggests that editors of evaluation journals should encourage the reporting of qualitative design details and authors should develop strategies yielding fuller methodological description. Copyright © 2018 Elsevier Ltd. All rights reserved.

Qualitative evaluation of a delirium prevention and management programme.

PubMed

Kang, Yun; Moyle, Wendy; Cooke, Marie; O'Dwyer, Siobhan

2017-12-01

To evaluate the effect of an educational programme on registered nurses' knowledge and attitude in delirium care for hospitalised older adults with and without dementia, and to examine the strengths and weaknesses of the programme from the participants' perspectives. Providing care for patients with delirium or delirium superimposed on dementia often poses particular challenges such as distinguishing between delirium and dementia for nurses. A descriptive qualitative study was used. A delirium educational programme based on adult learning principles was provided to the participants. A purposive sample of 12 registered nurses who participated in the educational programme undertook individual interviews. Content analysis was conducted to identify unique and common themes indicative of registered nurse perceptions. Registered nurses reported improved knowledge and attitude towards the delirium care of hospitalised older adults with dementia and at risk of delirium. Active learning in the programme facilitated the participants' learning processes. This active learning included deep learning, collaborative learning and application of new concepts to practice. Most participants felt that they had inadequate management support to apply their new knowledge in practice, and this included staff resource and policies and protocols. The qualitative findings indicated that the delirium education had benefited the participants by improving their knowledge and attitude towards the delirium care of hospitalised older adults with dementia and at risk of delirium. This study provided an understanding of the strengths and limitations of the educational programme delivered to registered nurses in South Korea. Registered nurses in South Korea should need not only appropriate education, but also adequate resources, policies and guidelines as well as support from managers and from all other healthcare professionals. © 2017 John Wiley & Sons Ltd.

Interdisciplinary Practice Models for Older Adults With Back Pain: A Qualitative Evaluation.

PubMed

Salsbury, Stacie A; Goertz, Christine M; Vining, Robert D; Hondras, Maria A; Andresen, Andrew A; Long, Cynthia R; Lyons, Kevin J; Killinger, Lisa Z; Wallace, Robert B

2018-03-19

Older adults seek health care for low back pain from multiple providers who may not coordinate their treatments. This study evaluated the perceived feasibility of a patient-centered practice model for back pain, including facilitators for interprofessional collaboration between family medicine physicians and doctors of chiropractic. This qualitative evaluation was a component of a randomized controlled trial of 3 interdisciplinary models for back pain management: usual medical care; concurrent medical and chiropractic care; and collaborative medical and chiropractic care with interprofessional education, clinical record exchange, and team-based case management. Data collection included clinician interviews, chart abstractions, and fieldnotes analyzed with qualitative content analysis. An organizational-level framework for dissemination of health care interventions identified norms/attitudes, organizational structures and processes, resources, networks-linkages, and change agents that supported model implementation. Clinicians interviewed included 13 family medicine residents and 6 chiropractors. Clinicians were receptive to interprofessional education, noting the experience introduced them to new colleagues and the treatment approaches of the cooperating profession. Clinicians exchanged high volumes of clinical records, but found the logistics cumbersome. Team-based case management enhanced information flow, social support, and interaction between individual patients and the collaborating providers. Older patients were viewed positively as change agents for interprofessional collaboration between these provider groups. Family medicine residents and doctors of chiropractic viewed collaborative care as a useful practice model for older adults with back pain. Health care organizations adopting medical and chiropractic collaboration can tailor this general model to their specific setting to support implementation.

Opening the Black Box and Searching for Smoking Guns: Process Causality in Qualitative Research

ERIC Educational Resources Information Center

Bennett, Elisabeth E.; McWhorter, Rochell R.

2016-01-01

Purpose: The purpose of this paper is to explore the role of qualitative research in causality, with particular emphasis on process causality. In one paper, it is not possible to discuss all the issues of causality, but the aim is to provide useful ways of thinking about causality and qualitative research. Specifically, a brief overview of the…

High Resolution Qualitative and Quantitative MR Evaluation of the Glenoid Labrum

PubMed Central

Iwasaki, Kenyu; Tafur, Monica; Chang, Eric Y.; SherondaStatum; Biswas, Reni; Tran, Betty; Bae, Won C.; Du, Jiang; Bydder, Graeme M.; Chung, Christine B.

2015-01-01

Objective To implement qualitative and quantitative MR sequences for the evaluation of labral pathology. Methods Six glenoid labra were dissected and the anterior and posterior portions were divided into normal, mildly degenerated, or severely degenerated groups using gross and MR findings. Qualitative evaluation was performed using T1-weighted, proton density-weighted (PD), spoiled gradient echo (SPGR) and ultra-short echo time (UTE) sequences. Quantitative evaluation included T2 and T1rho measurements as well as T1, T2*, and T1rho measurements acquired with UTE techniques. Results SPGR and UTE sequences best demonstrated labral fiber structure. Degenerated labra had a tendency towards decreased T1 values, increased T2/T2* values and increased T1 rho values. T2* values obtained with the UTE sequence allowed for delineation between normal, mildly degenerated and severely degenerated groups (p<0.001). Conclusion Quantitative T2* measurements acquired with the UTE technique are useful for distinguishing between normal, mildly degenerated and severely degenerated labra. PMID:26359581

Protocol for a process-oriented qualitative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme using the Researcher-in-Residence model

PubMed Central

Eyre, Laura; George, Bethan; Marshall, Martin

2015-01-01

Introduction The integration of health and social care in England is widely accepted as the answer to fragmentation, financial concerns and system inefficiencies, in the context of growing and ageing populations with increasingly complex needs. Despite an expanding body of literature, there is little evidence yet to suggest that integrated care can achieve the benefits that its advocates claim for it. Researchers have often adopted rationalist and technocratic approaches to evaluation, treating integration as an intervention rather than a process. Results have usually been of limited use to practitioners responsible for health and social care integration. There is, therefore, a need to broaden the evidence base, exploring not only what works but also how integrated care can most successfully be implemented and delivered. For this reason, we are carrying out a formative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme. Our expectation is that this will add value to the literature by focusing on the processes by which the vision and objectives of integrated care are translated through phases of development, implementation and delivery from a central to a local perspective, and from a strategic to an operational perspective. Methods and analysis The qualitative and process-oriented evaluation uses an innovative participative approach—the Researcher-in-Residence model. The evaluation is underpinned by a critical ontology, an interpretive epistemology and a critical discourse analysis methodology. Data will be generated using interviews, observations and documentary gathering. Ethics and dissemination Emerging findings will be interpreted and disseminated collaboratively with stakeholders, to enable the research to influence and optimise the effective implementation of integrated care across WELC. Presentations and publications will ensure that learning is shared as widely as possible. The study has received

Using Qualitative Methods to Evaluate a Family Behavioral Intervention for Type 1 Diabetes

PubMed Central

Herbert, Linda Jones; Sweenie, Rachel; Kelly, Katherine Patterson; Holmes, Clarissa; Streisand, Randi

2013-01-01

Introduction The objectives of this study were to qualitatively evaluate a dyadic adolescent-parent type 1 diabetes (T1D) program developed to prevent deterioration in diabetes care among adolescents with T1D and provide recommendations for program refinement. Method Thirteen adolescent-parent dyads who participated in the larger RCT, the TeamWork Project, were interviewed regarding their perceptions of their participation in the program and current T1D challenges. Interviews were transcribed and coded to establish broad themes. Results Adolescents and parents thought the TeamWork Project sessions were helpful and taught them new information. Five themes catalog findings from the qualitative interviews: TeamWork content, TeamWork structure, transition of responsibility, current and future challenges, and future intervention considerations. Discussion Addressing T1D challenges as a parent-adolescent dyad via a behavioral clinic program is helpful to families during adolescence. Findings highlight the utility of qualitative evaluation to tailor interventions for the unique challenges related to pediatric chronic illness. PMID:24269281

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment.

PubMed

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment

PubMed Central

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action. PMID:28992759

Implementation of the SMART MOVE intervention in primary care: a qualitative study using normalisation process theory.

PubMed

Glynn, Liam G; Glynn, Fergus; Casey, Monica; Wilkinson, Louise Gaffney; Hayes, Patrick S; Heaney, David; Murphy, Andrew W M

2018-05-02

Problematic translational gaps continue to exist between demonstrating the positive impact of healthcare interventions in research settings and their implementation into routine daily practice. The aim of this qualitative evaluation of the SMART MOVE trial was to conduct a theoretically informed analysis, using normalisation process theory, of the potential barriers and levers to the implementation of a mhealth intervention to promote physical activity in primary care. The study took place in the West of Ireland with recruitment in the community from the Clare Primary Care Network. SMART MOVE trial participants and the staff from four primary care centres were invited to take part and all agreed to do so. A qualitative methodology with a combination of focus groups (general practitioners, practice nurses and non-clinical staff from four separate primary care centres, n = 14) and individual semi-structured interviews (intervention and control SMART MOVE trial participants, n = 4) with purposeful sampling utilising the principles of Framework Analysis was utilised. The Normalisation Process Theory was used to develop the topic guide for the interviews and also informed the data analysis process. Four themes emerged from the analysis: personal and professional exercise strategies; roles and responsibilities to support active engagement; utilisation challenges; and evaluation, adoption and adherence. It was evident that introducing a new healthcare intervention demands a comprehensive evaluation of the intervention itself and also the environment in which it is to operate. Despite certain obstacles, the opportunity exists for the successful implementation of a novel healthcare intervention that addresses a hitherto unresolved healthcare need, provided that the intervention has strong usability attributes for both disseminators and target users and coheres strongly with the core objectives and culture of the health care environment in which it is to operate. We

The Urban Adaptation and Adaptation Process of Urban Migrant Children: A Qualitative Study

ERIC Educational Resources Information Center

Liu, Yang; Fang, Xiaoyi; Cai, Rong; Wu, Yang; Zhang, Yaofang

2009-01-01

This article employs qualitative research methods to explore the urban adaptation and adaptation processes of Chinese migrant children. Through twenty-one in-depth interviews with migrant children, the researchers discovered: The participant migrant children showed a fairly high level of adaptation to the city; their process of urban adaptation…

Using mind mapping techniques for rapid qualitative data analysis in public participation processes.

PubMed

Burgess-Allen, Jilla; Owen-Smith, Vicci

2010-12-01

In a health service environment where timescales for patient participation in service design are short and resources scarce, a balance needs to be achieved between research rigour and the timeliness and utility of the findings of patient participation processes. To develop a pragmatic mind mapping approach to managing the qualitative data from patient participation processes. While this article draws on experience of using mind maps in a variety of participation processes, a single example is used to illustrate the approach. In this example mind maps were created during the course of patient participation focus groups. Two group discussions were also transcribed verbatim to allow comparison of the rapid mind mapping approach with traditional thematic analysis of qualitative data. The illustrative example formed part of a local alcohol service review which included consultation with local alcohol service users, their families and staff groups. The mind mapping approach provided a pleasing graphical format for representing the key themes raised during the focus groups. It helped stimulate and galvanize discussion and keep it on track, enhanced transparency and group ownership of the data analysis process, allowed a rapid dynamic between data collection and feedback, and was considerably faster than traditional methods for the analysis of focus groups, while resulting in similar broad themes. This study suggests that the use of a mind mapping approach to managing qualitative data can provide a pragmatic resolution of the tension between limited resources and quality in patient participation processes. © 2010 The Authors. Health Expectations © 2010 Blackwell Publishing Ltd.

Critiquing qualitative research.

PubMed

Beck, Cheryl Tatano

2009-10-01

The ability to critique research is a valuable skill that is fundamental to a perioperative nurse's ability to base his or her clinical practice on evidence derived from research. Criteria differ for critiquing a quantitative versus a qualitative study (ie, statistics are evaluated in a quantitative study, but not in a qualitative study). This article provides on guidelines for assessing qualitative research. Excerpts from a published qualitative research report are summarized and then critiqued. Questions are provided that help evaluate different sections of a research study (eg, sample, data collection methods, data analysis).

Community-based health care for indigenous women in Mexico: a qualitative evaluation

PubMed Central

2014-01-01

Introduction Indigenous women in Mexico represent a vulnerable population in which three kinds of discrimination converge (ethnicity, gender and class), having direct repercussions on health status. The discrimination and inequity in health care settings brought this population to the fore as a priority group for institutional action. The objective of this study was to evaluate the processes and performance of the “Casa de la Mujer Indígena”, a community based project for culturally and linguistically appropriate service delivery for indigenous women. The evaluation summarizes perspectives from diverse stakeholders involved in the implementation of the model, including users, local authorities, and institutional representatives. Methods The study covered five Casas implementation sites located in four Mexican states. A qualitative process evaluation focused on systematically analyzing the Casas project processes and performance was conducted using archival information and semi-structured interviews. Sixty-two interviews were conducted, and grounded theory approach was applied for data analysis. Results Few similarities were observed between the proposed model of service delivery and its implementation in diverse locations, signaling discordant operating processes. Evidence gathered from Casas personnel highlighted their ability to detect obstetric emergencies and domestic violence cases, as well as contribute to the empowerment of women in the indigenous communities served by the project. These themes directly translated to increases in the reporting of abuse and referrals for obstetric emergencies. Conclusions The model’s cultural and linguistic competency, and contributions to increased referrals for obstetric emergencies and abuse are notable successes. The flexibility and community-based nature of the model has allowed it to be adapted to the particularities of diverse indigenous contexts. Local, culturally appropriate implementation has been facilitated

Community-based health care for indigenous women in Mexico: a qualitative evaluation.

PubMed

Pelcastre-Villafuerte, Blanca; Ruiz, Myriam; Meneses, Sergio; Amaya, Claudia; Márquez, Margarita; Taboada, Arianna; Careaga, Katherine

2014-01-06

Indigenous women in Mexico represent a vulnerable population in which three kinds of discrimination converge (ethnicity, gender and class), having direct repercussions on health status. The discrimination and inequity in health care settings brought this population to the fore as a priority group for institutional action. The objective of this study was to evaluate the processes and performance of the "Casa de la Mujer Indígena", a community based project for culturally and linguistically appropriate service delivery for indigenous women. The evaluation summarizes perspectives from diverse stakeholders involved in the implementation of the model, including users, local authorities, and institutional representatives. The study covered five Casas implementation sites located in four Mexican states. A qualitative process evaluation focused on systematically analyzing the Casas project processes and performance was conducted using archival information and semi-structured interviews. Sixty-two interviews were conducted, and grounded theory approach was applied for data analysis. Few similarities were observed between the proposed model of service delivery and its implementation in diverse locations, signaling discordant operating processes. Evidence gathered from Casas personnel highlighted their ability to detect obstetric emergencies and domestic violence cases, as well as contribute to the empowerment of women in the indigenous communities served by the project. These themes directly translated to increases in the reporting of abuse and referrals for obstetric emergencies. The model's cultural and linguistic competency, and contributions to increased referrals for obstetric emergencies and abuse are notable successes. The flexibility and community-based nature of the model has allowed it to be adapted to the particularities of diverse indigenous contexts. Local, culturally appropriate implementation has been facilitated by the fact that the Casas have been

A Coding System for Qualitative Studies of the Information-Seeking Process in Computer Science Research

ERIC Educational Resources Information Center

Moral, Cristian; de Antonio, Angelica; Ferre, Xavier; Lara, Graciela

2015-01-01

Introduction: In this article we propose a qualitative analysis tool--a coding system--that can support the formalisation of the information-seeking process in a specific field: research in computer science. Method: In order to elaborate the coding system, we have conducted a set of qualitative studies, more specifically a focus group and some…

Hand hygiene among healthcare workers: A qualitative meta summary using the GRADE-CERQual process

PubMed Central

Chatfield, Sheryl L.; DeBois, Kristen; Nolan, Rachael; Crawford, Hannah; Hallam, Jeffrey S.

2016-01-01

Background: Hand hygiene is considered an effective and potentially modifiable infection control behaviour among healthcare workers (HCW). Several meta-studies have been published that compare quantitatively expressed findings, but limited efforts have been made to synthesise qualitative research. Objectives: This paper provides the first report of integrated findings from qualitative research reports on hand hygiene compliance among HCW worldwide that employs the GRADE-CERQual process of quality assessment. Methods: We conducted database searches and identified 36 reports in which authors conducted qualitative or mixed methods research on hand hygiene compliance among HCW. We used Dedoose analysis software to facilitate extraction of relevant excerpts. We applied the GRADE-CERQual process to describe relative confidence as high, moderate or low for nine aggregate findings. Findings: Highest confidence findings included that HCW believe they have access to adequate training, and that management and resource support are sometimes lacking. Individual, subjective criteria also influence hand hygiene. Discussion: These results suggest the need for further investigation into healthcare cultures that are perceived as supportive for infection control. Surveillance processes have potential, especially if information is perceived by HCW as timely and relevant. PMID:28989515

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Moving beyond qualitative evaluations of Bayesian models of cognition.

PubMed

Hemmer, Pernille; Tauber, Sean; Steyvers, Mark

2015-06-01

Bayesian models of cognition provide a powerful way to understand the behavior and goals of individuals from a computational point of view. Much of the focus in the Bayesian cognitive modeling approach has been on qualitative model evaluations, where predictions from the models are compared to data that is often averaged over individuals. In many cognitive tasks, however, there are pervasive individual differences. We introduce an approach to directly infer individual differences related to subjective mental representations within the framework of Bayesian models of cognition. In this approach, Bayesian data analysis methods are used to estimate cognitive parameters and motivate the inference process within a Bayesian cognitive model. We illustrate this integrative Bayesian approach on a model of memory. We apply the model to behavioral data from a memory experiment involving the recall of heights of people. A cross-validation analysis shows that the Bayesian memory model with inferred subjective priors predicts withheld data better than a Bayesian model where the priors are based on environmental statistics. In addition, the model with inferred priors at the individual subject level led to the best overall generalization performance, suggesting that individual differences are important to consider in Bayesian models of cognition.

Process service quality evaluation based on Dempster-Shafer theory and support vector machine.

PubMed

Pei, Feng-Que; Li, Dong-Bo; Tong, Yi-Fei; He, Fei

2017-01-01

Human involvement influences traditional service quality evaluations, which triggers an evaluation's low accuracy, poor reliability and less impressive predictability. This paper proposes a method by employing a support vector machine (SVM) and Dempster-Shafer evidence theory to evaluate the service quality of a production process by handling a high number of input features with a low sampling data set, which is called SVMs-DS. Features that can affect production quality are extracted by a large number of sensors. Preprocessing steps such as feature simplification and normalization are reduced. Based on three individual SVM models, the basic probability assignments (BPAs) are constructed, which can help the evaluation in a qualitative and quantitative way. The process service quality evaluation results are validated by the Dempster rules; the decision threshold to resolve conflicting results is generated from three SVM models. A case study is presented to demonstrate the effectiveness of the SVMs-DS method.

Teacher Evaluation: A Qualitative Study on Growth-Producing Practices in K-8 Schools

ERIC Educational Resources Information Center

Manso, Phoebe Hechanova

2017-01-01

Literature on teacher evaluation describes a flawed system that evokes wide-ranging attempts to "get it right." This qualitative study is another effort that seeks to understand its legal and traditional constructs. The goal of this research is to identify growth-producing practices that will transform teacher evaluation into an organic…

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren.

PubMed

Helitzer, D L; Davis, S M; Gittelsohn, J; Going, S B; Murray, D M; Snyder, P; Steckler, A B

1999-04-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used.

[Reconsidering evaluation criteria regarding health care research: toward an integrative framework of quantitative and qualitative criteria].

PubMed

Miyata, Hiroaki; Kai, Ichiro

2006-05-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confused and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. It is therefore very important to reconsider evaluation criteria regarding rigor in social science. As Lincoln & Guba have already compared quantitative paradigms (validity, reliability, neutrality, generalizability) with qualitative paradigms (credibility, dependability, confirmability, transferability), we have discuss use of evaluation criteria based on pragmatic perspective. Validity/Credibility is the paradigm concerned to observational framework, while Reliability/Dependability refer to the range of stability in observations, Neutrality/Confirmability reflect influences between observers and subjects, Generalizability/Transferability have epistemological difference in the way findings are applied. Qualitative studies, however, does not always chose the qualitative paradigms. If we assume the stability to some extent, it is better to use the quantitative paradigm (reliability). Moreover as a quantitative study can not always guarantee a perfect observational framework, with stability in all phases of observations, it is useful to use qualitative paradigms to enhance the rigor in the study.

[Advantages and disadvantages of incorporating qualitative methodology in the evaluation of health services. A practical case: evaluation of a high-resolution clinic].

PubMed

Alvarez Del Arco, D; Rodríguez Rieiro, C; Sanchidrián De Blás, C; Alejos, B; Plá Mestre, R

2012-01-01

We examined the usefulness of incorporating a qualitative phase in the evaluation of the quality of care in a high-resolution medical service carried out with quantitative methods. A quantitative research was performed using a structured questionnaire and selecting interviewees by systematic randomized sampling methods (n=320). In addition, a qualitative research was carried on through semi-structured interviews with patients selected by convenience criteria (n=11), observations in the care assistance circuit, and a group interview with health professionals working in the service. A multidisciplinary research team conducted an individual analysis of the information collected in both quantitative and qualitative phases. Subsequently, three meetings based on group brainstorming techniques were held to identify the diverse contributions of each of the methodologies employed to the research, using affinity graphs to analyse the different results obtained in both phases and evaluate possible bias arising from the use of qualitative methods. Qualitative research allowed examining specific aspects of the health care service that had been collected in the quantitative phase, harmonizing the results obtained in the previous phase, giving in-depth data on the reasons for patient dissatisfaction with specific aspects, such as waiting times and available infrastructures, and identifying emerging issues of the service which had not been previously assessed. Overall, the qualitative phase enriched the results of the research. It is appropriate and recommendable to incorporate this methodological approach in research aimed at evaluating the quality of the service in specific health care settings, since it is provided first hand, by the voice of the customer. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

PubMed

Tonkin-Crine, Sarah; Anthierens, Sibyl; Hood, Kerenza; Yardley, Lucy; Cals, Jochen W L; Francis, Nick A; Coenen, Samuel; van der Velden, Alike W; Godycki-Cwirko, Maciek; Llor, Carl; Butler, Chris C; Verheij, Theo J M; Goossens, Herman; Little, Paul

2016-05-12

Mixed methods are commonly used in health services research; however, data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point-of-care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs' and patients' experiences of taking part in the trial. Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with (1) 62 patients and (2) 66 GPs and quantitative data collected via questionnaires with (3) 2886 patients and (4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence. Three instances of dissonance occurred in 39 independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt that the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested that this was unnecessary if a full explanation was given. Whilst qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet. Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient

Mentoring doctoral students for qualitative research: interviews with experienced nursing faculty in Japan.

PubMed

Kayama, Mami; Gregg, Misuzu F; Asahara, Kiyomi; Yamamoto-Mitani, Noriko; Okuma, Keiko; Ohta, Kikuko; Kinoshita, Yasuhito

2013-05-01

This study aimed to describe the process of mentoring doctoral students for qualitative research in Japanese graduate programs in nursing. Nine experienced faculty-seven nurse researchers and two sociologists-were interviewed. Participants were asked about their process of mentoring students for qualitative nursing dissertations. Data analysis was conducted using a qualitative descriptive method. Participants' age ranged from 48 to 60 years. The first theme in the mentoring process is about the individualized, one-on-one mentorship process. The second theme occurs in a group process. The third theme is coordinating mentors and establishing a network to support the evaluation system. The mentoring processes identified in this study will be useful for future faculty development. The study elucidated much room for improvement in doctoral education programs for qualitative research methods in nursing science. Copyright 2013, SLACK Incorporated.

Measuring Down: Evaluating Digital Storytelling as a Process for Narrative Health Promotion.

PubMed

Gubrium, Aline C; Fiddian-Green, Alice; Lowe, Sarah; DiFulvio, Gloria; Del Toro-Mejías, Lizbeth

2016-05-15

Digital storytelling (DST) engages participants in a group-based process to create and share narrative accounts of life events. We present key evaluation findings of a 2-year, mixed-methods study that focused on effects of participating in the DST process on young Puerto Rican Latina's self-esteem, social support, empowerment, and sexual attitudes and behaviors. Quantitative results did not show significant changes in the expected outcomes. However, in our qualitative findings we identified several ways in which the DST made positive, health-bearing effects. We argue for the importance of "measuring down" to reflect the locally grounded, felt experiences of participants who engage in the process, as current quantitative scales do not "measure up" to accurately capture these effects. We end by suggesting the need to develop mixed-methods, culturally relevant, and sensitive evaluation tools that prioritize process effects as they inform intervention and health promotion. © The Author(s) 2016.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric

Qualitative study about the ways teachers react to feedback from resident evaluations

PubMed Central

2013-01-01

Background Currently, one of the main interventions that are widely expected to contribute to teachers’ professional development is confronting teachers with feedback from resident evaluations of their teaching performance. Receiving feedback, however, is a double edged sword. Teachers see themselves confronted with information about themselves and are, at the same time, expected to be role models in the way they respond to feedback. Knowledge about the teachers’ responses could be not only of benefit for their professional development, but also for supporting their role modeling. Therefore, research about professional development should include the way teachers respond to feedback. Method We designed a qualitative study with semi-structured individual conversations about feedback reports, gained from resident evaluations. Two researchers carried out a systematic analysis using qualitative research software. The analysis focused on what happened in the conversations and structured the data in three main themes: conversation process, acceptance and coping strategies. Results The result section describes the conversation patterns and atmosphere. Teachers accepted their results calmly, stating that, although they recognised some points of interest, they could not meet with every standard. Most used coping strategies were explaining the results from their personal beliefs about good teaching and attributing poor results to external factors and good results to themselves. However, some teachers admitted that they had poor results because of the fact that they were not “sharp enough” in their resident group, implying that they did not do their best. Conclusions Our study not only confirms that the effects of feedback depend first and foremost on the recipient but also enlightens the meaning and role of acceptance and being a role model. We think that the results justify the conclusion that teachers who are responsible for the day release programmes in the three

Expediting the Analysis of Qualitative Data in Evaluation: A Procedure for the Rapid Identification of Themes from Audio Recordings (RITA)

ERIC Educational Resources Information Center

Neal, Jennifer Watling; Neal, Zachary P.; VanDyke, Erika; Kornbluh, Mariah

2015-01-01

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

Factors Influencing Hand Washing Behaviour in Primary Schools: Process Evaluation within a Randomized Controlled Trial

ERIC Educational Resources Information Center

Chittleborough, Catherine R.; Nicholson, Alexandra L.; Basker, Elaine; Bell, Sarah; Campbell, Rona

2012-01-01

This article explores factors that may influence hand washing behaviour among pupils and staff in primary schools. A qualitative process evaluation within a cluster randomized controlled trial included pupil focus groups (n = 16, aged 6-11 years), semi-structured interviews (n = 16 teachers) and observations of hand washing facilities (n = 57).…

The Design, Development, and Evaluation of a Qualitative Data Collection Application for Pregnant Women.

PubMed

Keedle, Hazel; Schmied, Virginia; Burns, Elaine; Dahlen, Hannah

2018-01-01

This article explores the development and evaluation of a smartphone mobile software application (app) to collect qualitative data. The app was specifically designed to capture real-time qualitative data from women planning a vaginal birth after caesarean delivery. This article outlines the design and development of the app to include funding, ethics, and the recruitment of an app developer, as well as the evaluation of using the app by seven participants. Data collection methods used in qualitative research include interviews and focus groups (either online, face-to-face, or by phone), participant diaries, or observations of interactions. This article identifies an alternative data collection methodology using a smartphone app to collect real-time data. The app provides real-time data and instant access to data alongside the ability to access participants from a variety of locations. This allows the researcher to gain insight into the experiences of participants through audio or video recordings in longitudinal studies without the need for constant interactions or interviews with participants. Using smartphone applications can allow researchers to access participants who are traditionally hard to reach and access their data in real time. Evaluating these apps before use in research is invaluable. © 2017 Sigma Theta Tau International.

The Process of Adjustment among Caregivers of Individuals with Spinal Cord Injury: A Qualitative Study

DTIC Science & Technology

2015-10-01

Paralyzed Veterans of America Summit highlighting caregiver quality of life and social support. 10 What was the...1 AWARD NUMBER: W81XWH-14-1-0621 TITLE: The Process of Adjustment among Caregivers of Individuals with Spinal Cord Injury: A Qualitative Study...among Caregivers of Individuals with Spinal Cord Injury: A Qualitative Study 5b. GRANT NUMBER W81XWH-14-1-0621 5c. PROGRAM ELEMENT NUMBER 6

Meta-evaluation of a participatory process in the strengthening of municipal management

PubMed Central

de Almeida, Cristiane Andrea Locatelli; Tanaka, Oswaldo Yoshimi

2017-01-01

ABSTRACT OBJECTIVE To evaluate, with a focus on participation, an evaluation process developed by municipal managers and administrators of a health region in the state of São Paulo, considering the need for theoretical reflection on participatory health practices in the Brazilian context. METHODS Qualitative research that used the framework developed by Daigneault and Jacob (2009) to analyze the empirical material, encompassing three dimensions of participation: control of the evaluation process, diversity of participants, and extent of their involvement. We highlighted decisions or contextual aspects that deepened or limited the participatory option in the process under study. RESULTS We identified the presence and important performance of stakeholders who are “not specialists in evaluation”, through participation both in the direction of the evaluation process and in its distinct stages. The formed group started from their own annoyances added to the need for information and reflection to define the subject and scope of the evaluation; the use of the process planned by them guided the definition of the data to be collected and the format of result dissemination; the empirical material analysis was undertaken jointly by the participants. Regarding the third dimension, a limitation was identified regarding the diversity of actors involved due to the prioritization of the possibility of in-depth work with a fixed group of managers. CONCLUSIONS It is stated that there is no “ideal participation model” for evaluations. In certain contexts and structures, real opportunities for participation – even if they seem fragile at first sight – should be leveraged, and that requires flexibility and critical reflection on the part of those responsible for the evaluation processes to undertake the necessary adjustments. PMID:29166448

Methodological challenges in cross-language qualitative research: a research review.

PubMed

Squires, Allison

2009-02-01

Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this analysis of cross-language qualitative research was threefold: (1) review the methods literature addressing cross-language research; (2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; (3) test these criteria on published cross-language qualitative studies. A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant's language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other

Evaluation of an interview process for admission into a school of pharmacy.

PubMed

Kelsch, Michael P; Friesner, Daniel L

2012-03-12

To evaluate the doctor of pharmacy (PharmD) admissions interview process at North Dakota State University (NDSU). Faculty pairs interviewed candidates using a standardized grading rubric to evaluate qualitative parameters or attributes such as ethics, relevant life and work experience, emotional maturity, commitment to patient care, leadership, and understanding of the pharmacy profession. Total interview scores, individual attribute domain scores, and the consistency and reliability of the interviewers were assessed. The total mean interview score for the candidate pool was 17.4 of 25 points. Mean scores for individual domains ranged from 2.3 to 3.0 on a Likert-scale of 0-4. Nine of the 11 faculty pairs showed no mean differences from their interview partner in total interview scores given. Evaluations by 8 of the 11 faculty pairs produced high interrater reliability. The current interview process is generally consistent and reliable; however, future improvements such as additional interviewer training and adoption of a multiple mini-interview format could be made.

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Using the cognitive interviewing process to improve survey design by allied health: A qualitative study.

PubMed

Howlett, Owen; McKinstry, Carol; Lannin, Natasha A

2018-04-01

Allied health professionals frequently use surveys to collect data for clinical practice and service improvement projects. Careful development and piloting of purpose-designed surveys is important to ensure intended measuring (that respondents correctly interpret survey items when responding). Cognitive interviewing is a specific technique that can improve the design of self-administered surveys. The aim of this study was to describe the use of the cognitive interviewing process to improve survey design, which involved a purpose-designed, online survey evaluating staff use of functional electrical stimulation. A qualitative study involving one round of cognitive interviewing with three occupational therapists and three physiotherapists. The cognitive interviewing process identified 11 issues with the draft survey, which could potentially influence the validity and quality of responses. The raised issues included difficulties with: processing the question to be able to respond, determining a response to the question, retrieving relevant information from memory and comprehending the written question. Twelve survey amendments were made following the cognitive interviewing process, comprising four additions, seven revisions and one correction. The cognitive interviewing process applied during the development of a purpose-designed survey enabled the identification of potential problems and informed revisions to the survey prior to its use. © 2017 Occupational Therapy Australia.

[Modality of combined methods of quantitative and qualitative research in evaluation of therapeutic effects of Chinese medicine].

PubMed

Liu, Jian-ping

2011-05-01

The core of evidence-based medicine lies in implementing the current best available evidence of clinical research to direct the decision making in clinical practice, incorporation of individual experience and value and preference of patients. However, the current evaluation method for clinical therapeutic effect cannot reflect the humanity and wholesomeness as well as individualized tailored treatment of Chinese medicine (CM) by using randomized controlled trials. This assay addressed the complex intervention of highly individualized treatment of CM and its societal characteristics, and the author proposes a model for the evaluation of therapeutic effects of CM in which quantitative and qualitative methods are combined, embodying the characteristics of the social and natural sciences in CM. The model can show the dynamic process of CM diagnosis and treatment from a perspective of the whole system and can be used for the evaluation of complex intervention of CM. We hope to raise a different thinking and method from the new drug development in the therapeutic effect evaluation.

Qualitative computer aided evaluation of dental impressions in vivo.

PubMed

Luthardt, Ralph G; Koch, Rainer; Rudolph, Heike; Walter, Michael H

2006-01-01

Clinical investigations dealing with the precision of different impression techniques are rare. Objective of the present study was to develop and evaluate a procedure for the qualitative analysis of the three-dimensional impression precision based on an established in-vitro procedure. The zero hypothesis to be tested was that the precision of impressions does not differ depending on the impression technique used (single-step, monophase and two-step-techniques) and on clinical variables. Digital surface data of patient's teeth prepared for crowns were gathered from standardized manufactured master casts after impressions with three different techniques were taken in a randomized order. Data-sets were analyzed for each patient in comparison with the one-step impression chosen as the reference. The qualitative analysis was limited to data-points within the 99.5%-range. Based on the color-coded representation areas with maximum deviations were determined (preparation margin and the mantle and occlusal surface). To qualitatively analyze the precision of the impression techniques, the hypothesis was tested in linear models for repeated measures factors (p < 0.05). For the positive 99.5% deviations no variables with significant influence were determined in the statistical analysis. In contrast, the impression technique and the position of the preparation margin significantly influenced the negative 99.5% deviations. The influence of clinical parameter on the deviations between impression techniques can be determined reliably using the 99.5 percentile of the deviations. An analysis regarding the areas with maximum deviations showed high clinical relevance. The preparation margin was pointed out as the weak spot of impression taking.

Exploring Operational Test and Evaluation of Unmanned Aircraft Systems: A Qualitative Case Study

NASA Astrophysics Data System (ADS)

Saliceti, Jose A.

The purpose of this qualitative case study was to explore and identify strategies that may potentially remedy operational test and evaluation procedures used to evaluate Unmanned Aircraft Systems (UAS) technology. The sample for analysis consisted of organizations testing and evaluating UASs (e.g., U.S. Air Force, U.S. Navy, U.S. Army, U.S. Marine Corps, U.S. Coast Guard, and Customs Border Protection). A purposeful sampling technique was used to select 15 subject matter experts in the field of operational test and evaluation of UASs. A questionnaire was provided to participants to construct a descriptive and robust research. Analysis of responses revealed themes related to each research question. Findings revealed operational testers utilized requirements documents to extrapolate measures for testing UAS technology and develop critical operational issues. The requirements documents were (a) developed without the contribution of stakeholders and operational testers, (b) developed with vague or unrealistic measures, and (c) developed without a systematic method to derive requirements from mission tasks. Four approaches are recommended to develop testable operational requirements and assist operational testers: (a) use a mission task analysis tool to derive requirements for mission essential tasks for the system, (b) exercise collaboration among stakeholders and testers to ensure testable operational requirements based on mission tasks, (c) ensure testable measures are used in requirements documents, and (d) create a repository list of critical operational issues by mission areas. The preparation of operational test and evaluation processes for UAS technology is not uniform across testers. The processes in place are not standardized, thus test plan preparation and reporting are different among participants. A standard method to prepare and report UAS technology should be used when preparing and reporting on UAS technology. Using a systematic process, such as mission

Non cardiopatic and cardiopatic beta thalassemic patients: quantitative and qualitative cardiac iron deposition evaluation with MRI.

PubMed

Macarini, L; Marini, S; Pietrapertosa, A; Scardapane, A; Ettorre, G C

2005-01-01

Cardiomyopathy is one of the major complications of b thalassaemia major as a result of transfusional iron overload. The aim of our study is to evaluate with MR if there is any difference of iron deposition signal intensity (SI) or distribution between non-cardiopathic and cardiopathic thalassaemic patients in order to establish if there is a relationship between cardiopathy and iron deposition. We studied 20 patients affected by b thalassaemia major, of whom 10 cardiopathic and 10 non-cardiopathic, and 10 healthy volunteers as control group. Serum ferritin and left ventricular ejection fraction were calculated in thalassaemic patients. All patients were examined using a 1.5 MR unit with ECG-gated GE cine-MR T2*-weighted, SE T1-weighted and GE T2*-weighted sequences. In all cases, using an adequate ROI, the myocardial and skeletal muscle signal intensity (SI), the myocardial/skeletal muscle signal intensity ratio (SIR) and the SI average of the myocardium and skeletal muscle were calculated for every study group. The qualitative evaluation of iron deposition distribution was independently performed by three radiologists who analyzed the extension, the site and the morphology of iron deposition on the MR images and reported their observations on the basis of a four-level rating scale: 0 (absent), 1 (limited), 2 (partial), 3 (widespread deposition). The result of quantitative and qualitative evaluations were analysed with statistical tests. Cardiac iron deposition was found in 8/10 non-cardiopathic thalassaemic patients and in all cardiopathic thalassaemic patients. We noticed a significant SI difference (p>0.05) between the healthy volunteer control group and the thalassaemic patients with iron deposition, but no significant SI difference in iron deposition between non-cardiopathic and cardiopathic thalassaemic patients in the areas evaluated. The qualitative evaluation revealed a different distribution of iron deposition between the two thalassaemic groups, with

Challenges of teacher-based clinical evaluation from nursing students' point of view: Qualitative content analysis.

PubMed

Sadeghi, Tabandeh; Seyed Bagheri, Seyed Hamid

2017-01-01

Clinical evaluation is very important in the educational system of nursing. One of the most common methods of clinical evaluation is evaluation by the teacher, but the challenges that students would face in this evaluation method, have not been mentioned. Thus, this study aimed to explore the experiences and views of nursing students about the challenges of teacher-based clinical evaluation. This study was a descriptive qualitative study with a qualitative content analysis approach. Data were gathered through semi-structured focused group sessions with undergraduate nursing students who were passing their 8 th semester at Rafsanjan University of Medical Sciences. Date were analyzed using Graneheim and Lundman's proposed method. Data collection and analysis were concurrent. According to the findings, "factitious evaluation" was the main theme of study that consisted of three categories: "Personal preferences," "unfairness" and "shirking responsibility." These categories are explained using quotes derived from the data. According to the results of this study, teacher-based clinical evaluation would lead to factitious evaluation. Thus, changing this approach of evaluation toward modern methods of evaluation is suggested. The finding can help nursing instructors to get a better understanding of the nursing students' point of view toward this evaluation approach and as a result could be planning for changing of this approach.

Qualitative evaluations and comparisons of six night-vision colorization methods

NASA Astrophysics Data System (ADS)

Zheng, Yufeng; Reese, Kristopher; Blasch, Erik; McManamon, Paul

2013-05-01

Current multispectral night vision (NV) colorization techniques can manipulate images to produce colorized images that closely resemble natural scenes. The colorized NV images can enhance human perception by improving observer object classification and reaction times especially for low light conditions. This paper focuses on the qualitative (subjective) evaluations and comparisons of six NV colorization methods. The multispectral images include visible (Red-Green- Blue), near infrared (NIR), and long wave infrared (LWIR) images. The six colorization methods are channel-based color fusion (CBCF), statistic matching (SM), histogram matching (HM), joint-histogram matching (JHM), statistic matching then joint-histogram matching (SM-JHM), and the lookup table (LUT). Four categries of quality measurements are used for the qualitative evaluations, which are contrast, detail, colorfulness, and overall quality. The score of each measurement is rated from 1 to 3 scale to represent low, average, and high quality, respectively. Specifically, high contrast (of rated score 3) means an adequate level of brightness and contrast. The high detail represents high clarity of detailed contents while maintaining low artifacts. The high colorfulness preserves more natural colors (i.e., closely resembles the daylight image). Overall quality is determined from the NV image compared to the reference image. Nine sets of multispectral NV images were used in our experiments. For each set, the six colorized NV images (produced from NIR and LWIR images) are concurrently presented to users along with the reference color (RGB) image (taken at daytime). A total of 67 subjects passed a screening test ("Ishihara Color Blindness Test") and were asked to evaluate the 9-set colorized images. The experimental results showed the quality order of colorization methods from the best to the worst: CBCF < SM < SM-JHM < LUT < JHM < HM. It is anticipated that this work will provide a benchmark for NV

Qualitative Student Models.

ERIC Educational Resources Information Center

Clancey, William J.

The concept of a qualitative model is used as the focus of this review of qualitative student models in order to compare alternative computational models and to contrast domain requirements. The report is divided into eight sections: (1) Origins and Goals (adaptive instruction, qualitative models of processes, components of an artificial…

[Qualitative evaluation of blood products records in a hospital].

PubMed

Lartigue, B; Catillon, E

2012-02-01

This study aimed at evaluating the qualitative performance of blood products traceability from paper and electronic medical records in a hospital. Quality of date/time documentation was assessed by detection, for 20minutes or more, of chronological errors and inter-source inconsistencies, in a random sample of 168 blood products transfused during 2009. A receipt date/time was confirmed in 52% of paper records; a data entry error was attested in 25% of paper records, and 21% of electronic records. A transfusion date/time was notified in 93% of paper records, with a data entry error in 26% of paper records and 25% of electronic records. The patient medical record held at least one date/time error in 18% and 17%, for receipt and transfusion respectively. Environmental factors (clinical setting, urgency, blood product category) did not contributed to data error rates. Although blood products traceability has good quantitative results, the recorded documentation is not qualitative. In our study, data entry errors are similar in electronic or paper records, but the global failure rate is lesser in electronic records because omissions are controlled. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

Nurse practitioner integration: Qualitative experiences of the change management process.

PubMed

Lowe, Grainne; Plummer, Virginia; Boyd, Leanne

2018-04-30

The aim of this qualitative research was to explore perceptions of organisational change related to the integration of nurse practitioners from key nursing stakeholders. The ongoing delivery of effective and efficient patient services is reliant upon the development and sustainability of nurse practitioner roles. Examination of the factors contributing to the underutilization of nurse practitioner roles is crucial to inform future management policies. A change management theory is used to reveal the complexity involved. Qualitative interviews were undertaken using a purposive sampling strategy of key stakeholders. Thematic analysis was undertaken and key themes were correlated to the theoretical framework. The results confirm the benefits of nurse practitioner roles, but suggest organisational structures and embedded professional cultures present barriers to full role optimization. Complicated policy processes are creating barriers to the integration of nurse practitioner roles. The findings increase understanding of the links between strategic planning, human resource management, professional and organisational cultures, governance and politics in change management. Effective leadership drives the change process through the ability to align key components necessary for success. Sustainability of nurse practitioners relies on recognition of their full potential in the health care team. The results of this study highlight the importance of management and leadership in the promotion of advanced nursing skills and experience to better meet patient outcomes. The findings reinforce the potential of nurse practitioners to deliver patient centred, timely and efficient health care. © 2018 John Wiley & Sons Ltd.

Qualitative Methods in Mental Health Services Research

PubMed Central

Palinkas, Lawrence A.

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This paper reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the papers included in this special series along with representative examples from the literature. Qualitative methods are used to provide a “thick description” or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods, but often differ with respect to study design, data collection and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semi-structured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research. PMID:25350675

An evaluation of the process and initial impact of disseminating a nursing e-thesis.

PubMed

Macduff, Colin

2009-05-01

This paper is a report of a study conducted to evaluate product, process and outcome aspects of the dissemination of a nursing PhD thesis via an open-access electronic institutional repository. Despite the growth of university institutional repositories which make theses easily accessible via the world wide web, nursing has been very slow to evaluate related processes and outcomes. Drawing on Stake's evaluation research methods, a case study design was adopted. The case is described using a four-phase structure within which key aspects of process and impact are reflexively analysed. In the conceptualization/re-conceptualization phase, fundamental questions about the purpose, format and imagined readership for a published nursing PhD were considered. In the preparation phase, seven key practical processes were identified that are likely to be relevant to most e-theses. In the dissemination phase email invitations were primarily used to invite engagement. The evaluation phase involved quantitative indicators of initial impact, such as page viewing and download statistics and qualitative feedback on processes and product. Analysis of process and impact elements of e-thesis dissemination is likely to have more than intrinsic value. The advent of e-theses housed in web-based institutional repositories has the potential to transform thesis access and use. It also offers potential to transform the nature and scope of thesis production and dissemination. Nursing scholars can exploit and evaluate such opportunities.

Rationale, design and methods for process evaluation in the HEALTHY study.

PubMed

Schneider, M; Hall, W J; Hernandez, A E; Hindes, K; Montez, G; Pham, T; Rosen, L; Sleigh, A; Thompson, D; Volpe, S L; Zeveloff, A; Steckler, A

2009-08-01

The HEALTHY study was a multi-site randomized trial designed to determine whether a 3-year school-based intervention targeting nutrition and physical activity behaviors could effectively reduce risk factors associated with type 2 diabetes in middle school children. Pilot and formative studies were conducted to inform the development of the intervention components and the process evaluation methods for the main trial. During the main trial, both qualitative and quantitative assessments monitored the fidelity of the intervention and motivated modifications to improve intervention delivery. Structured observations of physical education classes, total school food environments, classroom-based educational modules, and communications and promotional campaigns provided verification that the intervention was delivered as intended. Interviews and focus groups yielded a multidimensional assessment of how the intervention was delivered and received, as well as identifying the barriers to and facilitators of the intervention across and within participating schools. Interim summaries of process evaluation data were presented to the study group as a means of ensuring standardization and quality of the intervention across the seven participating centers. Process evaluation methods and procedures documented the fidelity with which the HEALTHY study was implemented across 21 intervention schools and identified ways in which the intervention delivery might be enhanced throughout the study.

Evaluating factors influencing the delivery and outcomes of an incentive-based behaviour change strategy targeting child obesity: protocol for a qualitative process and impact evaluation.

PubMed

Enright, Gemma; Gyani, Alex; Raadsma, Simon; Allman-Farinelli, Margaret; Rissel, Chris; Innes-Hughes, Christine; Lukeis, Sarah; Rodgers, Anthony; Redfern, Julie

2016-12-16

Community-based weight management programmes are important in addressing childhood obesity. However, the mechanisms that lead to behaviour change within the programmes are rarely studied within the context of the programmes themselves once they have been implemented. This means that further potential gains in the effectiveness of the programme are often not made and any potential losses of efficacy are often not noticed. Qualitative research alongside randomised controlled trials (RCTs) can tell us the context in which these programmes are implemented and elucidate potential mediators or modifiers of the programmes' effectiveness. The aim of this evaluation is to determine the barriers and enablers to the delivery and impact of an incentive-based behaviour change strategy targeting child obesity to inform future translation. Qualitative analysis, including stakeholder and family interviews, focus groups and a survey, will be used. The research will be conducted in collaboration with policymakers, researchers and community health professionals. Participants will be selected from programme providers, and parents/carers and children participating in an Australian community weight management programme during an RCT examining the effectiveness of incentives for improving behaviour change. A maximum variation sampling method based on participant demographics and group characteristics will be used. Thematic analysis will be carried out inductively based on emergent themes, using NVivo V.9. This research is approved by the South West Sydney Human Ethics Committee review body (HREC/14/LPOOL/480). The evaluation will provide information about the contextual and influencing factors related to the outcomes of the RCT. The results will assist researchers, community health practitioners and policymakers regarding the development, implementation and translation of behaviour change strategies in community initiatives for obese children. Insights gained may be applicable to a range

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study

PubMed Central

Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-01-01

Background To improve workers’ health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. Objective The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Methods Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Results Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts

Analysis of cognitive theories in artificial intelligence and psychology in relation to the qualitative process of emotion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Semrau, P.

The purpose of this study was to analyze selected cognitive theories in the areas of artificial intelligence (A.I.) and psychology to determine the role of emotions in the cognitive or intellectual processes. Understanding the relationship of emotions to processes of intelligence has implications for constructing theories of aesthetic response and A.I. systems in art. Psychological theories were examined that demonstrated the changing nature of the research in emotion related to cognition. The basic techniques in A.I. were reviewed and the A.I. research was analyzed to determine the process of cognition and the role of emotion. The A.I. research emphasized themore » digital, quantifiable character of the computer and associated cognitive models and programs. In conclusion, the cognitive-emotive research in psychology and the cognitive research in A.I. emphasized quantification methods over analog and qualitative characteristics required for a holistic explanation of cognition. Further A.I. research needs to examine the qualitative aspects of values, attitudes, and beliefs on influencing the creative thinking processes. Inclusion of research related to qualitative problem solving in art provides a more comprehensive base of study for examining the area of intelligence in computers.« less

Process evaluation distributed system

NASA Technical Reports Server (NTRS)

Moffatt, Christopher L. (Inventor)

2006-01-01

The distributed system includes a database server, an administration module, a process evaluation module, and a data display module. The administration module is in communication with the database server for providing observation criteria information to the database server. The process evaluation module is in communication with the database server for obtaining the observation criteria information from the database server and collecting process data based on the observation criteria information. The process evaluation module utilizes a personal digital assistant (PDA). A data display module in communication with the database server, including a website for viewing collected process data in a desired metrics form, the data display module also for providing desired editing and modification of the collected process data. The connectivity established by the database server to the administration module, the process evaluation module, and the data display module, minimizes the requirement for manual input of the collected process data.

Using a theory-driven conceptual framework in qualitative health research.

PubMed

Macfarlane, Anne; O'Reilly-de Brún, Mary

2012-05-01

The role and merits of highly inductive research designs in qualitative health research are well established, and there has been a powerful proliferation of grounded theory method in the field. However, tight qualitative research designs informed by social theory can be useful to sensitize researchers to concepts and processes that they might not necessarily identify through inductive processes. In this article, we provide a reflexive account of our experience of using a theory-driven conceptual framework, the Normalization Process Model, in a qualitative evaluation of general practitioners' uptake of a free, pilot, language interpreting service in the Republic of Ireland. We reflect on our decisions about whether or not to use the Model, and describe our actual use of it to inform research questions, sampling, coding, and data analysis. We conclude with reflections on the added value that the Model and tight design brought to our research.

A Qualitative Systematic Review of the Bereavement Process Following Suicide.

PubMed

Shields, Chris; Kavanagh, Michele; Russo, Kate

2017-03-01

Despite the fact that a large number of people are bereaved by suicide each year, the experiences of those bereaved by suicide are poorly understood. It has been suggested that a contributing factor in relation to this lack of understanding has been the use of quantitative methods, which may not be sensitive to the bereavement process and its thematic content. Therefore, the current article outlines a systematic review of 11 qualitative studies that address issues related to the bereavement process following suicide. The results indicate that those bereaved by suicide encounter a range of difficult feelings following suicide including blame, guilt, and emptiness and that these feelings are affected by participants' ability to make meaning of the event. The meaning-making process is a complex one that occurs within a difficult social context in which both those bereaved by suicide and members of the wider community struggle to interact with each other in a beneficial way. Clinical implications of these findings are discussed.

A qualitative systematic review of studies using the normalization process theory to research implementation processes.

PubMed

McEvoy, Rachel; Ballini, Luciana; Maltoni, Susanna; O'Donnell, Catherine A; Mair, Frances S; Macfarlane, Anne

2014-01-02

There is a well-recognized need for greater use of theory to address research translational gaps. Normalization Process Theory (NPT) provides a set of sociological tools to understand and explain the social processes through which new or modified practices of thinking, enacting, and organizing work are implemented, embedded, and integrated in healthcare and other organizational settings. This review of NPT offers readers the opportunity to observe how, and in what areas, a particular theoretical approach to implementation is being used. In this article we review the literature on NPT in order to understand what interventions NPT is being used to analyze, how NPT is being operationalized, and the reported benefits, if any, of using NPT. Using a framework analysis approach, we conducted a qualitative systematic review of peer-reviewed literature using NPT. We searched 12 electronic databases and all citations linked to six key NPT development papers. Grey literature/unpublished studies were not sought. Limitations of English language, healthcare setting and year of publication 2006 to June 2012 were set. Twenty-nine articles met the inclusion criteria; in the main, NPT is being applied to qualitatively analyze a diverse range of complex interventions, many beyond its original field of e-health and telehealth. The NPT constructs have high stability across settings and, notwithstanding challenges in applying NPT in terms of managing overlaps between constructs, there is evidence that it is a beneficial heuristic device to explain and guide implementation processes. NPT offers a generalizable framework that can be applied across contexts with opportunities for incremental knowledge gain over time and an explicit framework for analysis, which can explain and potentially shape implementation processes. This is the first review of NPT in use and it generates an impetus for further and extended use of NPT. We recommend that in future NPT research, authors should explicate

A qualitative systematic review of studies using the normalization process theory to research implementation processes

PubMed Central

2014-01-01

Background There is a well-recognized need for greater use of theory to address research translational gaps. Normalization Process Theory (NPT) provides a set of sociological tools to understand and explain the social processes through which new or modified practices of thinking, enacting, and organizing work are implemented, embedded, and integrated in healthcare and other organizational settings. This review of NPT offers readers the opportunity to observe how, and in what areas, a particular theoretical approach to implementation is being used. In this article we review the literature on NPT in order to understand what interventions NPT is being used to analyze, how NPT is being operationalized, and the reported benefits, if any, of using NPT. Methods Using a framework analysis approach, we conducted a qualitative systematic review of peer-reviewed literature using NPT. We searched 12 electronic databases and all citations linked to six key NPT development papers. Grey literature/unpublished studies were not sought. Limitations of English language, healthcare setting and year of publication 2006 to June 2012 were set. Results Twenty-nine articles met the inclusion criteria; in the main, NPT is being applied to qualitatively analyze a diverse range of complex interventions, many beyond its original field of e-health and telehealth. The NPT constructs have high stability across settings and, notwithstanding challenges in applying NPT in terms of managing overlaps between constructs, there is evidence that it is a beneficial heuristic device to explain and guide implementation processes. Conclusions NPT offers a generalizable framework that can be applied across contexts with opportunities for incremental knowledge gain over time and an explicit framework for analysis, which can explain and potentially shape implementation processes. This is the first review of NPT in use and it generates an impetus for further and extended use of NPT. We recommend that in future

Development of retrospective quantitative and qualitative job-exposure matrices for exposures at a beryllium processing facility.

PubMed

Couch, James R; Petersen, Martin; Rice, Carol; Schubauer-Berigan, Mary K

2011-05-01

To construct a job-exposure matrix (JEM) for an Ohio beryllium processing facility between 1953 and 2006 and to evaluate temporal changes in airborne beryllium exposures. Quantitative area- and breathing-zone-based exposure measurements of airborne beryllium were made between 1953 and 2006 and used by plant personnel to estimate daily weighted average (DWA) exposure concentrations for sampled departments and operations. These DWA measurements were used to create a JEM with 18 exposure metrics, which was linked to the plant cohort consisting of 18,568 unique job, department and year combinations. The exposure metrics ranged from quantitative metrics (annual arithmetic/geometric average DWA exposures, maximum DWA and peak exposures) to descriptive qualitative metrics (chemical beryllium species and physical form) to qualitative assignment of exposure to other risk factors (yes/no). Twelve collapsed job titles with long-term consistent industrial hygiene samples were evaluated using regression analysis for time trends in DWA estimates. Annual arithmetic mean DWA estimates (overall plant-wide exposures including administration, non-production, and production estimates) for the data by decade ranged from a high of 1.39 μg/m(3) in the 1950s to a low of 0.33 μg/m(3) in the 2000s. Of the 12 jobs evaluated for temporal trend, the average arithmetic DWA mean was 2.46 μg/m(3) and the average geometric mean DWA was 1.53 μg/m(3). After the DWA calculations were log-transformed, 11 of the 12 had a statistically significant (p < 0.05) decrease in reported exposure over time. The constructed JEM successfully differentiated beryllium exposures across jobs and over time. This is the only quantitative JEM containing exposure estimates (average and peak) for the entire plant history.

Finding Qualitative Research Evidence for Health Technology Assessment.

PubMed

DeJean, Deirdre; Giacomini, Mita; Simeonov, Dorina; Smith, Andrea

2016-08-01

Health technology assessment (HTA) agencies increasingly use reviews of qualitative research as evidence for evaluating social, experiential, and ethical aspects of health technologies. We systematically searched three bibliographic databases (MEDLINE, CINAHL, and Social Science Citation Index [SSCI]) using published search filters or "hedges" and our hybrid filter to identify qualitative research studies pertaining to chronic obstructive pulmonary disease and early breast cancer. The search filters were compared in terms of sensitivity, specificity, and precision. Our screening by title and abstract revealed that qualitative research constituted only slightly more than 1% of all published research on each health topic. The performance of the published search filters varied greatly across topics and databases. Compared with existing search filters, our hybrid filter demonstrated a consistently high sensitivity across databases and topics, and minimized the resource-intensive process of sifting through false positives. We identify opportunities for qualitative health researchers to improve the uptake of qualitative research into evidence-informed policy making. © The Author(s) 2016.

Methodological Challenges in Cross-Language Qualitative Research: A Research Review

PubMed Central

Squires, Allison

2009-01-01

Objectives Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this critical review of cross-language qualitative research was three fold: 1) review the methods literature addressing cross language research; 2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; and 3) test these criteria on published cross-language qualitative studies. Data sources A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. Review methods The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. Results The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant’s language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. Conclusions The finding about researchers making the role of the translator or interpreter

Evaluation of an Interview Process for Admission Into a School of Pharmacy

PubMed Central

Friesner, Daniel L.

2012-01-01

Objective. To evaluate the doctor of pharmacy (PharmD) admissions interview process at North Dakota State University (NDSU). Methods. Faculty pairs interviewed candidates using a standardized grading rubric to evaluate qualitative parameters or attributes such as ethics, relevant life and work experience, emotional maturity, commitment to patient care, leadership, and understanding of the pharmacy profession. Total interview scores, individual attribute domain scores, and the consistency and reliability of the interviewers were assessed. Results. The total mean interview score for the candidate pool was 17.4 of 25 points. Mean scores for individual domains ranged from 2.3 to 3.0 on a Likert-scale of 0-4. Nine of the 11 faculty pairs showed no mean differences from their interview partner in total interview scores given. Evaluations by 8 of the 11 faculty pairs produced high interrater reliability. Conclusions. The current interview process is generally consistent and reliable; however, future improvements such as additional interviewer training and adoption of a multiple mini-interview format could be made. PMID:22438594

Implementing nurse-initiated and managed antiretroviral treatment (NIMART) in South Africa: a qualitative process evaluation of the STRETCH trial.

PubMed

Georgeu, Daniella; Colvin, Christopher J; Lewin, Simon; Fairall, Lara; Bachmann, Max O; Uebel, Kerry; Zwarenstein, Merrick; Draper, Beverly; Bateman, Eric D

2012-07-16

Task-shifting is promoted widely as a mechanism for expanding antiretroviral treatment (ART) access. However, the evidence for nurse-initiated and managed ART (NIMART) in Africa is limited, and little is known about the key barriers and enablers to implementing NIMART programmes on a large scale. The STRETCH (Streamlining Tasks and Roles to Expand Treatment and Care for HIV) programme was a complex educational and organisational intervention implemented in the Free State Province of South Africa to enable nurses providing primary HIV/AIDS care to expand their roles and include aspects of care and treatment usually provided by physicians. STRETCH used a phased implementation approach and ART treatment guidelines tailored specifically to nurses. The effects of STRETCH on pre-ART mortality, ART provision, and the quality of HIV/ART care were evaluated through a randomised controlled trial. This study was conducted alongside the trial to develop a contextualised understanding of factors affecting the implementation of the programme. This study was a qualitative process evaluation using in-depth interviews and focus group discussions with patients, health workers, health managers, and other key informants as well as observation in clinics. Research questions focused on perceptions of STRETCH, changes in health provider roles, attitudes and patient relationships, and impact of the implementation context on trial outcomes. Data were analysed collaboratively by the research team using thematic analysis. NIMART appears to be highly acceptable among nurses, patients, and physicians. Managers and nurses expressed confidence in their ability to deliver ART successfully. This confidence developed slowly and unevenly, through a phased and well-supported approach that guided nurses through training, re-prescription, and initiation. The research also shows that NIMART changes the working and referral relationships between health staff, demands significant training and support, and

Implementing nurse-initiated and managed antiretroviral treatment (NIMART) in South Africa: a qualitative process evaluation of the STRETCH trial

PubMed Central

2012-01-01

Background Task-shifting is promoted widely as a mechanism for expanding antiretroviral treatment (ART) access. However, the evidence for nurse-initiated and managed ART (NIMART) in Africa is limited, and little is known about the key barriers and enablers to implementing NIMART programmes on a large scale. The STRETCH (Streamlining Tasks and Roles to Expand Treatment and Care for HIV) programme was a complex educational and organisational intervention implemented in the Free State Province of South Africa to enable nurses providing primary HIV/AIDS care to expand their roles and include aspects of care and treatment usually provided by physicians. STRETCH used a phased implementation approach and ART treatment guidelines tailored specifically to nurses. The effects of STRETCH on pre-ART mortality, ART provision, and the quality of HIV/ART care were evaluated through a randomised controlled trial. This study was conducted alongside the trial to develop a contextualised understanding of factors affecting the implementation of the programme. Methods This study was a qualitative process evaluation using in-depth interviews and focus group discussions with patients, health workers, health managers, and other key informants as well as observation in clinics. Research questions focused on perceptions of STRETCH, changes in health provider roles, attitudes and patient relationships, and impact of the implementation context on trial outcomes. Data were analysed collaboratively by the research team using thematic analysis. Results NIMART appears to be highly acceptable among nurses, patients, and physicians. Managers and nurses expressed confidence in their ability to deliver ART successfully. This confidence developed slowly and unevenly, through a phased and well-supported approach that guided nurses through training, re-prescription, and initiation. The research also shows that NIMART changes the working and referral relationships between health staff, demands

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

Patient-focused goal planning process and outcome after spinal cord injury rehabilitation: quantitative and qualitative audit.

PubMed

Byrnes, Michelle; Beilby, Janet; Ray, Patricia; McLennan, Renee; Ker, John; Schug, Stephan

2012-12-01

To evaluate the process and outcome of a multidisciplinary inpatient goal planning rehabilitation programme on physical, social and psychological functioning for patients with spinal cord injury. Clinical audit: quantitative and qualitative analyses. Specialist spinal injury unit, Perth, Australia. Consecutive series of 100 newly injured spinal cord injury inpatients. MAIN MEASURE(S): The Needs Assessment Checklist (NAC), patient-focused goal planning questionnaire and goal planning progress form. The clinical audit of 100 spinal cord injured patients revealed that 547 goal planning meetings were held with 8531 goals stipulated in total. Seventy-five per cent of the goals set at the first goal planning meeting were achieved by the second meeting and the rate of goal achievements at subsequent goal planning meetings dropped to 56%. Based on quantitative analysis of physical, social and psychological functioning, the 100 spinal cord injury patients improved significantly from baseline to discharge. Furthermore, qualitative analysis revealed benefits consistently reported by spinal cord injury patients of the goal planning rehabilitation programme in improvements to their physical, social and psychological adjustment to injury. The findings of this clinical audit underpin the need for patient-focused goal planning rehabilitation programmes which are tailored to the individual's needs and involve a comprehensive multidisciplinary team.

Shifting Practices in Teacher Performance Evaluation: A Qualitative Examination of Administrator Change Readiness

ERIC Educational Resources Information Center

Spina, Nancy; Buckley, Phillip; Puchner, Laurel

2014-01-01

This study examines the perceptions, attitudes and beliefs of administrators and teachers in a Southwestern Illinois School District regarding the recent reforms in teacher performance evaluation. This study uses a qualitative approach and provides data from individual and focus group interviews to determine the extent to which the district is…

Using Radar Charts with Qualitative Evaluation: Techniques to Assess Change in Blended Learning

ERIC Educational Resources Information Center

Kaczynski, Dan; Wood, Leigh; Harding, Ansie

2008-01-01

When university academics implement changes in learning, such as introducing blended learning, it is conventional practice to examine and evaluate the impact of the resulting curriculum reform. Judging the worth and impact of an educational development is a complex task involving subtle differences in learning. Qualitative methods to explore these…

Protocol for the mixed-methods process and context evaluation of the TB & Tobacco randomised controlled trial in Bangladesh and Pakistan: a hybrid effectiveness–implementation study

PubMed Central

Nohavova, Iveta; Dogar, Omara; Kralikova, Eva; Pankova, Alexandra; Zvolska, Kamila; Huque, Rumana; Fatima, Razia; Noor, Maryam; Elsey, Helen; Sheikh, Aziz; Siddiqi, Kamran; Kotz, Daniel

2018-01-01

Introduction Tuberculosis (TB) remains a significant public health problem in South Asia. Tobacco use increases the risks of TB infection and TB progression. The TB& Tobacco placebo-controlled randomised trial aims to (1) assess the effectiveness of the tobacco cessation medication cytisine versus placebo when combined with behavioural support and (2) implement tobacco cessation medication and behavioural support as part of general TB care in Bangladesh and Pakistan. This paper summarises the process and context evaluation protocol embedded in the effectiveness–implementation hybrid design. Methods and analysis We are conducting a mixed-methods process and context evaluation informed by an intervention logic model that draws on the UK Medical Research Council’s Process Evaluation Guidance. Our approach includes quantitative and qualitative data collection on context, recruitment, reach, dose delivered, dose received and fidelity. Quantitative data include patient characteristics, reach of recruitment among eligible patients, routine trial data on dose delivered and dose received, and a COM-B (‘capability’, ‘opportunity’, ‘motivation’ and ‘behaviour’) questionnaire filled in by participating health workers. Qualitative data include semistructured interviews with TB health workers and patients, and with policy-makers at district and central levels in each country. Interviews will be analysed using the framework approach. The behavioural intervention delivery is audio recorded and assessed using a predefined fidelity coding index based on behavioural change technique taxonomy. Ethics and dissemination The study complies with the guidelines of the Declaration of Helsinki. Ethics approval for the study and process evaluation was granted by the University of Leeds (qualitative components), University of York (trial data and fidelity assessment), Bangladesh Medical Research Council and Bangladesh Drug Administration (trial data and qualitative

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren1–3

PubMed Central

Helitzer, Deborah L; Davis, Sally M; Gittelsohn, Joel; Going, Scott B; Murray, David M; Snyder, Patricia; Steckler, Allan B

2016-01-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used. PMID:10195608

Health systems research training enhances workplace research skills: a qualitative evaluation.

PubMed

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager perceptions of the usefulness, in the work setting, of skills taught on a health systems research education course in South Africa and to assess the extent to which the course stimulated awareness and development of health systems research in the work setting. The education course was evaluated using a qualitative approach. Respondents were selected for interview using purposive sampling. Interviews were conducted with 39 respondents, including all of the major stakeholders. The interviews lasted between 20 and 60 minutes and were conducted either face to face or over the telephone. Thematic analysis was applied to the data, and key themes were identified. The course demystified health systems research and stimulated interest in reading and applying research findings. The course also changed participants' attitudes to routine data collection and was reported to have facilitated the application of informal research or problem-solving methods to everyday work situations. However, inadequate support within the workplace was a significant obstacle to applying the skills learned. A 2-week intensive, experiential course in health systems research methods can provide a mechanism for introducing basic research skills to a wide range of learners. Qualitative evaluation is a useful approach for assessing the impacts of education courses.

Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review.

PubMed

May, Carl R; Cummings, Amanda; Girling, Melissa; Bracher, Mike; Mair, Frances S; May, Christine M; Murray, Elizabeth; Myall, Michelle; Rapley, Tim; Finch, Tracy

2018-06-07

Normalization Process Theory (NPT) identifies, characterises and explains key mechanisms that promote and inhibit the implementation, embedding and integration of new health techniques, technologies and other complex interventions. A large body of literature that employs NPT to inform feasibility studies and process evaluations of complex healthcare interventions has now emerged. The aims of this review were to review this literature; to identify and characterise the uses and limits of NPT in research on the implementation and integration of healthcare interventions; and to explore NPT's contribution to understanding the dynamics of these processes. A qualitative systematic review was conducted. We searched Web of Science, Scopus and Google Scholar for articles with empirical data in peer-reviewed journals that cited either key papers presenting and developing NPT, or the NPT Online Toolkit ( www.normalizationprocess.org ). We included in the review only articles that used NPT as the primary approach to collection, analysis or reporting of data in studies of the implementation of healthcare techniques, technologies or other interventions. A structured data extraction instrument was used, and data were analysed qualitatively. Searches revealed 3322 citations. We show that after eliminating 2337 duplicates and broken or junk URLs, 985 were screened as titles and abstracts. Of these, 101 were excluded because they did not fit the inclusion criteria for the review. This left 884 articles for full-text screening. Of these, 754 did not fit the inclusion criteria for the review. This left 130 papers presenting results from 108 identifiable studies to be included in the review. NPT appears to provide researchers and practitioners with a conceptual vocabulary for rigorous studies of implementation processes. It identifies, characterises and explains empirically identifiable mechanisms that motivate and shape implementation processes. Taken together, these mean that analyses

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

PubMed

de Korte, Elsbeth Marieke; Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-03-28

To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those

Undergraduate medical education programme renewal: a longitudinal context, input, process and product evaluation study.

PubMed

Mirzazadeh, Azim; Gandomkar, Roghayeh; Hejri, Sara Mortaz; Hassanzadeh, Gholamreza; Koochak, Hamid Emadi; Golestani, Abolfazl; Jafarian, Ali; Jalili, Mohammad; Nayeri, Fatemeh; Saleh, Narges; Shahi, Farhad; Razavi, Seyed Hasan Emami

2016-02-01

The purpose of this study was to utilize the Context, Input, Process and Product (CIPP) evaluation model as a comprehensive framework to guide initiating, planning, implementing and evaluating a revised undergraduate medical education programme. The eight-year longitudinal evaluation study consisted of four phases compatible with the four components of the CIPP model. In the first phase, we explored the strengths and weaknesses of the traditional programme as well as contextual needs, assets, and resources. For the second phase, we proposed a model for the programme considering contextual features. During the process phase, we provided formative information for revisions and adjustments. Finally, in the fourth phase, we evaluated the outcomes of the new undergraduate medical education programme in the basic sciences phase. Information was collected from different sources such as medical students, faculty members, administrators, and graduates, using various qualitative and quantitative methods including focus groups, questionnaires, and performance measures. The CIPP model has the potential to guide policy makers to systematically collect evaluation data and to manage stakeholders' reactions at each stage of the reform in order to make informed decisions. However, the model may result in evaluation burden and fail to address some unplanned evaluation questions.

Assimilation of Web-Based Urgent Stroke Evaluation: A Qualitative Study of Two Networks

PubMed Central

Mathiassen, Lars; Switzer, Jeffrey A; Adams, Robert J

2014-01-01

Background Stroke is a leading cause of death and serious, long-term disability across the world. Urgent stroke care treatment is time-sensitive and requires a stroke-trained neurologist for clinical diagnosis. Rural areas, where neurologists and stroke specialists are lacking, have a high incidence of stroke-related death and disability. By virtually connecting emergency department physicians in rural hospitals to regional medical centers for consultations, specialized Web-based stroke evaluation systems (telestroke) have helped address the challenge of urgent stroke care in underserved communities. However, many rural hospitals that have deployed telestroke have not fully assimilated this technology. Objective The objective of this study was to explore potential sources of variations in the utilization of a Web-based telestroke system for urgent stroke evaluation and propose a telestroke assimilation model to improve stroke care performance. Methods An exploratory, qualitative case study of two telestroke networks, each comprising an academic stroke center (hub) and connected rural hospitals (spokes), was conducted. Data were collected from 50 semistructured interviews with 40 stakeholders, telestroke usage logs from 32 spokes, site visits, published papers, and reports. Results The two networks used identical technology (called Remote Evaluation of Acute isCHemic stroke, REACH) and were of similar size and complexity, but showed large variations in telestroke assimilation across spokes. Several observed hub- and spoke-related characteristics can explain these variations. The hub-related characteristics included telestroke institutionalization into stroke care, resources for the telestroke program, ongoing support for stroke readiness of spokes, telestroke performance monitoring, and continuous telestroke process improvement. The spoke-related characteristics included managerial telestroke championship, stroke center certification, dedicated telestroke

Toward Eco Product Development with Qualitative and CAE Design Process - Case Study of Flame Guiding Module

NASA Astrophysics Data System (ADS)

Chen, W. L.; Chao, F. L.

2018-04-01

Sustainable products become increasingly important for company in addressing eco-performance to satisfy global environmental regulations. Case study of flame guiding module reviewed design process and concerns related to the torch design. For enhancing flame height, the torch was embedded with an airflow guidance structure. The design process and design methodologies were investigated as an eco-design case study. Combine qualitative and CAE simulation were proposed to fulfil its main and auxiliary functions including reduction of impact during use. The design guidelines help prevent mistake arrangements, CAE helps understand combustion phenomenon. The flow field simulation enables fine tune of geometric design. Functional test and measurement are carried out to confirm the product features. On Eco-performance, we choose 5 items for evaluation the status of previous and redesign module, namely function need, low impact material, few manufacturing steps, low energy consumption, and safety. The radar diagram indicates that eco-performance of redesign module is better. Life cycle assessment calculated the carbon footprint of the manufacturing and processing stage with Eco-it. By using recycled steel in the flame module, it reduces raw material stage carbon footprint significantly.

Educators' and Applicants' Views of the Postdoctoral Pediatric Dentistry Admission Process: A Qualitative Study.

PubMed

Ricker, Kevin; Mihas, Paul; Lee, Jessica Y; Guthmiller, Janet M; Roberts, Michael W; Divaris, Kimon

2015-11-01

The postdoctoral application and matching process in dental education is a high-stakes and resource-intensive process for all involved. While programs seek the most qualified candidates, applicants strive to be competitive to increase their likelihood of being accepted to a desirable program. There are limited data regarding either subjective or objective factors underlying the complex interplay between programs and applicants. This qualitative study sought to provide insight into the stakeholders' experiences and views on the matching process. Telephone and in-person interviews were conducted with ten pediatric dentistry program directors and ten recent applicants to pediatric dentistry programs in the United States in 2013-14. Participants were selected to represent the geographic (five districts of the American Academy of Pediatric Dentistry) and institutional (hospital- or university-based) diversity of pediatric dentistry programs. Interviews were recorded and transcribed verbatim. Veracity and need for more information were the themes most often articulated by both groups. The program directors most valued teachability and self-motivation as desirable applicant characteristics. The applicants relied primarily on subjective sources to gather information about programs and prioritized location and financial factors as pivotal for their rankings. Both groups appreciated the uniformity of the current application process and highlighted several weaknesses and areas for improvement. These results shed light on the postdoctoral matching process in pediatric dentistry via a qualitative description of stakeholders' experiences and viewpoints. These insights can serve as a basis for improving and refining the matching process.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

A new qualitative pattern classification of shear wave elastograghy for solid breast mass evaluation.

PubMed

Cong, Rui; Li, Jing; Guo, Song

2017-02-01

To examine the efficacy of qualitative shear wave elastography (SWE) in the classification and evaluation of solid breast masses, and to compare this method with conventional ultrasonograghy (US), quantitative SWE parameters and qualitative SWE classification proposed before. From April 2015 to March 2016, 314 consecutive females with 325 breast masses who decided to undergo core needle biopsy and/or surgical biopsy were enrolled. Conventional US and SWE were previously performed in all enrolled subjects. Each mass was classified by two different qualitative classifications. One was established in our study, herein named the Qual1. Qual1 could classify the SWE images into five color patterns by the visual evaluations: Color pattern 1 (homogeneous pattern); Color pattern 2 (comparative homogeneous pattern); Color pattern 3 (irregularly heterogeneous pattern); Color pattern 4 (intralesional echo pattern); and Color pattern 5 (the stiff rim sign pattern). The second qualitative classification was named Qual2 here, and included a four-color overlay pattern classification (Tozaki and Fukuma, Acta Radiologica, 2011). The Breast Imaging Reporting and Data System (BI-RADS) assessment and quantitative SWE parameters were recorded. Diagnostic performances of conventional US, SWE parameters, and combinations of US and SWE parameters were compared. With pathological results as the gold standard, of the 325 examined breast masses, 139 (42.77%) samples were malignant and 186 (57.23%) were benign. The Qual1 showed a higher Az value than the Qual2 and quantitative SWE parameters (all P<0.05). When applying Qual1=Color pattern 1 for downgrading and Qual1=Color pattern 5 for upgrading the BI-RADS categories, we obtained the highest Az value (0.951), and achieved a significantly higher specificity (86.56%, P=0.002) than that of the US (81.18%) with the same sensitivity (94.96%). The qualitative classification proposed in this study may be representative of SWE parameters and has

Making Visible the Coding Process: Using Qualitative Data Software in a Post-Structural Study

ERIC Educational Resources Information Center

Ryan, Mary

2009-01-01

Qualitative research methods require transparency to ensure the "trustworthiness" of the data analysis. The intricate processes of organising, coding and analysing the data are often rendered invisible in the presentation of the research findings, which requires a "leap of faith" for the reader. Computer assisted data analysis software can be used…

Partnerships for Active Children in Elementary Schools (PACES): First year process evaluation.

PubMed

Egan, Cate A; Webster, Collin; Weaver, R Glenn; Brian, Ali; Stodden, David; Russ, Laura; Nesbitt, Danielle; Vazou, Spyridoula

2018-04-01

Movement integration (MI) is a strategy within comprehensive school physical activity programs (CSPAP). School-university partnerships are recommended to leverage teachers' capacity to use MI. A mixed method process evaluation was conducted of the first year of implementing Partnerships for Active Children in Elementary Schools (PACES). Classroom teachers (N=12) from four schools participated. Data were collected in Fall 2014 (baseline) and Spring 2015 (∼ four months of intervention) using the System for Observing Student Movement in Academic Routines and Transitions and semi-structured interviews. There were no significant differences between intervention classrooms and control classrooms MI promotion. Differences approaching significance (U=5, p=0.04, d=1.2) were observed when comparing classrooms that received two (community of practice, community-based participatory research) or three components (two components plus service learning) of the intervention and classrooms that received one (community of practice) or no components. Qualitative findings revealed that teachers in classrooms that were more successful responded more favorably to the intervention components than teachers in classrooms that were less successful. Quantitative and qualitative results supported the effectiveness of community-based participatory research as a component of PACES. This study provides information about MI process variables in the context of a CSPAP intervention. Copyright © 2017 Elsevier Ltd. All rights reserved.

Motivational Interviewing and Medication Review in Coronary Heart Disease (MIMeRiC): Intervention Development and Protocol for the Process Evaluation.

PubMed

Östbring, Malin Johansson; Eriksson, Tommy; Petersson, Göran; Hellström, Lina

2018-01-30

Trials of complex interventions are often criticized for being difficult to interpret because the effects of apparently similar interventions vary across studies dependent on context, targeted groups, and the delivery of the intervention. The Motivational Interviewing and Medication Review in Coronary heart disease (MIMeRiC) trial is a randomized controlled trial (RCT) of an intervention aimed at improving pharmacological secondary prevention. Guidelines for the development and evaluation of complex interventions have recently highlighted the need for better reporting of the development of interventions, including descriptions of how the intervention is assumed to work, how this theory informed the process evaluation, and how the process evaluation relates to the outcome evaluation. This paper aims to describe how the intervention was designed and developed. The aim of the process evaluation is to better understand how and why the intervention in the MIMeRiC trial was effective or not effective. The research questions for evaluating the process are based on the conceptual model of change processes assumed in the intervention and will be analyzed by qualitative and quantitative methods. Quantitative data are used to evaluate the medication review in terms of drug-related problems, to describe how patients' beliefs about medicines are affected by the intervention, and to evaluate the quality of motivational interviewing. Qualitative data will be used to analyze whether patients experienced the intervention as intended, how cardiologists experienced the collaboration and intervention, and how the intervention affected patients' overall experience of care after coronary heart disease. The development and piloting of the intervention are described in relation to the theoretical framework. Data for the process evaluation will be collected until March 2018. Some process evaluation questions will be analyzed before, and others will be analyzed after the outcomes of the

How Qualitative Research Informs Clinical and Policy Decision Making in Transplantation: A Review.

PubMed

Tong, Allison; Morton, Rachael L; Webster, Angela C

2016-09-01

Patient-centered care is no longer just a buzzword. It is now widely touted as a cornerstone in delivering quality care across all fields of medicine. However, patient-centered strategies and interventions necessitate evidence about patients' decision-making processes, values, priorities, and needs. Qualitative research is particularly well suited to understanding the experience and perspective of patients, donors, clinicians, and policy makers on a wide range of transplantation-related topics including organ donation and allocation, adherence to prescribed therapy, pretransplant and posttransplant care, implementation of clinical guidelines, and doctor-patient communication. In transplantation, evidence derived from qualitative research has been integrated into strategies for shared decision-making, patient educational resources, process evaluations of trials, clinical guidelines, and policies. The aim of this article is to outline key concepts and methods used in qualitative research, guide the appraisal of qualitative studies, and assist clinicians to understand how qualitative research may inform their practice and policy.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

QUAGOL: a guide for qualitative data analysis.

PubMed

Dierckx de Casterlé, Bernadette; Gastmans, Chris; Bryon, Els; Denier, Yvonne

2012-03-01

Data analysis is a complex and contested part of the qualitative research process, which has received limited theoretical attention. Researchers are often in need of useful instructions or guidelines on how to analyze the mass of qualitative data, but face the lack of clear guidance for using particular analytic methods. The aim of this paper is to propose and discuss the Qualitative Analysis Guide of Leuven (QUAGOL), a guide that was developed in order to be able to truly capture the rich insights of qualitative interview data. The article describes six major problems researchers are often struggling with during the process of qualitative data analysis. Consequently, the QUAGOL is proposed as a guide to facilitate the process of analysis. Challenges emerged and lessons learned from own extensive experiences with qualitative data analysis within the Grounded Theory Approach, as well as from those of other researchers (as described in the literature), were discussed and recommendations were presented. Strengths and pitfalls of the proposed method were discussed in detail. The Qualitative Analysis Guide of Leuven (QUAGOL) offers a comprehensive method to guide the process of qualitative data analysis. The process consists of two parts, each consisting of five stages. The method is systematic but not rigid. It is characterized by iterative processes of digging deeper, constantly moving between the various stages of the process. As such, it aims to stimulate the researcher's intuition and creativity as optimal as possible. The QUAGOL guide is a theory and practice-based guide that supports and facilitates the process of analysis of qualitative interview data. Although the method can facilitate the process of analysis, it cannot guarantee automatic quality. The skills of the researcher and the quality of the research team remain the most crucial components of a successful process of analysis. Additionally, the importance of constantly moving between the various stages

Adolescents' Use of Self-Regulatory Processes and Their Relation to Qualitative Mental Model Shifts while Using Hypermedia

ERIC Educational Resources Information Center

Greene, Jeffrey Alan; Azevedo, Roger

2007-01-01

This study examined 148 adolescents' use of self-regulated learning (SRL) processes when learning about the circulatory system using hypermedia. We examined participants' verbal protocols to determine the relationship between SRL processes and qualitative shifts in students' mental models from pretest to posttest. Results indicated that…

Process evaluation of a cluster-randomised trial testing a pressure ulcer prevention care bundle: a mixed-methods study.

PubMed

Roberts, Shelley; McInnes, Elizabeth; Bucknall, Tracey; Wallis, Marianne; Banks, Merrilyn; Chaboyer, Wendy

2017-02-13

As pressure ulcers contribute to significant patient burden and increased health care costs, their prevention is a clinical priority. Our team developed and tested a complex intervention, a pressure ulcer prevention care bundle promoting patient participation in care, in a cluster-randomised trial. The UK Medical Research Council recommends process evaluation of complex interventions to provide insight into why they work or fail and how they might be improved. This study aimed to evaluate processes underpinning implementation of the intervention and explore end-users' perceptions of it, in order to give a deeper understanding of its effects. A pre-specified, mixed-methods process evaluation was conducted as an adjunct to the main trial, guided by a framework for process evaluation of cluster-randomised trials. Data was collected across eight Australian hospitals but mainly focused on the four intervention hospitals. Quantitative and qualitative data were collected across the evaluation domains: recruitment, reach, intervention delivery and response to intervention, at both cluster and individual patient level. Quantitative data were analysed using descriptive and inferential statistics. Qualitative data were analysed using thematic analysis. In the context of the main trial, which found a 42% reduction in risk of pressure ulcer with the intervention that was not significant after adjusting for clustering and covariates, this process evaluation provides important insights. Recruitment and reach among clusters and individuals was high, indicating that patients, nurses and hospitals are willing to engage with a pressure ulcer prevention care bundle. Of 799 intervention patients in the trial, 96.7% received the intervention, which took under 10 min to deliver. Patients and nurses accepted the care bundle, recognising benefits to it and describing how it enabled participation in pressure ulcer prevention (PUP) care. This process evaluation found no major failures

Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

ERIC Educational Resources Information Center

Bruhns, Arthur E.

Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

How is rehabilitation with and without an integrated self-management approach perceived by UK community-dwelling stroke survivors? A qualitative process evaluation to explore implementation and contextual variations

PubMed Central

Jones, Fiona; McKevitt, Christopher; Riazi, Afsane; Liston, Matthew

2017-01-01

Objective Self-management programmes could support long-term needs after stroke and using methods integrated into rehabilitation is one option. To explore theoretical assumptions and possible mechanisms of implementation a process evaluation was delivered alongside a cluster trial which has demonstrated feasibility of an integrated self-management programme (Bridges SMP) in community-dwelling stroke survivors. This paper aims to show the extent to which experiences from stroke survivors receiving rehabilitation in control (usual care) and intervention (integrated self-management) sites reflected the differences in rehabilitation received and whether their understandings aligned with the self-management approach employed. Design Semistructured qualitative interviews carried out as part of a process evaluation analysed thematically. Setting Study was based in South London; all interviews were carried out in participants' home setting. Participants 22 stroke participants recruited; 12 from integrated self-management sites and 10 from usual care sites. Results All participants revealed shared appreciation of knowledge and support from therapists but subtle differences emerged between sites in respect to perceptions about responsibility, control and how previous experiences were used. Accounts depicted a variance regarding who had structured and planned their rehabilitation, with greater flexibility about content and involvement perceived by participants from the integrated self-management sites. They also provided accounts and experiences which aligned with principles of the intervention, such as self-discovery and problem-solving. Conclusions The findings reflect our theoretical assumptions and possible mechanisms of implementation that rehabilitation with a focus on supporting self-management is reflected in accounts and understandings of stroke survivors. Taken together with our previous research this justifies evaluating the effectiveness of Bridges SMP in a larger

'Stories' or 'snapshots'? A study directed at comparing qualitative and quantitative approaches to curriculum evaluation.

PubMed

Pateman, B; Jinks, A M

1999-01-01

The focus of this paper is a study designed to explore the validity of quantitative approaches of student evaluation in a pre-registration degree programme. As managers of the students' education we were concerned that the quantitative method, which used lecturer criteria, may not fully represent students' views. The approach taken is that of a process-type strategy for curriculum evaluation as described by Parlett and Hamilton (1972). The aim of the study is to produce illuminative data, or students' 'stories' of their educational experiences through use of semi-structured interviews. The results are then compared to the current quantitative measurement tools designed to obtain 'snapshots' of the educational effectiveness of the curriculum. The quantitative measurement tools use Likert scale measurements of teacher-devised criterion statements. The results of the study give a rich source of qualitative data which can be used to inform future curriculum development. However, complete validation of the current quantitative instruments used was not achieved in this study. Student and teacher agendas in respect of important issues pertaining to the course programme were found to differ. Limitations of the study are given. There is discussion of the options open to the management team with regard to future development of curriculum evaluation systems.

Qualitative research in palliative care 1990-1999: a descriptive review.

PubMed

Froggatt, Katherine A; Field, David; Bailey, Chris; Krishnasamy, Meinir

2003-03-01

A collaborative, evaluative review of qualitative research in palliative care published between 1990 and 1999 has been conducted. Nearly 30,000 articles in 48 journals from specialist palliative care, oncology, death studies, medicine, nursing, gerontology, health and the social sciences were examined. From these journals, 138 articles (0.5%) reporting qualitative research with a focus on palliative care in the context of death, dying or bereavement were identified. These articles were reviewed using a proforma designed by the group. This article describes the review process, and the following findings: the distribution of different forms of qualitative research in palliative care; the location of such papers; the focus of the research; and the research methodology and methods adopted.

The relevance of qualitative research for clinical programs in psychiatry.

PubMed

Goering, Paula; Boydell, Katherine M; Pignatiello, Antonio

2008-03-01

It is time to move beyond education about qualitative research theory and methods to using them to understand and improve psychiatric practice. There is a good fit between this agenda and current thinking about research use that broadens definitions of evidence beyond the results of experiments. This paper describes a qualitative program evaluation to illustrate what kind of useful knowledge is generated and how it can be created through a clinician-researcher partnership. The linkage and exchange model of effective knowledge translation described involves interaction between clinicians and researchers throughout the research process and results in mutual learning through the planning, disseminating, and application of existing or new qualitative research in decision making.

The role of economic evaluation in the decision-making process of family physicians: design and methods of a qualitative embedded multiple-case study

PubMed Central

Lessard, Chantale; Contandriopoulos, André-Pierre; Beaulieu, Marie-Dominique

2009-01-01

Background A considerable amount of resource allocation decisions take place daily at the point of the clinical encounter; especially in primary care, where 80 percent of health problems are managed. Ignoring economic evaluation evidence in individual clinical decision-making may have a broad impact on the efficiency of health services. To date, almost all studies on the use of economic evaluation in decision-making used a quantitative approach, and few investigated decision-making at the clinical level. An important question is whether economic evaluations affect clinical practice. The project is an intervention research study designed to understand the role of economic evaluation in the decision-making process of family physicians (FPs). The contributions of the project will be from the perspective of Pierre Bourdieu's sociological theory. Methods/design A qualitative research strategy is proposed. We will conduct an embedded multiple-case study design. Ten case studies will be performed. The FPs will be the unit of analysis. The sampling strategies will be directed towards theoretical generalization. The 10 selected cases will be intended to reflect a diversity of FPs. There will be two embedded units of analysis: FPs (micro-level of analysis) and field of family medicine (macro-level of analysis). The division of the determinants of practice/behaviour into two groups, corresponding to the macro-structural level and the micro-individual level, is the basis for Bourdieu's mode of analysis. The sources of data collection for the micro-level analysis will be 10 life history interviews with FPs, documents and observational evidence. The sources of data collection for the macro-level analysis will be documents and 9 open-ended, focused interviews with key informants from medical associations and academic institutions. The analytic induction approach to data analysis will be used. A list of codes will be generated based on both the original framework and new themes

Children's food choice process in the home environment. A qualitative descriptive study.

PubMed

Holsten, Joanna E; Deatrick, Janet A; Kumanyika, Shiriki; Pinto-Martin, Jennifer; Compher, Charlene W

2012-02-01

This qualitative descriptive study explored children's food choices in the home with particular attention to environmental influences. Semi-structured interviews were conducted with 11- to 14-year-old children (n=47) from one middle school. A data-driven content analysis using selected principles of grounded theory was performed. Children's food choices in the home emerged as a process that involved three interacting components, the child, the parent, and the food, embedded within the context of time. Children's structured activities throughout the day, week, and year provided an overall context for food choices. Parents affected children's food choices through their presence in the home, time pressure and activity prioritization, incorporation of family members' preferences, food preparation effort and skills, and financial and health concerns. Parents created food options through food purchasing and preparation and indirectly affected children's food choices by setting rules, providing information, and modeling behaviors. Children affected parents' decisions by communicating food preferences. For children, important aspects of the food itself included its availability at home and attributes related to taste, preparation, and cost. Children evaluated potential food options based on their hunger level, food preferences, time pressure and activity prioritization, food preparation effort and skills, and expected physical consequences of food. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of shear wave elastography for differential diagnosis of breast lesions: A new qualitative analysis versus conventional quantitative analysis.

PubMed

Ren, Wei-Wei; Li, Xiao-Long; Wang, Dan; Liu, Bo-Ji; Zhao, Chong-Ke; Xu, Hui-Xiong

2018-04-13

To evaluate a special kind of ultrasound (US) shear wave elastography for differential diagnosis of breast lesions, using a new qualitative analysis (i.e. the elasticity score in the travel time map) compared with conventional quantitative analysis. From June 2014 to July 2015, 266 pathologically proven breast lesions were enrolled in this study. The maximum, mean, median, minimum, and standard deviation of shear wave speed (SWS) values (m/s) were assessed. The elasticity score, a new qualitative feature, was evaluated in the travel time map. The area under the receiver operating characteristic (AUROC) curves were plotted to evaluate the diagnostic performance of both qualitative and quantitative analyses for differentiation of breast lesions. Among all quantitative parameters, SWS-max showed the highest AUROC (0.805; 95% CI: 0.752, 0.851) compared with SWS-mean (0.786; 95% CI:0.732, 0.834; P = 0.094), SWS-median (0.775; 95% CI:0.720, 0.824; P = 0.046), SWS-min (0.675; 95% CI:0.615, 0.731; P = 0.000), and SWS-SD (0.768; 95% CI:0.712, 0.817; P = 0.074). The AUROC of qualitative analysis in this study obtained the best diagnostic performance (0.871; 95% CI: 0.825, 0.909, compared with the best parameter of SWS-max in quantitative analysis, P = 0.011). The new qualitative analysis of shear wave travel time showed the superior diagnostic performance in the differentiation of breast lesions in comparison with conventional quantitative analysis.

The Career Transition Process: A Qualitative Exploration of Korean Middle-Aged Workers in Postretirement Employment

ERIC Educational Resources Information Center

Kim, Seon-Joo

2014-01-01

Today's society, shaped by demographic changes and a global economy, has created different employment trends and work lives that result in adults' engaging in postretirement second careers. This phenomenon is a common occurrence in rapidly aging societies like Korea. This qualitative study examined the postretirement career transition process of…

Implementation of a Multidisciplinary Guideline for Low Back Pain: Process-Evaluation Among Health Care Professionals.

PubMed

Suman, Arnela; Schaafsma, Frederieke G; Buchbinder, Rachelle; van Tulder, Maurits W; Anema, Johannes R

2017-09-01

Background To reduce the burden of low back pain (LBP) in the Netherlands, a multidisciplinary guideline for LBP has been implemented in Dutch primary care using a multifaceted implementation strategy targeted at health care professionals (HCPs) and patients. The current paper describes the process evaluation of the implementation among HCPs. Methods The strategy aimed to improve multidisciplinary collaboration and communication, and consisted of 7 components. This process evaluation was performed using the Linnan and Steckler framework. Data were collected using a mixed methods approach of quantitative and qualitative data. Results 128 HCPs participated in the implementation study, of which 96 participated in quantitative and 21 participated in qualitative evaluation. Overall dose delivered for this study was 89 %, and the participants were satisfied with the strategy, mostly with the multidisciplinary approach, which contributed to the mutual understanding of each other's disciplines and perspectives. While the training sessions did not yield any new information, the strategy created awareness of the guideline and its recommendations, contributing to positively changing attitudes and aiding in improving guideline adherent behaviour. However, many barriers to implementation still exist, including personal and practical factors, confidence, dependence and distrust issues among the HCPs, as well as policy factors (e.g. reimbursement systems). Conclusions The data presented in this paper have shown that the strategy that was used to implement the guideline in a Dutch primary care setting was feasible, especially when using a multidisciplinary approach. However, identified barriers for implementation have been identified and should be addressed in future implementation.

Qualitative and quantitative evaluation of some vocal function parameters following fitting of a prosthesis.

PubMed

Cavalot, A L; Palonta, F; Preti, G; Nazionale, G; Ricci, E; Vione, N; Albera, R; Cortesina, G

2001-12-01

The insertion of a prosthesis and restoration with pectoralis major myocutaneous flaps for patients subjected to total pharyngolaryngectomy is a technique now universally accepted; however the literature on the subject is lacking. Our study considers 10 patients subjected to total pharyngolaryngectomy and restoration with pectoralis major myocutaneous flaps who were fitted with vocal function prostheses and a control group of 50 subjects treated with a total laryngectomy without pectoralis major myocutaneous flaps and who were fitted with vocal function prostheses. Specific qualitative and quantitative parameters were compared. The quantitative measurement of the levels of voice intensity and the evaluation of the harmonics-to-noise ratio were not statistically significant (p > 0.05) between the two study groups at either high- or low-volume speech. On the contrary, statistically significant differences were found (p < 0.05) for the basic frequency of both the low and the high volume voice. For the qualitative analysis seven parameters were established for evaluation by trained and untrained listeners: on the basis of these parameters the control group had statistically better voices.

A Qualitative Study of Latino Lesbian and Gay Youths' Experiences with Discrimination and the Career Development Process

ERIC Educational Resources Information Center

Adams, Eve M.; Cahill, Betsy J.; Ackerlind, Stacy J.

2005-01-01

Eight Latino lesbian and gay (LG) youth were interviewed for this descriptive qualitative study. The purpose of this study was to examine the Latino LG youth career development process and to increase our understanding of how multiple identities intersect with each other and the career development process. Six themes emerged: knowing you are…

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed

Devers, K J

1999-12-01

To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. Existing literature in the social sciences and health services research, particularly in primary care and medicine. Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results.

Qualitative Evaluation of a Role Play Bullying Simulation.

PubMed

Gillespie, Gordon L; Brown, Kathryn; Grubb, Paula; Shay, Amy; Montoya, Karen

Bullying against nurses is becoming a pervasive problem. In this article, a role play simulation designed for undergraduate nursing students is described. In addition, the evaluation findings from a subsample of students who participated in a role play simulation addressing bullying behaviors are reported. Focus group sessions were completed with a subset of eight students who participated in the intervention. Sessions were audiorecorded, transcribed verbatim, and analyzed using Colaizzi's procedural steps for qualitative analysis. Themes derived from the data were "The Experience of Being Bullied", "Implementation of the Program", "Desired Outcome of the Program", and "Context of Bullying in the Nursing Profession". Role play simulation was an effective and active learning strategy to diffuse education on bullying in nursing practice. Bullying in nursing was identified as a problem worthy of incorporation into the undergraduate nursing curriculum. To further enhance the learning experience with role play simulation, adequate briefing instructions, opportunity to opt out of the role play, and comprehensive debriefing are essential.

[Qualitative research methodology in health care].

PubMed

Bedregal, Paula; Besoain, Carolina; Reinoso, Alejandro; Zubarew, Tamara

2017-03-01

Health care research requires different methodological approaches such as qualitative and quantitative analyzes to understand the phenomena under study. Qualitative research is usually the least considered. Central elements of the qualitative method are that the object of study is constituted by perceptions, emotions and beliefs, non-random sampling by purpose, circular process of knowledge construction, and methodological rigor throughout the research process, from quality design to the consistency of results. The objective of this work is to contribute to the methodological knowledge about qualitative research in health services, based on the implementation of the study, “The transition process from pediatric to adult services: perspectives from adolescents with chronic diseases, caregivers and health professionals”. The information gathered through the qualitative methodology facilitated the understanding of critical points, barriers and facilitators of the transition process of adolescents with chronic diseases, considering the perspective of users and the health team. This study allowed the design of a transition services model from pediatric to adult health services based on the needs of adolescents with chronic diseases, their caregivers and the health team.

Evaluating a Dutch cardiology primary care plus intervention on the Triple Aim outcomes: study design of a practice-based quantitative and qualitative research.

PubMed

Quanjel, Tessa C C; Spreeuwenberg, Marieke D; Struijs, Jeroen N; Baan, Caroline A; Ruwaard, Dirk

2017-09-06

In an attempt to deal with the pressures on the health-care system and to guarantee sustainability, changes are needed. This study focuses on a cardiology primary care plus intervention. Primary care plus (PC+) is a new health-care delivery model focused on substitution of specialist care in the hospital setting with specialist care in the primary care setting. The intervention consists of a cardiology PC+ centre in which cardiologists, supported by other health-care professionals, provide consultations in a primary care setting. The PC+ centre aims to improve the health of the population and quality of care as experienced by patients, and reduce the number of referrals to hospital-based outpatient specialist care in order to reduce health-care costs. These aims reflect the Triple Aim principle. Hence, the objectives of the study are to evaluate the cardiology PC+ centre in terms of the Triple Aim outcomes and to evaluate the process of the introduction of PC+. The study is a practice-based, quantitative study with a longitudinal observational design, and an additional qualitative study to supplement, interpret and improve the quantitative study. The study population of the quantitative part will consist of adult patients (≥18 years) with non-acute and low-complexity cardiology-related health complaints, who will be referred to the cardiology PC+ centre (intervention group) or hospital-based outpatient cardiology care (control group). All eligible patients will be asked to complete questionnaires at three different time points consisting of questions about their demographics, health status and experience of care. Additionally, quantitative data will be collected about health-care utilization and related health-care costs at the PC+ centre and the hospital. The qualitative part, consisting of semi-structured interviews, focus groups, and observations, is designed to evaluate the process as well as to amplify, clarify and explain quantitative results. This study

Systematic Evaluation and Uncertainty Analysis of the Refuse-Derived Fuel Process in Taiwan.

PubMed

Chang, Ying-Hsi; Chang, Ni-Bin; Chen, W C

1998-06-01

In the last few years, Taiwan has set a bold agenda in solid waste recycling and incineration programs. Not only were the recycling activities and incineration projects promoted by government agencies, but the related laws and regulations were continuously promulgated by the Legislative Yen. The solid waste presorting process that is to be considered prior to the existing incineration facilities has received wide attention. This paper illustrates a thorough evaluation for the first refuse-derived fuel pilot process from both quantitative and qualitative aspects. The process is to be installed and integrated with a large-scale municipal incinerator. This pilot process, developed by an engineering firm in Tainan County, consists of standard unit operations of shredding, magnetic separation, trommel screening, and air classification. A series of sampling and analyses were initialized in order to characterize its potentials in the solid waste management system. The probabilistic modeling for various types o f waste pro perties derived in this analysis may provide a basic understanding of system reliability.

'Potentially inappropriate or specifically appropriate?' Qualitative evaluation of general practitioners views on prescribing, polypharmacy and potentially inappropriate prescribing in older people.

PubMed

Clyne, Barbara; Cooper, Janine A; Hughes, Carmel M; Fahey, Tom; Smith, Susan M

2016-08-11

Potentially inappropriate prescribing (PIP) is common in older people in primary care, as evidenced by a significant body of quantitative research. However, relatively few qualitative studies have investigated the phenomenon of PIP and its underlying processes from the perspective of general practitioners (GPs). The aim of this paper is to explore qualitatively, GP perspectives regarding prescribing and PIP in older primary care patients. Semi-structured qualitative interviews were conducted with GPs participating in a randomised controlled trial (RCT) of an intervention to decrease PIP in older patients (≥70 years) in Ireland. Interviews were conducted with GP participants (both intervention and control) from the OPTI-SCRIPT cluster RCT as part of the trial process evaluation between January and July 2013. Interviews were conducted by one interviewer and audio recorded. Interviews were transcribed verbatim and a thematic analysis was conducted. Seventeen semi-structured interviews were conducted (13 male; 4 female). Three main, inter-related themes emerged (complex prescribing environment, paternalistic doctor-patient relationship, and relevance of PIP concept). Patient complexity (e.g. polypharmacy, multimorbidity), as well as prescriber complexity (e.g. multiple prescribers, poor communication, restricted autonomy) were all identified as factors contributing to a complex prescribing environment where PIP could occur, as was a paternalistic-doctor patient relationship. The concept of PIP was perceived to be of variable usefulness to GPs and the criteria to measure it may be at odds with the complex processes of prescribing for this patient population. Several inter-related factors contributing to the occurrence of PIP were identified, some of which may be amenable to intervention. Improvement strategies focused on improved management of polypharmacy and multimorbidity, and communication across primary and secondary care could result in substantial improvements

Patients' perceptions of joint teleconsultations: a qualitative evaluation.

PubMed

Harrison, Robert; Macfarlane, Anne; Murray, Elizabeth; Wallace, Paul

2006-03-01

To determine patient perceptions of joint teleconsultations (JTC), with particular reference to reasons underlying, and factors contributing to, patient satisfaction and dissatisfaction with this mode of health delivery. Telemedicine has been welcomed as one way of improving health-care delivery, by improving patient access to secondary care and specialist services hence widening patient choice, particularly for patients outside major conurbations. However, a recent systematic review found currently available data on patient satisfaction with telemedicine to be methodologically flawed. Qualitative evaluations offer the opportunity to elucidate the details of patient satisfaction with this mode of health-care delivery. Qualitative study using semi-structured interviews. Purposive sample of 28 participants of a major randomized controlled trial (Virtual Outreach study) of JTC conducted in one urban and one rural area in Britain. Joint teleconferenced consultations with the patient, patient's general practitioner (GP), and a hospital specialist. The patient and GP were sited in the local practice, while the hospital specialist was in the hospital outpatient department, and the two parties were connected by an ISDN2 link and video-conferencing software. Patient experiences of JTC, with particular reference to reasons underlying, and factors contributing to, overall satisfaction or dissatisfaction. Two major themes were identified: customer care and doctor-patient interaction. Patients appreciated the customer care aspects of JTC, particularly the enhanced convenience, reduced costs and improved punctuality associated with JTC. However, there were divergent views about the doctor-patient interactions with some patients expressing a sense of alienation arising from the use of technology, and problems with doctor-patient communication. These data add significantly to the existing literature on patient satisfaction with telemedicine, by elucidating the factors underlying

Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

PubMed

Cypress, Brigitte S

Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.

Nurses' decision-making process in cases of physical restraint in acute elderly care: a qualitative study.

PubMed

Goethals, S; Dierckx de Casterlé, B; Gastmans, C

2013-05-01

The increasing vulnerability of patients in acute elderly care requires constant critical reflection in ethically charged situations such as when employing physical restraint. Qualitative evidence concerning nurses' decision making in cases of physical restraint is limited and fragmented. A thorough understanding of nurses' decision-making process could be useful to understand how nurses reason and make decisions in ethically laden situations. The aims of this study were to explore and describe nurses' decision-making process in cases of physical restraint. We used a qualitative interview design inspired by the Grounded Theory approach. Data analysis was guided by the Qualitative Analysis Guide of Leuven. Twelve hospitals geographically spread throughout the five provinces of Flanders, Belgium. Twenty-one acute geriatric nurses interviewed between October 2009 and April 2011 were purposively and theoretically selected, with the aim of including nurses having a variety of characteristics and experiences concerning decisions on using physical restraint. In cases of physical restraint in acute elderly care, nurses' decision making was never experienced as a fixed decision but rather as a series of decisions. Decision making was mostly reasoned upon and based on rational arguments; however, decisions were also made routinely and intuitively. Some nurses felt very certain about their decisions, while others experienced feelings of uncertainty regarding their decisions. Nurses' decision making is an independent process that requires nurses to obtain a good picture of the patient, to be constantly observant, and to assess and reassess the patient's situation. Coming to thoughtful and individualized decisions requires major commitment and constant critical reflection. Copyright © 2012 Elsevier Ltd. All rights reserved.

Interpersonal processes and self-injury: a qualitative study using Bricolage.

PubMed

Rayner, G; Warne, T

2016-02-01

Literature on self-injury has recognized the impact on the relationship between clients and staff. There is an absence of a detailed account of interpersonal processes surrounding self-injury. A Bricolage qualitative research approach was carried out in the United Kingdom that explored the interpersonal processes surrounding self-injury. Three pairs of clients and staff were interviewed about an incident of self-injury. The interviews were thematically analysed and then synthesized producing a deeper exploration of the relationship between the client and staff. An interpersonal trigger followed by anger and shame, resulted in self-injury to 'numb' these experiences. Self-injury is conceptualized as a safety behaviour to avoid shame and anger and then as a maintenance cycle that traps the client in a reinforcing and rejecting relationship. Staff interviewed were able to reflect with the clients and help them reframe these experiences. Mental Health Nurses can work with clients to understand their own interpersonal cycles of self-injury. They can then reflect on their own roles in this process and avoid reinforcing the clients' negative beliefs. WHAT THE STUDY ADDS TO INTERNATIONAL EVIDENCE: This is the first international paper to explore the interconnection between the client and a professional helper in their lived experiences of self-injury. © 2015 John Wiley & Sons Ltd.

Factors that affect implementation of a nurse staffing directive: results from a qualitative multi-case evaluation.

PubMed

Robinson, Claire H; Annis, Ann M; Forman, Jane; Krein, Sarah L; Yankey, Nicholas; Duffy, Sonia A; Taylor, Beth; Sales, Anne E

2016-08-01

To assess implementation of the Veterans Health Administration staffing methodology directive. In 2010 the Veterans Health Administration promulgated a staffing methodology directive for inpatient nursing units to address staffing and budget forecasting. A qualitative multi-case evaluation approach assessed staffing methodology implementation. Semi-structured telephone interviews were conducted from March - June 2014 with Nurse Executives and their teams at 21 facilities. Interviews focused on the budgeting process, implementation experiences, use of data, leadership support, and training. An implementation score was created for each facility using a 4-point rating scale. The scores were used to select three facilities (low, medium and high implementation) for more detailed case studies. After analysing interview summaries, the evaluation team developed a four domain scoring structure: (1) integration of staffing methodology into budget development; (2) implementation of the Directive elements; (3) engagement of leadership and staff; and (4) use of data to support the staffing methodology process. The high implementation facility had leadership understanding and endorsement of staffing methodology, confidence in and ability to work with data, and integration of staffing methodology results into the budgeting process. The low implementation facility reported poor leadership engagement and little understanding of data sources and interpretation. Implementation varies widely across facilities. Implementing staffing methodology in facilities with complex and changing staffing needs requires substantial commitment at all organizational levels especially for facilities that have traditionally relied on historical levels to budget for staffing. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

Priority-setting and hospital strategic planning: a qualitative case study.

PubMed

Martin, Douglas; Shulman, Ken; Santiago-Sorrell, Patricia; Singer, Peter

2003-10-01

To describe and evaluate the priority-setting element of a hospital's strategic planning process. Qualitative case study and evaluation against the conditions of 'accountability for reasonableness' of a strategic planning process at a large urban university-affiliated hospital. The hospital's strategic planning process met the conditions of 'accountability for reasonableness' in large part. Specifically: the hospital based its decisions on reasons (both information and criteria) that the participants felt were relevant to the hospital; the number and type of participants were very extensive; the process, decisions and reasons were well communicated throughout the organization, using multiple communication vehicles; and the process included an ethical framework linked to an effort to evaluate and improve the process. However, there were opportunities to improve the process, particularly by giving participants more time to absorb the information relevant to priority-setting decisions, more time to take difficult decisions and some means to appeal or revise decisions. A case study linked to an evaluation using 'accountability for reasonableness' can serve to improve priority-setting in the context of hospital strategic planning.

An Analysis of Frame Semantics of Continuous Processes

DTIC Science & Technology

2016-08-10

in natural text involving a variety of continuous processes. Keywords: Frame Semantics; Qualitative Reasoning Introduction & Background Daily...We evaluate our mapping on science texts , but expect our approach to be domain general. Qualitative Process Theory In QP theory, changes within a...fragments from text could reason about real-world scenarios, predicting, for example, that our tub of water may overflow. However, the incremental

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed Central

Devers, K J

1999-01-01

OBJECTIVE: To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. DATA SOURCES: Existing literature in the social sciences and health services research, particularly in primary care and medicine. PRINCIPAL FINDING: Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. CONCLUSION: The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results. Images Figure 1 PMID:10591278

Process of Argumentation in High School Biology Class: A Qualitative Analysis

NASA Astrophysics Data System (ADS)

Ramli, M.; Rakhmawati, E.; Hendarto, P.; Winarni

2017-02-01

Argumentation skill can be nurtured by designing a lesson in which students are provided with the opportunity to argue. This research aims to analyse argumentation process in biology class. The participants were students of three biology classes from different high schools in Surakarta Indonesia. One of the classroom was taught by a student teacher, and the rest were instructed by the assigned teachers. Through a classroom observation, oral activities were noted, audio-recorded and video-taped. Coding was done based on the existence of claiming-reasoning-evidence (CRE) process by McNeill and Krajcik. Data was analysed qualitatively focusing on the role of teachers to initiate questioning to support argumentation process. The lesson design of three were also analysed. The result shows that pedagogical skill of teachers to support argumentation process, such as skill to ask, answer, and respond to students’ question and statements need to be trained intensively. Most of the argumentation found were only claiming, without reasoning and evidence. Teachers have to change the routine of mostly posing open-ended questions to students, and giving directly a correct answer to students’ questions. Knowledge and skills to encourage student to follow inquiry-based learning have to be acquired by teachers.

Autonomy through identification: a qualitative study of the process of identification used by people with type 2 diabetes.

PubMed

Moser, Albine; van der Bruggen, Harry; Spreeuwenberg, Cor; Widdershoven, Guy

2008-04-01

The aim of this study is to clarify the process of identification with diabetes as a dimension of autonomy as described by people with type 2 diabetes. People with type 2 diabetes view autonomy as competency in shaping one's life. This concept of autonomy has seven dimensions, which emerged as categories in prior research. Dynamic processes shape these dimensions of autonomy. One of the dimensions of autonomy is identification. This study has a qualitative descriptive and exploratory design and an inductive approach as described in grounded theory. Data were collected by means of in-depth interviews. The sample consisted of 15 people with type 2 diabetes mellitus in a nurse-led, shared-care setting in the Netherlands. The phases of identification are comprehending, struggling, evaluating and mastering. Each phase has its own characteristics. Identifying with the diabetes is a non-linear, cyclical and continuous process because people with diabetes have to deal with changing conditions. The dynamics of identification is directed to a process of identifying with diabetes and its care requirement. Recognizing identification as an element of autonomy enables nurses to adopt a more patient-oriented view of autonomy. Nursing that fosters the process of identification promotes autonomy. This implies that a person with diabetes should be able to identify with the nurse's interventions. Hence it is vital that nurses build supportive partnerships when providing care for such a patient.

Functional evaluations in the monitoring of the river ecosystem processes: the Adige River as a case stu.

PubMed

Braioni, M G; Salmoiraghi, G; Bracco, F; Villani, M; Braioni, A; Girelli, L

2002-03-12

A model of analysis and environmental evaluation was applied to 11 stretches of the Adige River, where an innovative procedure was carried out to interpret ecological results. Within each stretch, the most suitable methods were used to assess the quality and processes of flood plains, banks, water column, bed, and interstitial environment. Indices were applied to evaluate the wild state and ecological quality of the banks (wild state index, buffer strip index) and the landscape quality of wide areas of the fluvial corridor (environmental landscape index). The biotic components (i.e., macrozoobenthos, phytoplankton and zooplankton, interstitial hyporheic fauna, vegetation in the riparian areas) were analysed by both quantitative and functional methods (as productivity, litter--processing and colonisation). The results achieved were then translated into five classes of functional evaluation. These qualitative assessments have thus preserved a high level of precision and sensitivity in quantifying both the quality of the environmental conditions and the integrity of the ecosystem processes. Read together with urban planning data, they indicate what actions are needed to restore and rehabilitate the Adige River corridor.

Women’s perspectives of the fetal fibronectin testing process: a qualitative descriptive study

PubMed Central

2014-01-01

Background In 2009 the Ontario Ministry of Health and Long Term Care funded the implementation of province-wide fetal fibronectin testing in Ontario hospitals. This paper reports results from the provincial evaluation that sought to describe the experience of fetal fibronectin testing from the perspective of women with symptoms of preterm labour. Methods A descriptive qualitative design was used, employing semi-structured telephone and face-to-face interviews with women who had fetal fibronectin testing. Results Five hospitals participated in recruiting women for the study and 17 women were interviewed. Women described their experiences of fetal fibronectin testing as an emotional process that moves from expecting, to feeling, to hoping for reassurance; and then to re-defining what is required to feel reassured. Women described feeling anxious while waiting for fetal fibronectin results. When test results were negative, women described feeling a sense of relief that their symptoms would not likely lead to an imminent preterm birth. Women with positive results expressed feeling reassured by the care decisions and quick action taken by the health care team. Conclusion Fetal fibronectin testing was acceptable and beneficial to these women with symptoms of preterm labour. Implications for practice and future research are suggested. PMID:24894630

Qualitative research in rehabilitation science: opportunities, challenges, and future directions.

PubMed

VanderKaay, Sandra; Moll, Sandra E; Gewurtz, Rebecca E; Jindal, Pranay; Loyola-Sanchez, Adalberto; Packham, Tara L; Lim, Chun Y

2018-03-01

patients that are utilizing these services. Changes over time in how qualitative research is conceptualized, conducted, and utilized to advance rehabilitation science have resulted in a number of unique opportunities and challenges in using qualitative research that must be considered within this field. Advances in methodology and increased expectations for evaluation must be considered to ensure quality and credibility of qualitative rehabilitation research within rehabilitation. Improved quality and credibility may increase likelihood of research dissemination and use by clinicians intervening within the rehabilitation process in order to improve clinical practice. In order to maximize opportunities and mitigate challenges there are two principal future directions for rehabilitation scientists to consider: (1) advancing training in qualitative methods to adequately prepare future rehabilitation scientists and (2) engaging qualitative communities of research.

Qualitative Evaluation of a Role Play Bullying Simulation

PubMed Central

Gillespie, Gordon L.; Brown, Kathryn; Grubb, Paula; Shay, Amy; Montoya, Karen

2015-01-01

Bullying against nurses is becoming a pervasive problem. In this article, a role play simulation designed for undergraduate nursing students is described. In addition, the evaluation findings from a subsample of students who participated in a role play simulation addressing bullying behaviors are reported. Focus group sessions were completed with a subset of eight students who participated in the intervention. Sessions were audiorecorded, transcribed verbatim, and analyzed using Colaizzi’s procedural steps for qualitative analysis. Themes derived from the data were “The Experience of Being Bullied”, “Implementation of the Program”, “Desired Outcome of the Program”, and “Context of Bullying in the Nursing Profession”. Role play simulation was an effective and active learning strategy to diffuse education on bullying in nursing practice. Bullying in nursing was identified as a problem worthy of incorporation into the undergraduate nursing curriculum. To further enhance the learning experience with role play simulation, adequate briefing instructions, opportunity to opt out of the role play, and comprehensive debriefing are essential. PMID:26504502

A Qualitative Evaluation of the Use of Multimedia Case Studies in an Introductory Engineering Course at Two Southeastern Universities

ERIC Educational Resources Information Center

Huett, Kim C.; Kawulich, Barbara

2015-01-01

Collaborating at two universities to improve teaching and learning in undergraduate engineering, an interdisciplinary team of researchers, instructors, and evaluators planned and implemented the use of multimedia case studies with students enrolled in an introductory engineering course. This qualitative action evaluation study focuses on results…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

Process and impact evaluation of the Greater Christchurch Urban Development Strategy Health Impact Assessment

PubMed Central

Mathias, Kaaren R; Harris-Roxas, Ben

2009-01-01

Background despite health impact assessment (HIA) being increasingly widely used internationally, fundamental questions about its impact on decision-making, implementation and practices remain. In 2005 a collaboration between public health and local government authorities performed an HIA on the Christchurch Urban Development Strategy Options paper in New Zealand. The findings of this were incorporated into the Greater Christchurch Urban Development Strategy; Methods using multiple qualitative methodologies including key informant interviews, focus groups and questionnaires, this study performs process and impact evaluations of the Christchurch HIA including evaluation of costs and resource use; Results the evaluation found that the HIA had demonstrable direct impacts on planning and implementation of the final Urban Development Strategy as well as indirect impacts on understandings and ways of working within and between organisations. It also points out future directions and ways of working in this successful collaboration between public health and local government authorities. It summarises the modest resource use and discusses the important role HIA can play in urban planning with intersectoral collaboration and enhanced relationships as both catalysts and outcomes of the HIA process; Conclusion as one of the few evaluations of HIA that have been published to date, this paper makes a substantial contribution to the literature on the impact, utility and effectiveness of HIA. PMID:19344529

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

A qualitative evaluation of strategies to increase colorectal cancer screening uptake

PubMed Central

Tinmouth, Jill; Ritvo, Paul; McGregor, S. Elizabeth; Claus, Danielle; Pasut, George; Myers, Ronald E.; Guglietti, Crissa; Paszat, Lawrence F.; Hilsden, Robert J.; Rabeneck, Linda

2011-01-01

Abstract Objective To obtain data that could be used to optimize the content and design of the targeted, mailed invitations that Ontario’s provincewide colorectal cancer (CRC) screening program plans to use to increase screening uptake; to identify other strategies to increase CRC screening uptake; and to describe the effects of this qualitative work on a subsequent quantitative pilot study. Design Qualitative study using semistructured focus groups. Setting Four different Ontario communities. Participants Six focus groups comprising a total of 62 participants. Methods Six focus groups were conducted in 4 different Ontario communities. For 3 of the communities, participants were recruited from the general population by a private marketing firm, using random-digit dialing, and received a small honorarium for participating. In Sault Ste Marie, participants were convenience samples recruited from a large primary care practice and were not offered compensation. Responses were elicited regarding various strategies for promoting CRC screening. Findings represent all responses observed as well as recommendations to program planners based on focus groups observations. Main findings Key themes identified included the importance of receiving a CRC screening invitation from one’s family physician; a desire for personalized, brief communications; and a preference for succinct information in mailed materials. Strong support was indicated for direct mailing of the CRC screening kit (fecal occult blood test). Our findings substantially influenced the final design and content of the envelope and letter to be mailed in the subsequent quantitative pilot study. Conclusion We report strong support from our focus groups for a succinct, personalized invitation for CRC screening from one’s own family physician. We have also shown that qualitative evaluation can be used to provide decision makers with pertinent and timely knowledge. Our study is highly relevant to other public

Multi-indicator Evaluation System for Broadsword, Rod, Sword and Spear Athletes Based on Analytic Hierarchy Process

NASA Astrophysics Data System (ADS)

Luo, Lin

2017-08-01

In the practical selection of Wushu athletes, the objective evaluation of the level of athletes lacks sufficient technical indicators and often relies on the coach’s subjective judgments. It is difficult to accurately and objectively reflect the overall quality of the athletes without a fully quantified indicator system, thus affecting the level improvement of Wushu competition. The analytic hierarchy process (AHP) is a systemic analysis method combining quantitative and qualitative analysis. This paper realizes structured, hierarchized and quantified decision-making process of evaluating broadsword, rod, sword and spear athletes in the AHP. Combing characteristics of the athletes, analysis is carried out from three aspects, i.e., the athlete’s body shape, physical function and sports quality and 18 specific evaluation indicators established, and then combining expert advice and practical experience, pairwise comparison matrix is determined, and then the weight of the indicators and comprehensive evaluation coefficient are obtained to establish the evaluation model for the athletes, thus providing a scientific theoretical basis for the selection of Wushu athletes. The evaluation model proposed in this paper has realized the evaluation system of broadsword, rod, sword and spear athletes, which has effectively improved the scientific level of Wushu athletes selection in practical application.

Evaluating Continuing Nursing Education: A Qualitative Study of Intention to Change Practice and Perceived Barriers to Knowledge Translation.

PubMed

Wellings, Cynthea A; Gendek, Marilyn A; Gallagher, Silvia E

Evaluating the effectiveness of continuing nursing education does not always include behavioral change and patient health outcomes. A qualitative analysis of open-ended evaluation questions from continuing nursing education activities was conducted. The aim was to evaluate learners' intentions to change their practice resulting from their learning and their perceived barriers to implementing practice changes. Results revealed the multiple, interconnected challenges involved in translating new learning into practice.

A General Survey of Qualitative Research Methodology.

ERIC Educational Resources Information Center

Cary, Rick

Current definitions and philosophical foundations of qualitative research are presented; and designs, evaluation methods, and issues in application of qualitative research to education are discussed. The effects of positivism and the post-positivist era on qualitative research are outlined, and naturalist and positivist approaches are contrasted.…

A Qualitative Inquiry of the Counseling Dissertation Process

ERIC Educational Resources Information Center

Flynn, Stephen V.; Chasek, Christine L.; Harper, Irene F.; Murphy, Katherine M.; Jorgensen, Maribeth F.

2012-01-01

The authors in this consensual qualitative research study explored the dissertation experiences of 42 graduates (27 counselor educators, 13 counselors, 2 administrators) from 4 midwestern states. Identified domains included impact of environment, competing influences, personality traits, chair influence, committee function, and barriers to…

Qualitative Process Theory.

DTIC Science & Technology

1982-02-01

4. PERFORMING ORG. REPORT NUMBER S 7. AUTNOR(a) S.CONTRACT OR GRANT NUMBER(.j- Kenneth .D. Forbus NOq,,4-8o-C-o5o5 S. PERFORMING ORGANIZATION NAME...AND ADDRESS 10. PROGRAM ELEMENT. PROjECT. TASK Artificial Intelligence Laboratory. AREA & WORK UNIT NUMBERS 545 -Technology Square Cambridge...about processes, their effects , and their limits. Qualitati e rocess theory defines a simple notion of Reasoning about process also Imotivates a new

Process Evaluation of the Project SHINE Intervention for African American Families: An Integrated Positive Parenting and Peer Monitoring Approach to Health Promotion.

PubMed

St George, Sara M; Wilson, Dawn K; McDaniel, Tyler; Alia, Kassandra A

2016-07-01

This study describes the process evaluation of Project SHINE, a randomized family-based health promotion intervention that integrated parenting and peer monitoring for improving sedentary behavior, physical activity, and diet in African American families. Adolescent-parent dyads (n = 89) were randomized to a 6-week behavioral, positive parenting, and peer monitoring skills intervention or a general health education comparison condition. Process evaluation included observational ratings of fidelity, attendance records, psychosocial measures, and qualitative interviews. Results indicated that the intervention was delivered with high fidelity based on facilitator adherence (>98% of content delivered) and competent use of theoretically based behavior change and positive parenting skills (100% of ratings >3 on a 1-4 scale). Although only 43% of peers attended the "bring a friend" session, overall attendance was high (4.39 ± 1.51 sessions) as was the retention rate (88%). Parents in the intervention condition reported significant improvements in communication related to adolescents' engagement in health behaviors both on their own and with peers. These findings were supported by qualitative themes related to improvements in family communication and connectedness. This study provides an innovative example of how future family-based health promotion trials can expand their process evaluation approaches by assessing theoretically relevant positive parenting variables as part of ongoing monitoring. © 2016 Society for Public Health Education.

Quality dimensions in health evaluation: manager's conceptions.

PubMed

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

Psychiatric service staff perceptions of implementing a shared decision-making tool: a process evaluation study

PubMed Central

Schön, Ulla-Karin; Grim, Katarina; Wallin, Lars; Rosenberg, David; Svedberg, Petra

2018-01-01

ABSTRACT Purpose: Shared decision making, SDM, in psychiatric services, supports users to experience a greater sense of involvement in treatment, self-efficacy, autonomy and reduced coercion. Decision tools adapted to the needs of users have the potential to support SDM and restructure how users and staff work together to arrive at shared decisions. The aim of this study was to describe and analyse the implementation process of an SDM intervention for users of psychiatric services in Sweden. Method: The implementation was studied through a process evaluation utilizing both quantitative and qualitative methods. In designing the process evaluation for the intervention, three evaluation components were emphasized: contextual factors, implementation issues and mechanisms of impact. Results: The study addresses critical implementation issues related to decision-making authority, the perceived decision-making ability of users and the readiness of the service to increase influence and participation. It also emphasizes the importance of facilitation, as well as suggesting contextual adaptations that may be relevant for the local organizations. Conclusion: The results indicate that staff perceived the decision support tool as user-friendly and useful in supporting participation in decision-making, and suggest that such concrete supports to participation can be a factor in implementation if adequate attention is paid to organizational contexts and structures. PMID:29405889

Psychiatric service staff perceptions of implementing a shared decision-making tool: a process evaluation study.

PubMed

Schön, Ulla-Karin; Grim, Katarina; Wallin, Lars; Rosenberg, David; Svedberg, Petra

2018-12-01

Shared decision making, SDM, in psychiatric services, supports users to experience a greater sense of involvement in treatment, self-efficacy, autonomy and reduced coercion. Decision tools adapted to the needs of users have the potential to support SDM and restructure how users and staff work together to arrive at shared decisions. The aim of this study was to describe and analyse the implementation process of an SDM intervention for users of psychiatric services in Sweden. The implementation was studied through a process evaluation utilizing both quantitative and qualitative methods. In designing the process evaluation for the intervention, three evaluation components were emphasized: contextual factors, implementation issues and mechanisms of impact. The study addresses critical implementation issues related to decision-making authority, the perceived decision-making ability of users and the readiness of the service to increase influence and participation. It also emphasizes the importance of facilitation, as well as suggesting contextual adaptations that may be relevant for the local organizations. The results indicate that staff perceived the decision support tool as user-friendly and useful in supporting participation in decision-making, and suggest that such concrete supports to participation can be a factor in implementation if adequate attention is paid to organizational contexts and structures.

OR.NET: multi-perspective qualitative evaluation of an integrated operating room based on IEEE 11073 SDC.

PubMed

Rockstroh, M; Franke, S; Hofer, M; Will, A; Kasparick, M; Andersen, B; Neumuth, T

2017-08-01

Clinical working environments have become very complex imposing many different tasks in diagnosis, medical treatment, and care procedures. During the German flagship project OR.NET, more than 50 partners developed technologies for an open integration of medical devices and IT systems in the operating room. The aim of the present work was to evaluate a large set of the proposed concepts from the perspectives of various stakeholders. The demonstration OR is focused on interventions from the head and neck surgery and was developed in close cooperation with surgeons and numerous colleagues of the project partners. The demonstration OR was qualitatively evaluated including technical as well as clinical aspects. In the evaluation, a questionnaire was used to obtain feedback from hospital operators. The clinical implications were covered by structured interviews with surgeons, anesthesiologists and OR staff. In the present work, we qualitatively evaluate a subset of the proposed concepts from the perspectives of various stakeholders. The feedback of the clinicians indicates that there is a need for a flexible data and control integration. The hospital operators stress the need for tools to simplify risk management in openly integrated operating rooms. The implementation of openly integrated operating rooms will positively affect the surgeons, the anesthesiologists, the surgical nursing staff, as well as the technical personnel and the hospital operators. The evaluation demonstrated the need for OR integration technologies and identified the missing tools to support risk management and approval as the main barriers for future installments.

Presenting qualitative data through the co-construction of a model.

PubMed

Chenery-Morris, Sam

2014-09-01

Research skills are developed in pre-registration midwifery curricula to enhance student midwives' appreciation and appropriate application of evidence within their midwifery practice. A spontaneous, innovative session was facilitated based on student experiences of non-midwifery placements, which helped demonstrate how qualitative data are analysed and can then be presented. By listening to each other's varied experiences, the students were able to relate their research knowledge to date with their collective 'empirical data' to enhance their understanding of presenting qualitative research. The paper reports on the learning process. It is an evaluation of the session, with student permission for publication gained; it is not research.

The Do-Well study: protocol for a randomised controlled trial, economic and qualitative process evaluations of domiciliary welfare rights advice for socio-economically disadvantaged older people recruited via primary health care.

PubMed

Haighton, Catherine; Moffatt, Suzanne; Howel, Denise; McColl, Elaine; Milne, Eugene; Deverill, Mark; Rubin, Greg; Aspray, Terry; White, Martin

2012-05-28

Older people in poor health are more likely to need extra money, aids and adaptations to allow them to remain independent and cope with ill health, yet in the UK many do not claim the welfare benefits to which they are entitled. Welfare rights advice interventions lead to greater welfare income, but have not been rigorously evaluated for health benefits. This study will evaluate the effects on health and well-being of a domiciliary welfare rights advice service provided by local government or voluntary organisations in North East England for independent living, socio-economically disadvantaged older people (aged ≥60 yrs), recruited from general (primary care) practices. The study is a pragmatic, individually randomised, single blinded, wait-list controlled trial of welfare rights advice versus usual care, with embedded economic and qualitative process evaluations. The qualitative study will examine whether the intervention is delivered as intended; explore responses to the intervention and examine reasons for the trial findings; and explore the potential for translation of the intervention into routine policy and practice. The primary outcome is the effect on health-related quality of life, measured using the CASP 19 questionnaire. Volunteer men and women aged ≥60 years (1/household) will be identified from general practice patient registers. Patients in nursing homes or hospitals at the time of recruitment will be excluded. General practice populations will be recruited from disadvantaged areas of North East England, including urban, rural and semi-rural areas, with no previous access to targeted welfare rights advice services delivered to primary care patients. A minimum of 750 participants will be randomised to intervention and control arms in a 1:1 ratio. Achieving a trial design that is both ethical and acceptable to potential participants, required methodological compromises. The choice of follow-up length required a trade-off between sufficient time

The Do-Well study: protocol for a randomised controlled trial, economic and qualitative process evaluations of domiciliary welfare rights advice for socio-economically disadvantaged older people recruited via primary health care

PubMed Central

2012-01-01

Background Older people in poor health are more likely to need extra money, aids and adaptations to allow them to remain independent and cope with ill health, yet in the UK many do not claim the welfare benefits to which they are entitled. Welfare rights advice interventions lead to greater welfare income, but have not been rigorously evaluated for health benefits. This study will evaluate the effects on health and well-being of a domiciliary welfare rights advice service provided by local government or voluntary organisations in North East England for independent living, socio-economically disadvantaged older people (aged ≥60 yrs), recruited from general (primary care) practices. Methods/Design The study is a pragmatic, individually randomised, single blinded, wait-list controlled trial of welfare rights advice versus usual care, with embedded economic and qualitative process evaluations. The qualitative study will examine whether the intervention is delivered as intended; explore responses to the intervention and examine reasons for the trial findings; and explore the potential for translation of the intervention into routine policy and practice. The primary outcome is the effect on health-related quality of life, measured using the CASP 19 questionnaire. Volunteer men and women aged ≥60 years (1/household) will be identified from general practice patient registers. Patients in nursing homes or hospitals at the time of recruitment will be excluded. General practice populations will be recruited from disadvantaged areas of North East England, including urban, rural and semi-rural areas, with no previous access to targeted welfare rights advice services delivered to primary care patients. A minimum of 750 participants will be randomised to intervention and control arms in a 1:1 ratio. Discussion Achieving a trial design that is both ethical and acceptable to potential participants, required methodological compromises. The choice of follow-up length required

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation

PubMed Central

Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-01-01

Background This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. Objective The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of “How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?” Methods The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. Results The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1

Standards for reporting qualitative research: a synthesis of recommendations.

PubMed

O'Brien, Bridget C; Harris, Ilene B; Beckman, Thomas J; Reed, Darcy A; Cook, David A

2014-09-01

Standards for reporting exist for many types of quantitative research, but currently none exist for the broad spectrum of qualitative research. The purpose of the present study was to formulate and define standards for reporting qualitative research while preserving the requisite flexibility to accommodate various paradigms, approaches, and methods. The authors identified guidelines, reporting standards, and critical appraisal criteria for qualitative research by searching PubMed, Web of Science, and Google through July 2013; reviewing the reference lists of retrieved sources; and contacting experts. Specifically, two authors reviewed a sample of sources to generate an initial set of items that were potentially important in reporting qualitative research. Through an iterative process of reviewing sources, modifying the set of items, and coding all sources for items, the authors prepared a near-final list of items and descriptions and sent this list to five external reviewers for feedback. The final items and descriptions included in the reporting standards reflect this feedback. The Standards for Reporting Qualitative Research (SRQR) consists of 21 items. The authors define and explain key elements of each item and provide examples from recently published articles to illustrate ways in which the standards can be met. The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear standards for reporting qualitative research. These standards will assist authors during manuscript preparation, editors and reviewers in evaluating a manuscript for potential publication, and readers when critically appraising, applying, and synthesizing study findings.

Older adults' perspectives on the process of becoming users of assistive technology: a qualitative systematic review and meta-synthesis.

PubMed

Larsen, Stina Meyer; Mortensen, Rikke Falgreen; Kristensen, Hanne Kaae; Hounsgaard, Lise

2018-04-22

To identify, synthesize, and evaluate existing literature concerning the process of becoming a user of assistive technology (AT). A systematic review and meta-synthesis were carried out. Five bibliographic databases (MEDLINE via PubMed, CINAHL, Web of Science, PsycINFO and SocINDEX) were systematically searched up to 13 th of March 2017, using two sets of search terms: (i) elderly and synonyms and (ii) assistive technology and similar words, and combined with a qualitative research filter. Articles were screened, read and critically assessed. The meta-synthesis was guided by Ricoeur's theory of interpretation. Seventeen out of 4645 articles were included. Five phases emerged relating to the process of becoming a user of AT: phase A: Evaluating need, phase B: Acknowledging need, phase C: Incorporating the AT into daily life, phase D: Using the AT, and phase E: Future use. Three transitions, describing factors essential to moving from one phase to the next, were identified; from phase A-B: Valued activities are threatened, from phase B-C: Obtaining the AT and from phase C-D: Trust in the AT. No transition was identified from phase D-E. The meta-synthesis led to a deeper understanding of the process of older adults becoming users of AT, by exploring findings across the included articles. The identified phases and transitions in the systematic review serve as an analytical framework for understanding the process from the older adult's perspective. This review advocates for using a client-centred approach throughout the entire delivery process. Implications for rehabilitation The process of the older adult becoming a user of AT involves an individualized time factor, and this supports the practice of individualized follow-up. The process of becoming a user of AT is closely related to self-image; healthcare professionals should support not only the use of AT but also the older adult's emotional adjustment to a new self-image. The process is highly influenced by the older

Situating methodology within qualitative research.

PubMed

Kramer-Kile, Marnie L

2012-01-01

Qualitative nurse researchers are required to make deliberate and sometimes complex methodological decisions about their work. Methodology in qualitative research is a comprehensive approach in which theory (ideas) and method (doing) are brought into close alignment. It can be difficult, at times, to understand the concept of methodology. The purpose of this research column is to: (1) define qualitative methodology; (2) illuminate the relationship between epistemology, ontology and methodology; (3) explicate the connection between theory and method in qualitative research design; and 4) highlight relevant examples of methodological decisions made within cardiovascular nursing research. Although there is no "one set way" to do qualitative research, all qualitative researchers should account for the choices they make throughout the research process and articulate their methodological decision-making along the way.

Practice guidelines in the context of primary care, learning and usability in the physicians' decision-making process--a qualitative study.

PubMed

Ingemansson, Maria; Bastholm-Rahmner, Pia; Kiessling, Anna

2014-08-20

Decision-making is central for general practitioners (GP). Practice guidelines are important tools in this process but implementation of them in the complex context of primary care is a challenge. The purpose of this study was to explore how GPs approach, learn from and use practice guidelines in their day-to-day decision-making process in primary care. A qualitative approach using focus-group interviews was chosen in order to provide in-depth information. The participants were 22 GPs with a median of seven years of experience in primary care, representing seven primary healthcare centres in Stockholm, Sweden in 2011. The interviews focused on how the GPs use guidelines in their decision-making, factors that influence their decision how to approach these guidelines, and how they could encourage the learning process in routine practice.Data were analysed by qualitative content analysis. Meaning units were condensed and grouped in categories. After interpreting the content in the categories, themes were created. Three themes were conceptualized. The first theme emphasized to use guidelines by interactive contextualized dialogues. The categories underpinning this theme: 1. Feedback by peer-learning 2. Feedback by collaboration, mutual learning, and equality between specialties, identified important ways to achieve this learning dialogue. Confidence was central in the second theme, learning that establishes confidence to provide high quality care. Three aspects of confidence were identified in the categories of this theme: 1. Confidence by confirmation, 2. Confidence by reliability and 3. Confidence by evaluation of own results. In the third theme, learning by use of relevant evidence in the decision-making process, we identified two categories: 1. Design and lay-out visualizing the evidence 2. Accessibility adapted to the clinical decision-making process as prerequisites for using the practice guidelines. Decision-making in primary care is a dual process that involves

Qualitative Assessment: Evaluating the Impacts of Climate ...

EPA Pesticide Factsheets

The South Fork Nooksack River (South Fork) is located in northwest Washington State and is home to nine species of Pacific salmon, including Nooksack early Chinook (aka, spring Chinook salmon), an iconic species for the Nooksack Indian Tribe. The quantity of salmon in the South Fork, especially spring Chinook salmon, has dramatically declined from historic levels, due primarily to habitat degradation from the legacy impacts of various land uses such as commercial forestry, agriculture, flood control, and transportation infrastructure. Segments of the South Fork and some of its tributaries exceed temperature criteria established for the protection of cold-water salmonid populations, and were listed on Washington State’s Clean Water Act (CWA) 303(d) list of impaired waterbodies. High water temperatures in the South Fork are detrimental to fish and other native species that depend on cool, clean, well-oxygenated water. Of the nine salmon species, three have been listed as threatened under the federal Endangered Species Act (ESA) and are of high priority to restoration efforts in the South Fork—spring Chinook salmon, summer steelhead trout, and bull trout. Growing evidence shows that climate change will exacerbate legacy impacts. This qualitative assessment is a comprehensive analysis of climate change impacts on freshwater habitat and Pacific salmon in the South Fork. It also evaluates the effectiveness of restoration tools that address Pacific salmon recovery.

Power relations in qualitative research.

PubMed

Karnieli-Miller, Orit; Strier, Roni; Pessach, Liat

2009-02-01

This article focuses on the tensions between the commitment to power redistribution of the qualitative paradigm and the ethical and methodological complexity inherent in clinical research. Qualitative inquiry, in general, though there are significant variations between its different paradigms and traditions, proposes to reduce power differences and encourages disclosure and authenticity between researchers and participants. It clearly departs from the traditional conception of quantitative research, whereby the researcher is the ultimate source of authority and promotes the participants' equal participation in the research process. But it is precisely this admirable desire to democratize the research process, and the tendency to question traditional role boundaries, that raises multiple ethical dilemmas and serious methodological challenges. In this article, we offer a conceptual frame for addressing questions of power distribution in qualitative research through a developmental analysis of power relations across the different stages of the research process. We discuss ethical and methodological issues.

Qualitative Secondary Analysis: A Case Exemplar.

PubMed

Tate, Judith Ann; Happ, Mary Beth

Qualitative secondary analysis (QSA) is the use of qualitative data that was collected by someone else or was collected to answer a different research question. Secondary analysis of qualitative data provides an opportunity to maximize data utility, particularly with difficult-to-reach patient populations. However, qualitative secondary analysis methods require careful consideration and explicit description to best understand, contextualize, and evaluate the research results. In this article, we describe methodologic considerations using a case exemplar to illustrate challenges specific to qualitative secondary analysis and strategies to overcome them. Copyright © 2017 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Breast cancer patients' narrative experiences about communication during the oncology care process: a qualitative study.

PubMed

Abt Sacks, A; Perestelo-Perez, L; Rodriguez-Martin, B; Cuellar-Pompa, L; Algara López, M; González Hernández, N; Serrano-Aguilar, P

2016-09-01

To analyse the perception about the information and communication received to evaluate oncologic care of breast cancer patients in Spain. Qualitative study based on conducting in-depth interviews. An inductive thematic analysis of the illness narratives was performed. Intentional theoretical sampling of 41 people diagnosed with breast cancer. The information provided during care process is assessed as appropriate, as it includes personalised skills focused on communication and considers organisational and contextual issues. In some cases, the information was considered partial, heterogeneous and at times contradictory, which revealed a lack of continuity. To provide and adequately cover information needs from the patient perspective, it is necessary to ensure access, both in its physical (material) and intellectual (comprehension) dimension, keeping in mind elements of social capital (social networks) and cultural capital (values, beliefs, non-verbal language) that facilitate or hinder access. The current state of transition to a horizontal model in the doctor-patient relationship, could account for the difficulties, deficits and contradictions in communication and information that breast cancer patients perceive in many contexts. © 2015 John Wiley & Sons Ltd.

Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory

PubMed Central

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-01-01

Objective To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. Data Sources and Design We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. Principle Findings We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Conclusions Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines. PMID:17286625

Qualitative data analysis for health services research: developing taxonomy, themes, and theory.

PubMed

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-08-01

To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. DATA SOURCES AND DESIGN: We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines.

A qualitative evaluation of scalpel skill teaching of podiatry students.

PubMed

Causby, Ryan S; McDonnell, Michelle N; Reed, Lloyd; Fryer, Caroline E; Hillier, Susan L

2017-01-01

Degrees in health disciplines need a balance of theoretical knowledge and sufficient clinical practice to meet registration requirements, in particular those requiring specialist skills such as the use of scalpels and other small instruments, such as podiatry. However, despite this requirement there is a scarcity of literature and research to inform teaching of these particular manual clinical skills. Therefore, the aims of this study were to determine the current approaches being used to teach manual skills, in particular scalpel skills, in university podiatry programs in Australia and New Zealand, and to explore what issues, challenges and innovations exist. A qualitative study, consisting of semi-structured interviews with staff at eight university podiatry programs in Australia and New Zealand was undertaken to determine how these skills are taught and evaluated, and how poor performers are managed. A conventional content analysis technique was used to analyse and code interview data, with the resultant categories reported. Approaches to teaching manual clinical skills, in particular scalpel skills, appear to be consistent between university programs in Australia and New Zealand in utilising didactic-style content, demonstration, physical practice on inanimate objects and real skin, and often the use of supplementary audio-visual material. The main reported differences between programs were in methods and processes of practice, with controversy regarding the use of inanimate objects versus real skin for practice. Despite a lack of research and literature surrounding this topic, the approach to teaching is relatively consistent between programs with greatest disparity being the structure and duration of practice. Key issues for teaching staff in teaching manual skills were students' clinical exposure, motivation, levels of anxiety and dexterity.

Reporting Qualitative Research: Standards, Challenges, and Implications for Health Design.

PubMed

Peditto, Kathryn

2018-04-01

This Methods column describes the existing reporting standards for qualitative research, their application to health design research, and the challenges to implementation. Intended for both researchers and practitioners, this article provides multiple perspectives on both reporting and evaluating high-quality qualitative research. Two popular reporting standards exist for reporting qualitative research-the Consolidated Criteria for Reporting Qualitative Research (COREQ) and the Standards for Reporting Qualitative Research (SRQR). Though compiled using similar procedures, they differ in their criteria and the methods to which they apply. Creating and applying reporting criteria is inherently difficult due to the undefined and fluctuating nature of qualitative research when compared to quantitative studies. Qualitative research is expansive and occasionally controversial, spanning many different methods of inquiry and epistemological approaches. A "one-size-fits-all" standard for reporting qualitative research can be restrictive, but COREQ and SRQR both serve as valuable tools for developing responsible qualitative research proposals, effectively communicating research decisions, and evaluating submissions. Ultimately, tailoring a set of standards specific to health design research and its frequently used methods would ensure quality research and aid reviewers in their evaluations.

Changing Beliefs about Trauma: A Qualitative Study of Cognitive Processing Therapy.

PubMed

Price, Jennifer L; MacDonald, Helen Z; Adair, Kathryn C; Koerner, Naomi; Monson, Candice M

2016-03-01

Controlled qualitative methods complement quantitative treatment outcome research and enable a more thorough understanding of the effects of therapy and the suspected mechanisms of action. Thematic analyses were used to examine outcomes of cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) in a randomized controlled trial of individuals diagnosed with military-related PTSD (n = 15). After sessions 1 and 11, participants wrote "impact statements" describing their appraisals of their trauma and beliefs potentially impacted by traumatic events. Trained raters coded each of these statements using a thematic coding scheme. An analysis of thematic coding revealed positive changes over the course of therapy in participants' perspective on their trauma and their future, supporting the purported mechanisms of CPT. Implications of this research for theory and clinical practice are discussed.

Taiwanese women's process of recovery from stillbirth: a qualitative descriptive study.

PubMed

Tseng, Ying-Fen; Chen, Chung-Hey; Wang, Hsiu-Hung

2014-06-01

The purpose of this qualitative descriptive study was to portray the recovery process of Taiwanese women after stillbirth. Data were generated through individual in-depth interviews with 21 women selected using purposeful sampling. Three stages in an emotional journey of recovery were suffering from silent grief, searching for a way out, and achieving peace of mind and mental stability. Throughout their journey, the women's overarching concern was where the deceased child had gone and whether it was well. Together these stages composed A pathway to peace of mind, a mental journey on which women struggled to spiritually connect with the lost baby and finally sought a personal pathway to emotional peace. Findings can inform healthcare providers in providing culturally sensitive care for Taiwanese women to facilitate healing after a stillbirth. © 2014 Wiley Periodicals, Inc.

The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice.

PubMed

Breimaier, Helga E; Heckemann, Birgit; Halfens, Ruud J G; Lohrmann, Christa

2015-01-01

Implementing clinical practice guidelines (CPGs) in healthcare settings is a complex intervention involving both independent and interdependent components. Although the Consolidated Framework for Implementation Research (CFIR) has never been evaluated in a practical context, it appeared to be a suitable theoretical framework to guide an implementation process. The aim of this study was to evaluate the comprehensiveness, applicability and usefulness of the CFIR in the implementation of a fall-prevention CPG in nursing practice to improve patient care in an Austrian university teaching hospital setting. The evaluation of the CFIR was based on (1) team-meeting minutes, (2) the main investigator's research diary, containing a record of a before-and-after, mixed-methods study design embedded in a participatory action research (PAR) approach for guideline implementation, and (3) an analysis of qualitative and quantitative data collected from graduate and assistant nurses in two Austrian university teaching hospital departments. The CFIR was used to organise data per and across time point(s) and assess their influence on the implementation process, resulting in implementation and service outcomes. Overall, the CFIR could be demonstrated to be a comprehensive framework for the implementation of a guideline into a hospital-based nursing practice. However, the CFIR did not account for some crucial factors during the planning phase of an implementation process, such as consideration of stakeholder aims and wishes/needs when implementing an innovation, pre-established measures related to the intended innovation and pre-established strategies for implementing an innovation. For the CFIR constructs reflecting & evaluating and engaging, a more specific definition is recommended. The framework and its supplements could easily be used by researchers, and their scope was appropriate for the complexity of a prospective CPG-implementation project. The CFIR facilitated qualitative data

Application of statistical process control to qualitative molecular diagnostic assays.

PubMed

O'Brien, Cathal P; Finn, Stephen P

2014-01-01

Modern pathology laboratories and in particular high throughput laboratories such as clinical chemistry have developed a reliable system for statistical process control (SPC). Such a system is absent from the majority of molecular laboratories and where present is confined to quantitative assays. As the inability to apply SPC to an assay is an obvious disadvantage this study aimed to solve this problem by using a frequency estimate coupled with a confidence interval calculation to detect deviations from an expected mutation frequency. The results of this study demonstrate the strengths and weaknesses of this approach and highlight minimum sample number requirements. Notably, assays with low mutation frequencies and detection of small deviations from an expected value require greater sample numbers to mitigate a protracted time to detection. Modeled laboratory data was also used to highlight how this approach might be applied in a routine molecular laboratory. This article is the first to describe the application of SPC to qualitative laboratory data.

Relationship between Teacher Self-Efficacy and the Teacher Evaluation Process

ERIC Educational Resources Information Center

Pisciotta, Summer

2014-01-01

Changes in state laws led the education system personnel in Arizona to reconsider how they assess students, teachers, and administrators. Higher expectations for teacher and student performance and a budget deficit at schools resulted in evaluations being a focal point in teacher contract renewal. The purpose of this qualitative case study was to…

Pulmonologists' Reported Use of Guidelines and Shared Decision-making in Evaluation of Pulmonary Nodules: A Qualitative Study.

PubMed

Wiener, Renda Soylemez; Slatore, Christopher G; Gillespie, Chris; Clark, Jack A

2015-12-01

Selecting a strategy (surveillance, biopsy, resection) for pulmonary nodule evaluation can be complex given the absence of high-quality data comparing strategies and the important tradeoffs among strategies. Guidelines recommend a three-step approach: (1) assess the likelihood of malignancy, (2) evaluate whether the patient is a candidate for invasive intervention, and (3) elicit the patient's preferences and engage in shared decision-making. We sought to characterize how pulmonologists select a pulmonary nodule evaluation strategy and the extent to which they report following the guideline-recommended approach. We conducted semistructured qualitative interviews with 14 pulmonologists who manage patients with pulmonary nodules at four clinical sites. Transcripts of audiorecorded interviews were analyzed using the principles of grounded theory. Pulmonologists reported consistently performing steps 1 and 2 but described diverse approaches to step 3 that ranged from always engaging the patient in decision-making to never doing so. Many described incorporating patients' preferences only in particular circumstances, such as when the patient appeared particularly anxious or was aggressive in questioning management options. Indeed, other factors, including convenience, physician preferences, physician anxiety, malpractice concerns, and physician experience, appeared to drive decision-making as much as, if not more than, patient preferences. Although pulmonologists appear to routinely personalize pulmonary nodule evaluation strategies based on the individual patient's risk-benefit tradeoffs, they may not consistently take patient preferences into account during the decision-making process. In the absence of high-quality evidence regarding the optimal methods of pulmonary nodule evaluation, physicians should strive to ensure that management decisions are consistent with patients' values.

Conducting Qualitative Data Analysis: Managing Dynamic Tensions within

ERIC Educational Resources Information Center

Chenail, Ronald J.

2012-01-01

In the third of a series of "how-to" essays on conducting qualitative data analysis, Ron Chenail examines the dynamic tensions within the process of qualitative data analysis that qualitative researchers must manage in order to produce credible and creative results. These tensions include (a) the qualities of the data and the qualitative data…

Four challenges in selecting and implementing methods to monitor and evaluate participatory processes: Example from the Rwenzori region, Uganda.

PubMed

Hassenforder, Emeline; Ducrot, Raphaëlle; Ferrand, Nils; Barreteau, Olivier; Anne Daniell, Katherine; Pittock, Jamie

2016-09-15

Participatory approaches are now increasingly recognized and used as an essential element of policies and programs, especially in regards to natural resource management (NRM). Most practitioners, decision-makers and researchers having adopted participatory approaches also acknowledge the need to monitor and evaluate such approaches in order to audit their effectiveness, support decision-making or improve learning. Many manuals and frameworks exist on how to carry out monitoring and evaluation (M&E) for participatory processes. However, few provide guidelines on the selection and implementation of M&E methods, an aspect which is also often obscure in published studies, at the expense of the transparency, reliability and validity of the study. In this paper, we argue that the selection and implementation of M&E methods are particularly strategic when monitoring and evaluating a participatory process. We demonstrate that evaluators of participatory processes have to tackle a quadruple challenge when selecting and implementing methods: using mixed-methods, both qualitative and quantitative; assessing the participatory process, its outcomes, and its context; taking into account both the theory and participants' views; and being both rigorous and adaptive. The M&E of a participatory planning process in the Rwenzori Region, Uganda, is used as an example to show how these challenges unfold on the ground and how they can be tackled. Based on this example, we conclude by providing tools and strategies that can be used by evaluators to ensure that they make utile, feasible, coherent, transparent and adaptive methodological choices when monitoring and evaluating participatory processes for NRM. Copyright © 2016 Elsevier Ltd. All rights reserved.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

PubMed

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic

Qualitative evaluation of the implementation of the Interdisciplinary Management Tool: a reflective tool to enhance interdisciplinary teamwork using Structured, Facilitated Action Research for Implementation.

PubMed

Nancarrow, Susan A; Smith, Tony; Ariss, Steven; Enderby, Pamela M

2015-07-01

Reflective practice is used increasingly to enhance team functioning and service effectiveness; however, there is little evidence of its use in interdisciplinary teams. This paper presents the qualitative evaluation of the Interdisciplinary Management Tool (IMT), an evidence-based change tool designed to enhance interdisciplinary teamwork through structured team reflection. The IMT incorporates three components: an evidence-based resource guide; a reflective implementation framework based on Structured, Facilitated Action Research for Implementation methodology; and formative and summative evaluation components. The IMT was implemented with intermediate care teams supported by independent facilitators in England. Each intervention lasted 6 months and was evaluated over a 12-month period. Data sources include interviews, a focus group with facilitators, questionnaires completed by team members and documentary feedback from structured team reports. Data were analysed qualitatively using the Framework approach. The IMT was implemented with 10 teams, including 253 staff from more than 10 different disciplines. Team challenges included lack of clear vision; communication issues; limited career progression opportunities; inefficient resource use; need for role clarity and service development. The IMT successfully engaged staff in the change process, and resulted in teams developing creative strategies to address the issues identified. Participants valued dedicated time to focus on the processes of team functioning; however, some were uncomfortable with a focus on teamwork at the expense of delivering direct patient care. The IMT is a relatively low-cost, structured, reflective way to enhance team function. It empowers individuals to understand and value their own, and others' roles and responsibilities within the team; identify barriers to effective teamwork, and develop and implement appropriate solutions to these. To be successful, teams need protected time to take

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation.

PubMed

Vollmer Dahlke, Deborah; Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-02-10

This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of "How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?" The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1) were .893 for first cycle coding and .784

Language barriers and qualitative nursing research: methodological considerations.

PubMed

Squires, A

2008-09-01

This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation.

Aggregation, Validation, and Generalization of Qualitative Data - Methodological and Practical Research Strategies Illustrated by the Research Process of an empirically Based Typology.

PubMed

Weis, Daniel; Willems, Helmut

2017-06-01

The article deals with the question of how aggregated data which allow for generalizable insights can be generated from single-case based qualitative investigations. Thereby, two central challenges of qualitative social research are outlined: First, researchers must ensure that the single-case data can be aggregated and condensed so that new collective structures can be detected. Second, they must apply methods and practices to allow for the generalization of the results beyond the specific study. In the following, we demonstrate how and under what conditions these challenges can be addressed in research practice. To this end, the research process of the construction of an empirically based typology is described. A qualitative study, conducted within the framework of the Luxembourg Youth Report, is used to illustrate this process. Specifically, strategies are presented which increase the likelihood of generalizability or transferability of the results, while also highlighting their limitations.

Evaluating the Healthy Start program. Design development to evaluative assessment.

PubMed

Raykovich, K S; McCormick, M C; Howell, E M; Devaney, B L

1996-09-01

The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could be used to evaluate 15 diverse grantees. This article discusses the experience of creating a process and outcomes evaluation design that was both substantively and methodologically appropriate given such issues as the diversity of grantees and their community-based intervention strategies; the process of accessing secondary data sources, including vital records; the quality of client level data submissions; and the need to incorporate both qualitative and quantitative approaches into the evaluation design. The relevance of this experience for the conduct of other field studies of public health interventions is discussed.

"Research protocol: a synthesis of qualitative studies on the process of adaptation to dependency in elderly persons and their families"

PubMed Central

2010-01-01

Background Dealing with dependency in the elderly and their families leads us to explore the life experience of those involved together with the processes of adaptation to this condition. A number of original studies have been published which, following a qualitative methodology, have dealt with both dimensions. Methods/Design Objectives: 1) To present a synthesis of the qualitative evidence available on the process of adaptation to dependency in elderly persons and their families; 2) to conduct an in-depth study into the experiences and strategies developed by both to optimise their living conditions; 3) to enable standards of action/intervention to be developed in the caregiving environment. A synthesis of qualitative studies is projected with an extensive and inclusive bibliography search strategy. The primary search will focus on the major databases (CINAHL, MEDLINE, EMBASE, PsycInfo, PSICODOC, Cochrane Library, JBI, EMBASE, LILACS, CUIDEN, CUIDEN qualitative, CUIDATGE, British Nursing Index, SSCI). The secondary search will be conducted in articles taken from the references to studies identified in the articles and reports and the manual search in congresses and foundation papers. Article quality will be assessed by the guide proposed by Sandelowski & Barroso and data extraction done using the QARI data extraction form proposed by the Joanna Briggs Institute for Evidence-Based Practice. The synthesis of the findings will be based on the principles and procedures of grounded theory: coding, identification and relationship between categories, and synthesis using constant comparison as a strategy. Discussion This synthesis of qualitative evidence will enable us to detect health needs as perceived by the receivers in their own interaction contexts. PMID:20738846

Conducting Qualitative Data Analysis: Reading Line-by-Line, but Analyzing by Meaningful Qualitative Units

ERIC Educational Resources Information Center

Chenail, Ronald J.

2012-01-01

In the first of a series of "how-to" essays on conducting qualitative data analysis, Ron Chenail points out the challenges of determining units to analyze qualitatively when dealing with text. He acknowledges that although we may read a document word-by-word or line-by-line, we need to adjust our focus when processing the text for purposes of…

Protocol for process evaluation of a randomised controlled trial of family-led rehabilitation post stroke (ATTEND) in India

PubMed Central

Liu, Hueiming; Lindley, Richard; Alim, Mohammed; Felix, Cynthia; Gandhi, Dorcas B C; Verma, Shweta J; Tugnawat, Deepak Kumar; Syrigapu, Anuradha; Ramamurthy, Ramaprabhu Krishnappa; Pandian, Jeyaraj D; Walker, Marion; Forster, Anne; Anderson, Craig S; Langhorne, Peter; Murthy, Gudlavalleti Venkata Satyanarayana; Shamanna, Bindiganavale Ramaswamy; Hackett, Maree L; Maulik, Pallab K; Harvey, Lisa A; Jan, Stephen

2016-01-01

Introduction We are undertaking a randomised controlled trial (fAmily led rehabiliTaTion aftEr stroke in INDia, ATTEND) evaluating training a family carer to enable maximal rehabilitation of patients with stroke-related disability; as a potentially affordable, culturally acceptable and effective intervention for use in India. A process evaluation is needed to understand how and why this complex intervention may be effective, and to capture important barriers and facilitators to its implementation. We describe the protocol for our process evaluation to encourage the development of in-process evaluation methodology and transparency in reporting. Methods and analysis The realist and RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) frameworks informed the design. Mixed methods include semistructured interviews with health providers, patients and their carers, analysis of quantitative process data describing fidelity and dose of intervention, observations of trial set up and implementation, and the analysis of the cost data from the patients and their families perspective and programme budgets. These qualitative and quantitative data will be analysed iteratively prior to knowing the quantitative outcomes of the trial, and then triangulated with the results from the primary outcome evaluation. Ethics and dissemination The process evaluation has received ethical approval for all sites in India. In low-income and middle-income countries, the available human capital can form an approach to reducing the evidence practice gap, compared with the high cost alternatives available in established market economies. This process evaluation will provide insights into how such a programme can be implemented in practice and brought to scale. Through local stakeholder engagement and dissemination of findings globally we hope to build on patient-centred, cost-effective and sustainable models of stroke rehabilitation. Trial registration number CTRI/2013

Protocol for process evaluation of a randomised controlled trial of family-led rehabilitation post stroke (ATTEND) in India.

PubMed

Liu, Hueiming; Lindley, Richard; Alim, Mohammed; Felix, Cynthia; Gandhi, Dorcas B C; Verma, Shweta J; Tugnawat, Deepak Kumar; Syrigapu, Anuradha; Ramamurthy, Ramaprabhu Krishnappa; Pandian, Jeyaraj D; Walker, Marion; Forster, Anne; Anderson, Craig S; Langhorne, Peter; Murthy, Gudlavalleti Venkata Satyanarayana; Shamanna, Bindiganavale Ramaswamy; Hackett, Maree L; Maulik, Pallab K; Harvey, Lisa A; Jan, Stephen

2016-09-15

We are undertaking a randomised controlled trial (fAmily led rehabiliTaTion aftEr stroke in INDia, ATTEND) evaluating training a family carer to enable maximal rehabilitation of patients with stroke-related disability; as a potentially affordable, culturally acceptable and effective intervention for use in India. A process evaluation is needed to understand how and why this complex intervention may be effective, and to capture important barriers and facilitators to its implementation. We describe the protocol for our process evaluation to encourage the development of in-process evaluation methodology and transparency in reporting. The realist and RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) frameworks informed the design. Mixed methods include semistructured interviews with health providers, patients and their carers, analysis of quantitative process data describing fidelity and dose of intervention, observations of trial set up and implementation, and the analysis of the cost data from the patients and their families perspective and programme budgets. These qualitative and quantitative data will be analysed iteratively prior to knowing the quantitative outcomes of the trial, and then triangulated with the results from the primary outcome evaluation. The process evaluation has received ethical approval for all sites in India. In low-income and middle-income countries, the available human capital can form an approach to reducing the evidence practice gap, compared with the high cost alternatives available in established market economies. This process evaluation will provide insights into how such a programme can be implemented in practice and brought to scale. Through local stakeholder engagement and dissemination of findings globally we hope to build on patient-centred, cost-effective and sustainable models of stroke rehabilitation. CTRI/2013/04/003557. Published by the BMJ Publishing Group Limited. For permission to use (where not

76 FR 37344 - Technology Evaluation Process

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-27

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... is an extension of a prior RFI seeking comment on a proposed commercial buildings technology... seeks comments and information related to a commercial buildings technology evaluation process. DOE is...

76 FR 30696 - Technology Evaluation Process

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-26

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... (DOE) seeks comments and information related to a commercial buildings technology evaluation process... technologies for commercial buildings based on the voluntary submittal of product test data. The program would...

Empirical evaluation of the Process Overview Measure for assessing situation awareness in process plants.

PubMed

Lau, Nathan; Jamieson, Greg A; Skraaning, Gyrd

2016-03-01

The Process Overview Measure is a query-based measure developed to assess operator situation awareness (SA) from monitoring process plants. A companion paper describes how the measure has been developed according to process plant properties and operator cognitive work. The Process Overview Measure demonstrated practicality, sensitivity, validity and reliability in two full-scope simulator experiments investigating dramatically different operational concepts. Practicality was assessed based on qualitative feedback of participants and researchers. The Process Overview Measure demonstrated sensitivity and validity by revealing significant effects of experimental manipulations that corroborated with other empirical results. The measure also demonstrated adequate inter-rater reliability and practicality for measuring SA in full-scope simulator settings based on data collected on process experts. Thus, full-scope simulator studies can employ the Process Overview Measure to reveal the impact of new control room technology and operational concepts on monitoring process plants. Practitioner Summary: The Process Overview Measure is a query-based measure that demonstrated practicality, sensitivity, validity and reliability for assessing operator situation awareness (SA) from monitoring process plants in representative settings.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Recruitment and retention in a 10-month social network-based intervention promoting diabetes self-management in socioeconomically deprived patients: a qualitative process evaluation

PubMed Central

Vissenberg, Charlotte; Nierkens, Vera; Uitewaal, Paul J M; Middelkoop, Barend J C; Stronks, Karien

2017-01-01

Objectives Socioeconomically deprived patients with type 2 diabetes often face challenges with self-management, resulting in more diabetes-related complications. However, these groups are often under-represented in self-management interventions. Evidence on effective recruitment and retention strategies is growing, but lacking for intensive self-management interventions. This study aims to explore recruitment, retention and effective intervention strategies in a 10-month group-based intervention among Dutch, Moroccan, Turkish and Surinamese patients from socioeconomically deprived neighbourhoods. Methods Participants were recruited through general practitioners (GPs) and participated in a 10-month social network-based intervention (10 groups, n=69): Powerful Together with Diabetes. This intervention also targeted the significant others of participants and aimed to increase social support for self-management and to decrease social influences hindering self-management. A qualitative process evaluation was conducted. Retention was measured using log books kept by group leaders. Further, we conducted 17 in-depth interviews with participants (multiethnic sample) and 18 with group leaders. Interviews were transcribed, coded and analysed using framework analyses. Results The GP's letter and reminder calls, an informational meeting and the intervention's informal nature facilitated recruitment. During the first months, positive group atmosphere, the intervention's perceived usefulness, opportunities to socialise and a reduction in practical barriers facilitated retention. After the first months, conflicting responsibilities and changes in the intervention's nature and planning hindered retention. Calls from group leaders and the prospect of a diploma helped participants overcome these barriers. Conclusion To promote retention in lengthy self-management interventions, it seems important that patients feel they are going on an outing to a social gathering that is enjoyable

Determining the disease management process for epileptic patients: A qualitative study.

PubMed

Hosseini, Nazafarin; Sharif, Farkhondeh; Ahmadi, Fazlollah; Zare, Mohammad

2016-01-01

Epilepsy exposes patients to many physical, social, and emotional challenges. Thus, it seems to portray a complex picture and needs holistic care. Medical treatment and psychosocial part of epilepsy remain central to managing and improving the patient's qualify of life through team efforts. Some studies have shown the dimensions of self-management, but its management process of epilepsy patients, especially in Iran, is not clear. This study aimed to determine the disease management process in patients with epilepsy in Iran. This qualitative approach and grounded theory study was conducted from January 2009 to February 2012 in Isfahan city (Iran). Thirty-two participants were recruited by the goal-oriented, and snowball sample selection and theoretical sampling methods. After conducting a total of 43 in-depth interviews with the participants, the researchers reached data saturation. Data were analyzed using Strauss and Corbin method. With a focus on disease management process, researchers found three main themes and seven sub-themes as a psychosocial process (PSP). The main themes were: perception of threat to self-identity, effort to preserve self-identity, and burn out. The psychosocial aspect of the disease generated one main variable "the perception of identity loss" and one central variable "searching for self-identity." Participants attributed threat to self-identity and burn out to the way their disease was managed requiring efforts to preserve their identity. Recommendations consist of support programs and strategies to improve the public perception of epilepsy in Iran, help patients accept their condition and preserve self-identity, and most importantly, enhance medical management of epilepsy.

Knowledge representation and qualitative simulation of salmon redd functioning. Part I: qualitative modeling and simulation.

PubMed

Guerrin, F; Dumas, J

2001-02-01

This work aims at representing empirical knowledge of freshwater ecologists on the functioning of salmon redds (spawning areas of salmon) and its impact on mortality of early stages. For this, we use Qsim, a qualitative simulator. In this first part, we provide unfamiliar readers with the underlying qualitative differential equation (QDE) ontology of Qsim: representing quantities, qualitative variables, qualitative constraints, QDE structure. Based on a very simple example taken of the salmon redd application, we show how informal biological knowledge may be represented and simulated using an approach that was first intended to analyze qualitatively ordinary differential equations systems. A companion paper (Part II) gives the full description and simulation of the salmon redd qualitative model. This work was part of a project aimed at assessing the impact of the environment on salmon populations dynamics by the use of models of processes acting at different levels: catchment, river, and redds. Only the latter level is dealt with in this paper.

A Qualitative Evaluation of the Effects of Mandatory Reporting of Domestic Violence on Victims and Their Children

ERIC Educational Resources Information Center

Antle, Becky; Barbee, Anita; Yankeelov, Pam; Bledsoe, Linda

2010-01-01

This purpose of this research was to evaluate the mandatory reporting law for domestic violence victims in the state of Kentucky through the qualitative interview of 24 female victims of domestic violence. Victims were generally supportive of the law and felt that professionals should be required to report domestic abuse. They did not feel that…

[Auditory processing evaluation in children born preterm].

PubMed

Gallo, Júlia; Dias, Karin Ziliotto; Pereira, Liliane Desgualdo; Azevedo, Marisa Frasson de; Sousa, Elaine Colombo

2011-01-01

To verify the performance of children born preterm on auditory processing evaluation, and to correlate the data with behavioral hearing assessment carried out at 12 months of age, comparing the results to those of auditory processing evaluation of children born full-term. Participants were 30 children with ages between 4 and 7 years, who were divided into two groups: Group 1 (children born preterm), and Group 2 (children born full-term). The auditory processing results of Group 1 were correlated to data obtained from the behavioral auditory evaluation carried out at 12 months of age. The results were compared between groups. Subjects in Group 1 presented at least one risk indicator for hearing loss at birth. In the behavioral auditory assessment carried out at 12 months of age, 38% of the children in Group 1 were at risk for central auditory processing deficits, and 93.75% presented auditory processing deficits on the evaluation. Significant differences were found between the groups for the temporal order test, the PSI test with ipsilateral competitive message, and the speech-in-noise test. The delay in sound localization ability was associated to temporal processing deficits. Children born preterm have worse performance in auditory processing evaluation than children born full-term. Delay in sound localization at 12 months is associated to deficits on the physiological mechanism of temporal processing in the auditory processing evaluation carried out between 4 and 7 years.

Using Qualitative Research to Inform Development of Professional Guidelines: A Case Study of the Society of Critical Care Medicine Family-Centered Care Guidelines.

PubMed

Coombs, Maureen A; Davidson, Judy E; Nunnally, Mark E; Wickline, Mary A; Curtis, J Randall

2017-08-01

To explore the importance, challenges, and opportunities using qualitative research to enhance development of clinical practice guidelines, using recent guidelines for family-centered care in the ICU as an example. In developing the Society of Critical Care Medicine guidelines for family-centered care in the neonatal ICU, PICU, and adult ICU, we developed an innovative adaptation of the Grading of Recommendations, Assessments, Development and Evaluations approach to explicitly incorporate qualitative research. Using Grading of Recommendations, Assessments, Development and Evaluations and the Council of Medical Specialty Societies principles, we conducted a systematic review of qualitative research to establish family-centered domains and outcomes. Thematic analyses were undertaken on study findings and used to support Population, Intervention, Comparison, Outcome question development. We identified and employed three approaches using qualitative research in these guidelines. First, previously published qualitative research was used to identify important domains for the Population, Intervention, Comparison, Outcome questions. Second, this qualitative research was used to identify and prioritize key outcomes to be evaluated. Finally, we used qualitative methods, member checking with patients and families, to validate the process and outcome of the guideline development. In this, a novel report, we provide direction for standardizing the use of qualitative evidence in future guidelines. Recommendations are made to incorporate qualitative literature review and appraisal, include qualitative methodologists in guideline taskforce teams, and develop training for evaluation of qualitative research into guideline development procedures. Effective methods of involving patients and families as members of guideline development represent opportunities for future work.

Evaluating Rigor in Qualitative Methodology and Research Dissemination

ERIC Educational Resources Information Center

Trainor, Audrey A.; Graue, Elizabeth

2014-01-01

Despite previous and successful attempts to outline general criteria for rigor, researchers in special education have debated the application of rigor criteria, the significance or importance of small n research, the purpose of interpretivist approaches, and the generalizability of qualitative empirical results. Adding to these complications, the…

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

Qualitative Research Designs: Selection and Implementation

ERIC Educational Resources Information Center

Creswell, John W.; Hanson, William E.; Plano Clark, Vicki L.; Morales, Alejandro

2007-01-01

Counseling psychologists face many approaches from which to choose when they conduct a qualitative research study. This article focuses on the processes of selecting, contrasting, and implementing five different qualitative approaches. Based on an extended example related to test interpretation by counselors, clients, and communities, this article…

Process evaluation of a workplace health promotion intervention aimed at improving work engagement and energy balance.

PubMed

van Berkel, Jantien; Boot, Cécile R L; Proper, Karin I; Bongers, Paulien M; van der Beek, Allard J

2013-01-01

To evaluate the process of the implementation of an intervention aimed at improving work engagement and energy balance, and to explore associations between process measures and compliance. Process measures were assessed using a combination of quantitative and qualitative methods. The mindfulness training was attended at least once by 81.3% of subjects, and 54.5% were highly compliant. With regard to e-coaching and homework exercises, 6.3% and 8.0%, respectively, were highly compliant. The training was appreciated with a 7.5 score and e-coaching with a 6.8 score. Appreciation of training and e-coaching, satisfaction with trainer and coach, and practical facilitation were significantly associated with compliance. The intervention was implemented well on the level of the mindfulness training, but poorly on the level of e-coaching and homework time investment. To increase compliance, attention should be paid to satisfaction and trainer-participant relationship.

Evaluating Web accessibility at different processing phases

NASA Astrophysics Data System (ADS)

Fernandes, N.; Lopes, R.; Carriço, L.

2012-09-01

Modern Web sites use several techniques (e.g. DOM manipulation) that allow for the injection of new content into their Web pages (e.g. AJAX), as well as manipulation of the HTML DOM tree. This has the consequence that the Web pages that are presented to users (i.e. after browser processing) are different from the original structure and content that is transmitted through HTTP communication (i.e. after browser processing). This poses a series of challenges for Web accessibility evaluation, especially on automated evaluation software. This article details an experimental study designed to understand the differences posed by accessibility evaluation after Web browser processing. We implemented a Javascript-based evaluator, QualWeb, that can perform WCAG 2.0 based accessibility evaluations in the two phases of browser processing. Our study shows that, in fact, there are considerable differences between the HTML DOM trees in both phases, which have the consequence of having distinct evaluation results. We discuss the impact of these results in the light of the potential problems that these differences can pose to designers and developers that use accessibility evaluators that function before browser processing.

Language barriers and qualitative nursing research: methodological considerations

PubMed Central

Squires, A.

2009-01-01

Aim This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Background Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. Conclusion By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation. PMID:19522941

Evaluating the implementation process of a participatory organizational level occupational health intervention in schools.

PubMed

Schelvis, Roosmarijn M C; Wiezer, Noortje M; Blatter, Birgitte M; van Genabeek, Joost A G M; Oude Hengel, Karen M; Bohlmeijer, Ernst T; van der Beek, Allard J

2016-12-01

The importance of process evaluations in examining how and why interventions are (un) successful is increasingly recognized. Process evaluations mainly studied the implementation process and the quality of the implementation (fidelity). However, in adopting this approach for participatory organizational level occupational health interventions, important aspects such as context and participants perceptions are missing. Our objective was to systematically describe the implementation process of a participatory organizational level occupational health intervention aimed at reducing work stress and increasing vitality in two schools by applying a framework that covers aspects of the intervention and its implementation as well as the context and participants perceptions. A program theory was developed, describing the requirements for successful implementation. Each requirement was operationalized by making use of the framework, covering: initiation, communication, participation, fidelity, reach, communication, satisfaction, management support, targeting, delivery, exposure, culture, conditions, readiness for change and perceptions. The requirements were assessed by quantitative and qualitative data, collected at 12 and 24 months after baseline in both schools (questionnaire and interviews) or continuously (logbooks). The intervention consisted of a needs assessment phase and a phase of implementing intervention activities. The needs assessment phase was implemented successfully in school A, but not in school B where participation and readiness for change were insufficient. In the second phase, several intervention activities were implemented at school A, whereas this was only partly the case in school B (delivery). In both schools, however, participants felt not involved in the choice of intervention activities (targeting, participation, support), resulting in a negative perception of and only partial exposure to the intervention activities. Conditions, culture and

Engaging the Somali community in the road safety agenda: a process evaluation from the London borough of Hounslow.

PubMed

Christie, Nicola; Sleney, Judith; Ahmed, Fatima; Knight, Elisabeth

2012-08-01

In the UK the most disadvantaged in society are more likely than those more affluent to be injured or killed in a road traffic collision and therefore it is a major cause of health inequality. There is a strong link between ethnicity, deprivation and injury. Whilst national road traffic injury data does not collect ethnic origin the London accident and analysis group does in terms of broad categories such as 'white', 'black' and 'Asian'. Analysis of this data revealed the over-representation of child pedestrian casualties from a 'black' ethnic origin. This information led road safety practitioners in one London borough to map child pedestrian casualties against census data which identified the Somali community as being particularly at risk of being involved in a road traffic collision. Working with the community they sought to discuss and address road safety issues and introduced practical evidence based approaches such as child pedestrian training. The process evaluation of the project used a qualitative approach and showed that engaging with community partners and working across organisational boundaries was a useful strategy to gain an understanding of the Somali community. A bottom approach provided the community with a sense of control and involvement which appears to add value in terms of reducing the sense of powerlessness that marginalised communities often feel. In terms of evaluation, small projects like these, lend themselves to a qualitative process evaluation though it has to be accepted that the strength of this evidence may be regarded as weak. Where possible routine injury data needs to take into account ethnicity which is a known risk factor for road casualty involvement which needs to be continually monitored.

Improved quality and more attractive work by applying EBM in disability evaluations: a qualitative survey.

PubMed

Hoving, Jan L; Kok, Rob; Ketelaar, Sarah M; Smits, Paul B A; van Dijk, Frank J H; Verbeek, Jos H

2016-02-29

The uptake of evidence in practice by physicians, even if they are trained in the systematic method of evidence-based medicine (EBM), remains difficult to improve. The aim of this study was to explore perceptions and experiences of physicians doing disability evaluations regarding motivators and preconditions for the implementation of EBM in daily practice. This qualitative study was nested in a cluster randomized controlled trial (Trial registration NTR1767; 20-apr-2009) evaluating the effects of training in EBM. The 45 physicians that participated received a comprehensive 6-months training program in EBM of which the last course day included audio-recorded interviews in groups. During these interviews participating physicians discussed perceptions and experiences regarding EBM application in daily practice. In an iterative process we searched for common motivators or preconditions for the implementation of EBM. Three main concepts or themes emerged after analyzing the transcriptions of the discussions: 1) improved quality of physicians' actions, such as clients benefiting from the application of EBM; 2) improved work attractiveness of physicians; and 3) preconditions that have to be met in order to work in an evidence-based manner including professional competence, facilitating material conditions and organizational support and demands. Physicians trained in EBM are motivated to use EBM because they perceive it as a factor improving the quality of their work and making their work more attractive. In addition to personal investments and gains, organizational support should further facilitate the uptake of evidence in practice.

Quantitative and Qualitative Evaluation of Iranian Researchers' Scientific Production in Dentistry Subfields.

PubMed

Yaminfirooz, Mousa; Motallebnejad, Mina; Gholinia, Hemmat; Esbakian, Somayeh

2015-10-01

As in other fields of medicine, scientific production in the field of dentistry has significant placement. This study aimed at quantitatively and qualitatively evaluating Iranian researchers' scientific output in the field of dentistry and determining their contribution in each of dentistry subfields and branches. This research was a scientometric study that applied quantitative and qualitative indices of Web of Science (WoS). Research population consisted of927indexed documents published under the name of Iran in the time span of 1993-2012 which were extracted from WoS on 10 March 2013. The Mann-Whitney test and Pearson correlation coefficient were used to data analyses in SPSS 19. 777 (83. 73%) of indexed items of all scientific output in WoS were scientific articles. The highest growth rate of scientific productionwith90% belonged to endodontic sub field. The correlation coefficient test showed that there was a significant positive relationship between the number of documents and their publication age (P < 0. 0001). There was a significant difference between the mean number of published articles in the first ten- year (1993-2003) and that of the second one (2004-2013), in favor of the latter (P = 0. 001). The distribution frequencies of scientific production in various subfields of dentistry were very different. It needs to reinforce the infrastructure for more balanced scientific production in the field and its related subfields.

Sick-listed workers' expectations about and experiences with independent medical evaluation: a qualitative interview study from Norway.

PubMed

Aamland, Aase; Maeland, Silje

2018-06-01

To reduce the country's sick leave rate, Norwegian politicians have suggested independent medical evaluations (IMEs) for sick-listed workers. IME was tested in a large, randomized controlled trial in one Norwegian county (Evaluation of IME in Norway, or 'the NIME trial'). The current study´s aim was to explore sick-listed workers' expectations about and experiences with participating in an IME. Nine individual semi-structured telephone interviews were conducted. Our convenience sample included six women and three men, aged 35-59 years, who had diverse medical reasons for being on sick leave. Systematic text condensation was used for analysis. The participants questioned both the IME purpose and timing, but felt a moral obligation to participate. Inadequate information provided by their general practitioner (GP) to the IME doctor was considered burdensome by several participants. However, most participants appreciated the IME as a positive discussion, even if they did not feel it had any impact on their follow-up or return-to-work process. According to the sick-listed workers the IMEs were administered too late and disturbed already initiated treatment processes and return to work efforts. Still, the consultation with the IME doctor was rated as a positive encounter, contrary to their expectations. Our results diverge from findings in other countries where experiences with IME consultations have been reported as predominantly negative. These findings, along with additional, upcoming evaluations, will serve as a basis for the Norwegian government's decision about whether to implement IMEs on a regular basis. Key points   Independent medical evaluations for sick-listed workers has been tested out in a large Norwegian RCT and will be evaluated through qualitative interviews with participating stakeholders and by assessing the effects on RTW and costs/benefits. In this study, we explored sick-listed workers' expectations about and experiences with participating in

[Qualitative evaluation of the alcoholism integral approach with the GIA model (alcoholism institutional groups)].

PubMed

Villafañe, Claudia I

2009-01-01

This paper presents the evaluation, over a period of 6 years, on the effectiveness of the Alcoholism Institutional Group (GIA), in the Puerto San Julián Hospital, Santa Cruz, Argentina. The theoretical framework refers to three aspects: subject, social and institutional order. The qualitative logic and the process of analytic induction were used. information was gathered through semi-structured interviews to selected cases (intentional sampling). The constant comparative method for the analysis was used. the GIA method is effective from the aspects of the subject and the social order; the subject included in the treatment was able to: a) deconstruct the socially assumed role as an alcoholic, b) reconstruct their identity, c) restore the fabric of family, labour and social links, d) identify the healthy aspects of their personality to recover the capacities obstructed by the illness, e) learn to solve conflicts collectively thanks to group functioning, f) report to destigmatize the illness, and g) develop a healthy life project. The GIA method proved partially effective from the institutional angle; the task succeeded in uncovering, affirming and working on alcoholism as an illness within the hospital setting, but with less involvement than other local institutions, which motivated projects and strategies started from the results of this research.

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

PubMed

Holtrop, Jodi Summers; Rabin, Borsika A; Glasgow, Russell E

2018-03-13

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Performance Evaluation Process.

ERIC Educational Resources Information Center

1998

This document contains four papers from a symposium on the performance evaluation process and human resource development (HRD). "Assessing the Effectiveness of OJT (On the Job Training): A Case Study Approach" (Julie Furst-Bowe, Debra Gates) is a case study of the effectiveness of OJT in one of a high-tech manufacturing company's product…

Qualitative data collection and analysis methods: the INSTINCT trial.

PubMed

Meurer, William J; Frederiksen, Shirley M; Majersik, Jennifer J; Zhang, Lingling; Sandretto, Annette; Scott, Phillip A

2007-11-01

Patient care practices often lag behind current scientific evidence and professional guidelines. The failure of such knowledge translation (KT) efforts may reflect inadequate assessment and management of specific barriers confronting both physicians and patients at the point of treatment level. Effective KT in this setting may benefit from the use of qualitative methods to identify and overcome these barriers. Qualitative methodology allows in-depth exploration of the barriers involved in adopting practice change and has been infrequently used in emergency medicine research. The authors describe the methodology for qualitative analysis within the INcreasing Stroke Treatment through INteractive behavioral Change Tactics (INSTINCT) trial. This includes processes for valid data collection and reliable analysis of the textual data from focus group and interview transcripts. INSTINCT is a 24-hospital, randomized, controlled study that is designed to evaluate a system-based barrier assessment and interactive educational intervention to increase appropriate tissue plasminogen activator (tPA) use in ischemic stroke. Intervention hospitals undergo baseline barrier assessment using both qualitative as well as quantitative (survey) techniques. Investigators obtain data on local barriers to tPA use, as well as information on local attitudes, knowledge, and beliefs regarding acute stroke treatment. Targeted groups at each site include emergency physicians, emergency nurses, neurologists, radiologists, and hospital administrators. Transcript analysis using NVivo7 with a predefined barrier taxonomy is described. This will provide both qualitative insight on thrombolytic use and importance of specific barrier types for each site. The qualitative findings subsequently direct the form of professional education efforts and system interventions at treatment sites.

A qualitative process evaluation of a randomised controlled trial of a parenting intervention in community (school) settings for children at risk of attention deficit hyperactivity disorder (ADHD).

PubMed

Taylor, John A; Valentine, Althea Z; Sellman, Edward; Bransby-Adams, Kate; Daley, David; Sayal, Kapil

2015-11-17

Interventions for parents of children experiencing emotional and/or behavioural difficulties can help to improve their children's health, educational and social outcomes. However, the desirability and acceptability of screening and offering such interventions for attention-deficit hyperactivity disorder (ADHD)-type problems are currently unclear. This article is a qualitative process evaluation of a pragmatic cluster randomised controlled trial (Trial registration: ISRCTN87634685; reported elsewhere) to assess the feasibility and acceptability of a school-based parenting intervention programme for parents and teachers of children with high levels of ADHD symptoms. Parents (n = 22) and teaching staff (n = 29) took part in semi-structured group or individual interviews, either by telephone or face-to-face, following the main trial. Interviews were digitally-recorded, transcribed verbatim and subjected to thematic analysis. The parenting intervention was acceptable to parents and teachers, and they were enthusiastic about the need for parenting groups in the school environment and stressed the importance of parent-school collaboration. Parents generally stated a preference for universal recruitment approaches to such programmes whilst teachers described the need to target specific parents. Most parents who took part in the parenting intervention described it favourably and many saw benefits, at least in the short-term. Parents differed in their preferred group size, with some desiring one-to-one sessions and others favouring a larger group. Non-attending parents reported barriers to attendance such as fear of attending in a group, previous use of the programme, work and other commitments. Suggestions to improve the programme included: clearer communication; offering booster sessions; and greater collaboration with teachers. It is feasible to deliver parenting intervention programmes within or near schools. The intervention was acceptable to the majority of

Concurrent analysis: towards generalisable qualitative research.

PubMed

Snowden, Austyn; Martin, Colin R

2011-10-01

This study develops an original method of qualitative analysis coherent with its interpretivist principles. The objective is to increase the likelihood of achieving generalisability and so improve the chance of the findings being translated into practice. Good qualitative research depends on coherent analysis of different types of data. The limitations of existing methodologies are first discussed to justify the need for a novel approach. To illustrate this approach, primary evidence is presented using the new methodology. The primary evidence consists of a constructivist grounded theory of how mental health nurses with prescribing authority integrate prescribing into practice. This theory is built concurrently from interviews, reflective accounts and case study data from the literature. Concurrent analysis. Ten research articles and 13 semi-structured interviews were sampled purposively and then theoretically and analysed concurrently using constructivist grounded theory. A theory of the process of becoming competent in mental health nurse prescribing was generated through this process. This theory was validated by 32 practising mental health nurse prescribers as an accurate representation of their experience. The methodology generated a coherent and generalisable theory. It is therefore claimed that concurrent analysis engenders consistent and iterative treatment of different sources of qualitative data in a manageable manner. This process supports facilitation of the highest standard of qualitative research. Concurrent analysis removes the artificial delineation of relevant literature from other forms of constructed data. This gives researchers clear direction to treat qualitative data consistently raising the chances of generalisability of the findings. Raising the generalisability of qualitative research will increase its chances of informing clinical practice. © 2010 Blackwell Publishing Ltd.

Project evaluation process manual

DOT National Transportation Integrated Search

1997-07-01

Describes the process for evaluating airport environments, safety standards, airport infrastructure, licensing standards and multitransportational systems. The project rating system is intended to be used for determining state and federal funding.

Cooking, Healthy Eating, Fitness and Fun (CHEFFs): Qualitative Evaluation of a Nutrition Education Program for Children Living at Urban Family Homeless Shelters

PubMed Central

Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-01-01

Objectives. We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. Methods. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants’ understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. Results. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children’s knowledge and understanding of content, (2) children’s shift in attitudes or intentions, and (3) interpretations through children’s life experience. Food insecurity as well as shelter food service and policies were important influences on children’s choices, hunger, and sense of well-being. Conclusions. Children’s experiences highlighted the need to advocate for shelter policies that adequately provide for children’s nutritional and physical activity requirements and foster academic development. PMID:24148062

Cooking, healthy eating, fitness and fun (CHEFFs): qualitative evaluation of a nutrition education program for children living at urban family homeless shelters.

PubMed

Rodriguez, Jacqueline; Applebaum, Jo; Stephenson-Hunter, Cara; Tinio, Andrea; Shapiro, Alan

2013-12-01

We assessed the feasibility of a 15-week nutrition education, physical activity, and media literacy program for children living in urban family homeless shelters. We developed a qualitative monitoring tool to evaluate program process and impact at 2 shelter sites in the Bronx, New York, from 2009 to 2012. Facilitators recorded indications of participants' understanding of intended messages and demonstrations of changes in attitudes and behaviors. Comments, insights, and actions were recorded as they occurred. Facilitators also documented barriers to delivery of content and activities as intended. We used content analysis to examine data for patterns and identify themes. A total of 162 children participated at the 2 shelter sites. Analysis of qualitative data yielded 3 themes: (1) children's knowledge and understanding of content, (2) children's shift in attitudes or intentions, and (3) interpretations through children's life experience. Food insecurity as well as shelter food service and policies were important influences on children's choices, hunger, and sense of well-being. Children's experiences highlighted the need to advocate for shelter policies that adequately provide for children's nutritional and physical activity requirements and foster academic development.

Genetic toxicology at the crossroads-from qualitative hazard evaluation to quantitative risk assessment.

PubMed

White, Paul A; Johnson, George E

2016-05-01

Applied genetic toxicology is undergoing a transition from qualitative hazard identification to quantitative dose-response analysis and risk assessment. To facilitate this change, the Health and Environmental Sciences Institute (HESI) Genetic Toxicology Technical Committee (GTTC) sponsored a workshop held in Lancaster, UK on July 10-11, 2014. The event included invited speakers from several institutions and the contents was divided into three themes-1: Point-of-departure Metrics for Quantitative Dose-Response Analysis in Genetic Toxicology; 2: Measurement and Estimation of Exposures for Better Extrapolation to Humans and 3: The Use of Quantitative Approaches in Genetic Toxicology for human health risk assessment (HHRA). A host of pertinent issues were discussed relating to the use of in vitro and in vivo dose-response data, the development of methods for in vitro to in vivo extrapolation and approaches to use in vivo dose-response data to determine human exposure limits for regulatory evaluations and decision-making. This Special Issue, which was inspired by the workshop, contains a series of papers that collectively address topics related to the aforementioned themes. The Issue includes contributions that collectively evaluate, describe and discuss in silico, in vitro, in vivo and statistical approaches that are facilitating the shift from qualitative hazard evaluation to quantitative risk assessment. The use and application of the benchmark dose approach was a central theme in many of the workshop presentations and discussions, and the Special Issue includes several contributions that outline novel applications for the analysis and interpretation of genetic toxicity data. Although the contents of the Special Issue constitutes an important step towards the adoption of quantitative methods for regulatory assessment of genetic toxicity, formal acceptance of quantitative methods for HHRA and regulatory decision-making will require consensus regarding the

On Becoming Allies: A Qualitative Study of Lesbian-, Gay-, and Bisexual-Affirmative Counselor Training

ERIC Educational Resources Information Center

Dillon, Frank R.; Worthington, Roger L.; Savoy, Holly Bielstein; Rooney, S. Craig; Becker-Schutte, Ann; Guerra, Rachael M.

2004-01-01

The authors present a qualitative analysis of a process by which a research team of counselors-in-training confronted their heterosexist biases while investigating heterosexual attitudes toward sexual minorities. Members of the research team discovered that it was essential to reflect on and evaluate their attitudes, assumptions, and biases before…

Ayurvedic versus conventional dietary and lifestyle counseling for mothers with burnout-syndrome: A randomized controlled pilot study including a qualitative evaluation.

PubMed

Kessler, Christian S; Eisenmann, Clemens; Oberzaucher, Frank; Forster, Martin; Steckhan, Nico; Meier, Larissa; Stapelfeldt, Elmar; Michalsen, Andreas; Jeitler, Michael

2017-10-01

Ayurveda claims to be effective in the treatment of psychosomatic disorders by means of lifestyle and nutritional counseling. In a randomized controlled study mothers with burnout were randomized into two groups: Ayurvedic nutritional counseling (according to tradition), and conventional nutritional counseling (following the recommendations of a family doctor). Patients received five counseling sessions over twelve weeks. Outcomes included levels of burnout, quality of life, sleep, stress, depression/anxiety, and spirituality at three and six months. It also included a qualitative evaluation of the communication processes. We randomized thirty four patients; twenty three participants were included in the per protocol analysis. No significant differences were observed between the groups. However, significant and clinically relevant intra-group mean changes for the primary outcome burnout, and secondary outcomes sleep, stress, depression and mental health were only found in the Ayurveda group. The qualitative part of the study identified different conversational styles and counseling techniques between the two study groups. In conventional consultations questions tended to be category bound, while counseling-advice was predominantly admonitory. The Ayurvedic practitioner used open-ended interrogative forms, devices for displaying understanding, and positive re-evaluation more frequently, leading to an overall less asymmetrical interaction. We found positive effects for both groups, which however were more pronounced in the Ayurvedic group. The conversational and counseling techniques in the Ayurvedic group offered more opportunities for problem description by patients as well as patient-centered practice and resource-oriented recommendations by the physician. NCT01797887. Copyright © 2017 Elsevier Ltd. All rights reserved.

Determining the disease management process for epileptic patients: A qualitative study

PubMed Central

Hosseini, Nazafarin; Sharif, Farkhondeh; Ahmadi, Fazlollah; Zare, Mohammad

2016-01-01

Background: Epilepsy exposes patients to many physical, social, and emotional challenges. Thus, it seems to portray a complex picture and needs holistic care. Medical treatment and psychosocial part of epilepsy remain central to managing and improving the patient's qualify of life through team efforts. Some studies have shown the dimensions of self-management, but its management process of epilepsy patients, especially in Iran, is not clear. This study aimed to determine the disease management process in patients with epilepsy in Iran. Materials and Methods: This qualitative approach and grounded theory study was conducted from January 2009 to February 2012 in Isfahan city (Iran). Thirty-two participants were recruited by the goal-oriented, and snowball sample selection and theoretical sampling methods. After conducting a total of 43 in-depth interviews with the participants, the researchers reached data saturation. Data were analyzed using Strauss and Corbin method. Results: With a focus on disease management process, researchers found three main themes and seven sub-themes as a psychosocial process (PSP). The main themes were: perception of threat to self-identity, effort to preserve self-identity, and burn out. The psychosocial aspect of the disease generated one main variable “the perception of identity loss” and one central variable “searching for self-identity.” Conclusions: Participants attributed threat to self-identity and burn out to the way their disease was managed requiring efforts to preserve their identity. Recommendations consist of support programs and strategies to improve the public perception of epilepsy in Iran, help patients accept their condition and preserve self-identity, and most importantly, enhance medical management of epilepsy. PMID:26985223

A multimedia campaign to improve back beliefs in patients with non-specific low back pain: a process evaluation.

PubMed

Suman, Arnela; Schaafsma, Frederieke G; Bamarni, Jiman; van Tulder, Maurits W; Anema, Johannes R

2017-05-18

Low back pain (LBP) is one of the most prevalent and costly disorders worldwide. To reduce its burden in the Netherlands, implementation of a multidisciplinary guideline for LBP was supported by a multifaceted eHealth campaign for patients with LBP. The current study aims 1) to evaluate whether the implementation strategy was performed as planned; 2) to assess the feasibility, barriers and facilitators of the patient based eHealth campaign; 3) to gain insight into the satisfaction and experiences of patients with various ethnic backgrounds with the implementation strategy and to make a comparison between them; and 4) to explore the association between exposure to and satisfaction with the implementation strategy. This process evaluation was performed using the Linnan and Steckler framework, and used a mixed methods approach for data collection and analysis. The relationship between satisfaction of patients and exposure to the strategy was statistically examined. Semi-structured interviews were analysed using qualitative data analysis methods. Two hundred and fourteen patients participated in the quantitative, and 44 in the qualitative analysis. Most were female and had a high level of education. Many patients did not use the campaign at all or only once, and those that did rated it as reasonable. Patient satisfaction with the campaign increased significantly with an increase in its use. Qualitative analysis showed that four main themes played a role in campaign rating and use: satisfaction with intervention components, perceived benefits of the intervention, usage of the intervention, and satisfaction with the medium used. This process evaluation showed that the eHealth campaign was used only by a small proportion of patients with non-specific LBP. It seemed that the campaign was offered to the patients too late, that the lay-out of the campaign did not meet patient needs, and that healthcare providers rarely discussed the campaign with their patients, while

Online Communication Settings and the Qualitative Research Process: Acclimating Students and Novice Researchers.

PubMed

Gregory, Katherine

2018-06-01

In the last 20 years, qualitative research scholars have begun to interrogate methodological and analytic issues concerning online research settings as both data sources and instruments for digital methods. This article examines the adaptation of parts of a qualitative research curriculum for understanding online communication settings. I propose methodological best practices for researchers and educators that I developed while teaching research methods to undergraduate and graduate students across disciplinary departments and discuss obstacles faced during my own research while gathering data from online sources. This article confronts issues concerning the disembodied aspects of applying what in practice should be rooted in a humanistic inquiry. Furthermore, as some approaches to online qualitative research as a digital method grow increasingly problematic with the development of new data mining technologies, I will also briefly touch upon borderline ethical practices involving data-scraping-based qualitative research.

Enhancing the quality and credibility of qualitative analysis.

PubMed

Patton, M Q

1999-12-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems.

Enhancing the quality and credibility of qualitative analysis.

PubMed Central

Patton, M Q

1999-01-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems. PMID:10591279

A Review of Qualitative Data Gathering Methods and Their Applications To Support Organizational Strategic Planning Processes. Study Number Six.

ERIC Educational Resources Information Center

Wright, Phillip C.; Geroy, Gary D.

Exploring existing methodologies to determine whether they can be adapted or adopted to support strategic goal setting, this paper focuses on information gathering techniques as they relate to the human resource development professional's input into strategic planning processes. The information gathering techniques are all qualitative methods and…

The Adoption Process of Ricefield-Based Fish Seed Production in Northwest Bangladesh: An Understanding through Quantitative and Qualitative Investigation

ERIC Educational Resources Information Center

Haque, Mohammad Mahfujul; Little, David C.; Barman, Benoy K.; Wahab, Md. Abdul

2010-01-01

Purpose: The purpose of the study was to understand the adoption process of ricefield based fish seed production (RBFSP) that has been developed, promoted and established in Northwest Bangladesh. Design/Methodology/Approach: Quantitative investigation based on regression analysis and qualitative investigation using semi-structured interview were…

Validation of quantitative and qualitative methods for detecting allergenic ingredients in processed foods in Japan.

PubMed

Sakai, Shinobu; Adachi, Reiko; Akiyama, Hiroshi; Teshima, Reiko

2013-06-19

A labeling system for food allergenic ingredients was established in Japan in April 2002. To monitor the labeling, the Japanese government announced official methods for detecting allergens in processed foods in November 2002. The official methods consist of quantitative screening tests using enzyme-linked immunosorbent assays (ELISAs) and qualitative confirmation tests using Western blotting or polymerase chain reactions (PCR). In addition, the Japanese government designated 10 μg protein/g food (the corresponding allergenic ingredient soluble protein weight/food weight), determined by ELISA, as the labeling threshold. To standardize the official methods, the criteria for the validation protocol were described in the official guidelines. This paper, which was presented at the Advances in Food Allergen Detection Symposium, ACS National Meeting and Expo, San Diego, CA, Spring 2012, describes the validation protocol outlined in the official Japanese guidelines, the results of interlaboratory studies for the quantitative detection method (ELISA for crustacean proteins) and the qualitative detection method (PCR for shrimp and crab DNAs), and the reliability of the detection methods.

Career Counseling Process: A Qualitative Analysis of Experts' Cases

ERIC Educational Resources Information Center

Whiston, Susan C.; Lindeman, Dawn; Rahardja, Daryn; Reed, Jordan H.

2005-01-01

A consensual qualitative research methodology was used to analyze the career counseling cases of 12 noted vocational psychologists to identify common themes and factors. The findings indicated that the career counseling described by these experts often involved the same counseling or helping skills found in personal counseling or psychotherapy.…

Discrete event simulation tool for analysis of qualitative models of continuous processing systems

NASA Technical Reports Server (NTRS)

Malin, Jane T. (Inventor); Basham, Bryan D. (Inventor); Harris, Richard A. (Inventor)

1990-01-01

An artificial intelligence design and qualitative modeling tool is disclosed for creating computer models and simulating continuous activities, functions, and/or behavior using developed discrete event techniques. Conveniently, the tool is organized in four modules: library design module, model construction module, simulation module, and experimentation and analysis. The library design module supports the building of library knowledge including component classes and elements pertinent to a particular domain of continuous activities, functions, and behavior being modeled. The continuous behavior is defined discretely with respect to invocation statements, effect statements, and time delays. The functionality of the components is defined in terms of variable cluster instances, independent processes, and modes, further defined in terms of mode transition processes and mode dependent processes. Model construction utilizes the hierarchy of libraries and connects them with appropriate relations. The simulation executes a specialized initialization routine and executes events in a manner that includes selective inherency of characteristics through a time and event schema until the event queue in the simulator is emptied. The experimentation and analysis module supports analysis through the generation of appropriate log files and graphics developments and includes the ability of log file comparisons.

Bridging the gap between the economic evaluation literature and daily practice in occupational health: a qualitative study among decision-makers in the healthcare sector.

PubMed

van Dongen, Johanna M; Tompa, Emile; Clune, Laurie; Sarnocinska-Hart, Anna; Bongers, Paulien M; van Tulder, Maurits W; van der Beek, Allard J; van Wier, Marieke F

2013-06-03

Continued improvements in occupational health can only be ensured if decisions regarding the implementation and continuation of occupational health and safety interventions (OHS interventions) are based on the best available evidence. To ensure that this is the case, scientific evidence should meet the needs of decision-makers. As a first step in bridging the gap between the economic evaluation literature and daily practice in occupational health, this study aimed to provide insight into the occupational health decision-making process and information needs of decision-makers. An exploratory qualitative study was conducted with a purposeful sample of occupational health decision-makers in the Ontario healthcare sector. Eighteen in-depth interviews were conducted to explore the process by which occupational health decisions are made and the importance given to the financial implications of OHS interventions. Twenty-five structured telephone interviews were conducted to explore the sources of information used during the decision-making process, and decision-makers' knowledge on economic evaluation methods. In-depth interview data were analyzed according to the constant comparative method. For the structured telephone interviews, summary statistics were prepared. The occupational health decision-making process generally consists of three stages: initiation stage, establishing the need for an intervention; pre-implementation stage, developing an intervention and its business case in order to receive senior management approval; and implementation and evaluation stage, implementing and evaluating an intervention. During this process, information on the financial implications of OHS interventions was found to be of great importance, especially the employer's costs and benefits. However, scientific evidence was rarely consulted, sound ex-post program evaluations were hardly ever performed, and there seemed to be a need to advance the economic evaluation skill set of

Rural Principals and the North Carolina Teacher Evaluation Process: How Has the Transition from the TPAI-R to the New Evaluation Process Changed Principals' Evaluative Practices?

ERIC Educational Resources Information Center

Fuller, Charles Avery

2016-01-01

Beginning with the 2010-2011 school year the North Carolina State Board of Education (SBE) mandated the use of the North Carolina Teacher Evaluation Process (Evaluation Process) for use in all public school systems in the state to conduct teacher observations and evaluations. The Evaluation Process replaced the Teacher Performance Appraisal…

A Qualitative Approach to the Evaluation of Expert Systems Shells.

ERIC Educational Resources Information Center

Slawson, Dean A.; And Others

This study explores an approach to the evaluation of expert system shells using case studies. The methodology and some of the results of an evaluation of the prototype development of an expert system using the shell "M1" are detailed, including a description of the participants and the project, the data collection process and materials,…

Can small stores have a big impact? A qualitative evaluation of a store fruit and vegetable initiative.

PubMed

Gardiner, Breeana; Blake, Miranda; Harris, Raeleigh; Gee, Carena; Charaktis, Stella; Choong, Christine; Lade, Rebecca; Duff, Laura; Palermo, Claire

2013-12-01

The aim of this evaluation was to explore the quality, barriers, enablers and outcomes of a retail fresh fruit and vegetable initiative in rural communities identified to have poor geographic access to healthy food. A qualitative evaluation using in-depth interviews was conducted with rural store retailers across Victoria involved in the implementation of a retail fruit and vegetable initiative. Data were analysed using a thematic approach. Six of the 13 store retailers that were engaged in the initiative identified a range of qualities, barriers, enablers and outcomes. They reported that effective communication is essential for engaging retailers and sustaining participation. The choice and use of retail incentives may influence the community's purchase of fruit and vegetables. The community's attitude to fruit and vegetables, the staff's ability to promote produce and the capacity of the store to stock and sell fresh fruit and vegetables influenced perceived success. Barriers included difficulties receiving a regular supply of fresh fruit and vegetables, time constraints and storage facilities. This qualitative evaluation of a retail fruit and vegetable initiative found that effective leadership and communication from project workers, a range of retail incentives and the capacity of the store to promote, stock and sell fresh fruit and vegetables influenced perceived success. SO WHAT?: Fruit and vegetable retail initiatives in small rural community stores may have a role in supporting consumption of fruit and vegetables.

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study

PubMed Central

2014-01-01

to the challenges of publishing this research. Conclusions Health researchers combining qualitative research and trials viewed this practice as strengthening evaluative research. Teams viewing the qualitative research as essential to the trial, and resourcing it in practice, may have a better chance of delivering its added value to the trial. PMID:24913438

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study.

PubMed

O'Cathain, Alicia; Goode, Jackie; Drabble, Sarah J; Thomas, Kate J; Rudolph, Anne; Hewison, Jenny

2014-06-09

. Health researchers combining qualitative research and trials viewed this practice as strengthening evaluative research. Teams viewing the qualitative research as essential to the trial, and resourcing it in practice, may have a better chance of delivering its added value to the trial.

A person-centered integrated care quality framework, based on a qualitative study of patients' evaluation of care in light of chronic care ideals.

PubMed

Berntsen, Gro; Høyem, Audhild; Lettrem, Idar; Ruland, Cornelia; Rumpsfeld, Markus; Gammon, Deede

2018-06-20

Person-Centered Integrated Care (PC-IC) is believed to improve outcomes and experience for persons with multiple long-term and complex conditions. No broad consensus exists regarding how to capture the patient-experienced quality of PC-IC. Most PC-IC evaluation tools focus on care events or care in general. Building on others' and our previous work, we outlined a 4-stage goal-oriented PC-IC process ideal: 1) Personalized goal setting 2) Care planning aligned with goals 3) Care delivery according to plan, and 4) Evaluation of goal attainment. We aimed to explore, apply, refine and operationalize this quality of care framework. This paper is a qualitative evaluative review of the individual Patient Pathways (iPP) experiences of 19 strategically chosen persons with multimorbidity in light of ideals for chronic care. The iPP includes all care events, addressing the persons collected health issues, organized by time. We constructed iPPs based on the electronic health record (from general practice, nursing services, and hospital) with patient follow-up interviews. The application of the framework and its refinement were parallel processes. Both were based on analysis of salient themes in the empirical material in light of the PC-IC process ideal and progressively more informed applications of themes and questions. The informants consistently reviewed care quality by how care supported/ threatened their long-term goals. Personal goals were either implicit or identified by "What matters to you?" Informants expected care to address their long-term goals and placed responsibility for care quality and delivery at the system level. The PC-IC process framework exposed system failure in identifying long-term goals, provision of shared long-term multimorbidity care plans, monitoring of care delivery and goal evaluation. The PC-IC framework includes descriptions of ideal care, key questions and literature references for each stage of the PC-IC process. This first version of a PC

Quality nursing care: a qualitative enquiry.

PubMed

Hogston, R

1995-01-01

In spite of the wealth of literature on quality nursing care, a disparity exists in defining quality. The purpose of this study was an attempt to seek out practising nurses' perceptions of quality nursing care and to present a definition of quality as described by nurses. Eighteen nurses from a large hospital in the south of England were interviewed. Qualitative analysis based on a modified grounded theory approach revealed three categories described as 'structure', 'process' and 'outcome'. This supports previous work on evaluating quality care but postulates that structure, process and outcome could also be used as a mechanism for defining quality. The categories are defined by using the words of the informants in order to explain the essential attributes of quality nursing care. The findings demonstrate how more informants cited quality in terms of process and outcome than structure. It is speculated that the significance of this rests with the fact that nurses have direct control over process and outcome whereas the political and economic climate in which nurses work is beyond their control and decisions over structure lie with their managers.

A quantitative evaluation of a qualitative risk assessment framework: Examining the assumptions and predictions of the Productivity Susceptibility Analysis (PSA)

PubMed Central

2018-01-01

Qualitative risk assessment frameworks, such as the Productivity Susceptibility Analysis (PSA), have been developed to rapidly evaluate the risks of fishing to marine populations and prioritize management and research among species. Despite being applied to over 1,000 fish populations, and an ongoing debate about the most appropriate method to convert biological and fishery characteristics into an overall measure of risk, the assumptions and predictive capacity of these approaches have not been evaluated. Several interpretations of the PSA were mapped to a conventional age-structured fisheries dynamics model to evaluate the performance of the approach under a range of assumptions regarding exploitation rates and measures of biological risk. The results demonstrate that the underlying assumptions of these qualitative risk-based approaches are inappropriate, and the expected performance is poor for a wide range of conditions. The information required to score a fishery using a PSA-type approach is comparable to that required to populate an operating model and evaluating the population dynamics within a simulation framework. In addition to providing a more credible characterization of complex system dynamics, the operating model approach is transparent, reproducible and can evaluate alternative management strategies over a range of plausible hypotheses for the system. PMID:29856869

Evaluation of interventions on road traffic injuries in Peru: a qualitative approach.

PubMed

Huicho, Luis; Adam, Taghreed; Rosales, Edmundo; Paca-Palao, Ada; López, Luis; Luna, Diego; Miranda, J Jaime

2012-01-23

Evaluation of interventions on road traffic injuries (RTI) going beyond the assessment of impact to include factors underlying success or failure is an important complement to standard impact evaluations. We report here how we used a qualitative approach to assess current interventions implemented to reduce RTIs in Peru. We performed in-depth interviews with policymakers and technical officers involved in the implementation of RTI interventions to get their insight on design, implementation and evaluation aspects. We then conducted a workshop with key stakeholders to analyze the results of in-depth interviews, and to further discuss and identify key programmatic considerations when designing and implementing RTI interventions. We finally performed brainstorming sessions to assess potential system-wide effects of a selected intervention (Zero Tolerance), and to identify adaptation and redesign needs for this intervention. Key programmatic components were consistently identified that should be considered when designing and implementing RTI interventions. They include effective and sustained political commitment and planning; sufficient and sustained budget allocation; training, supervision, monitoring and evaluation of implemented policies; multisectoral participation; and strong governance and accountability. Brainstorming sessions revealed major negative effects of the selected intervention on various system building blocks. Our approach revealed substantial caveats in current RTI interventions in Peru, and fundamental negative effects on several components of the sectors and systems involved. It also highlighted programmatic issues that should be applied to guarantee an effective implementation and evaluation of these policies. The findings from this study were discussed with key stakeholders for consideration in further designing and planning RTI control interventions in Peru.

A Qualitative Exploration of First Generation College Students and the Use of Facebook in the College Choice Selection Process

ERIC Educational Resources Information Center

Coker, Cindy E.

2015-01-01

The purpose of this exploratory phenomenological narrative qualitative study was to investigate the influence of Facebook on first-generation college students' selection of a college framed within Hossler and Gallagher's (1987) college process model. The three questions which guided this research explored the influence of the social media website…

Qualitative and quantitative reasoning about thermodynamics

NASA Technical Reports Server (NTRS)

Skorstad, Gordon; Forbus, Ken

1989-01-01

One goal of qualitative physics is to capture the tacit knowledge of engineers and scientists. It is shown how Qualitative Process theory can be used to express concepts of engineering thermodynamics. In particular, it is shown how to integrate qualitative and quantitative knowledge to solve textbook problems involving thermodynamic cycles, such as gas turbine plants and steam power plants. These ideas were implemented in a program called SCHISM. Its analysis of a sample textbook problem is described and plans for future work are discussed.

Implementing nutrition guidelines for older people in residential care homes: a qualitative study using Normalization Process Theory.

PubMed

Bamford, Claire; Heaven, Ben; May, Carl; Moynihan, Paula

2012-10-30

Optimizing the dietary intake of older people can prevent nutritional deficiencies and diet-related diseases, thereby improving quality of life. However, there is evidence that the nutritional intake of older people living in care homes is suboptimal, with high levels of saturated fat, salt, and added sugars. The UK Food Standards Agency therefore developed nutrient- and food-based guidance for residential care homes. The acceptability of these guidelines and their feasibility in practice is unknown. This study used the Normalization Process Theory (NPT) to understand the barriers and facilitators to implementing the guidelines and inform future implementation. We conducted a process evaluation in five care homes in the north of England using qualitative methods (observation and interviews) to explore the views of managers, care staff, catering staff, and domestic staff. Data were analyzed thematically and discussed in data workshops; emerging themes were then mapped to the constructs of NPT. Many staff perceived the guidelines as unnecessarily restrictive and irrelevant to older people. In terms of NPT, the guidelines simply did not make sense (coherence), and as a result, relatively few staff invested in the guidelines (cognitive participation). Even where staff supported the guidelines, implementation was hampered by a lack of nutritional knowledge and institutional support (collective action). Finally, the absence of observable benefits to clients confirmed the negative preconceptions of many staff, with limited evidence of reappraisal following implementation (reflexive monitoring). The successful implementation of the nutrition guidelines requires that the fundamental issues relating to their perceived value and fit with other priorities and goals be addressed. Specialist support is needed to equip staff with the technical knowledge and skills required for menu analysis and development and to devise ways of evaluating the outcomes of modified menus. NPT

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

'It's trying to manage the work': a qualitative evaluation of recruitment processes within a UK multicentre trial.

PubMed

Skea, Zoë Christina; Treweek, Shaun; Gillies, Katie

2017-08-11

To explore trial site staff's perceptions regarding barriers and facilitators to local recruitment. Qualitative semi-structured interviews with a range of trial site staff from four trial sites in the UK. Interviews were analysed thematically to identify common themes across sites, barriers that could be addressed and facilitators that could be shared with other sites. 11 members of staff from four trial sites: clinical grant Co-applicant (n=1); Principal Investigators (n=3); Consultant Urologist (n=1); Research Nurses (n=5); Research Assistant (n=1). Embedded within an ongoing randomised controlled trial (the TISU trial). TISU is a UK multicentre trial comparing therapeutic interventions for ureteric stones. Our study draws attention to the initial and ongoing burden of trial work that is involved throughout the duration of a clinical trial. In terms of building and sustaining a research culture, trial staff described the ongoing work of engagement that was required to ensure that clinical staff were both educated and motivated to help with the process of identifying and screening potential participants. Having adequate and sufficient organisational and staffing resources was highlighted as being a necessary prerequisite to successful recruitment both in terms of accessing potentially eligible patients and being able to maximise recruitment after patient identification. The nature of the research study design can also potentially generate challenging communicative work for recruiting staff which can prove particularly problematic. Our paper adds to existing research highlighting the importance of the hidden and complex work that is involved in clinical trial recruitment. Those designing and supporting the operationalisation of clinical trials must recognise and support the mitigation of this 'work'. While much of the work is likely to be contextually sensitive at the level of local sites and for individual trials, some aspects are ubiquitous issues for delivery of

Process evaluation of a walking programme delivered through the workplace in the South Pacific island Vanuatu.

PubMed

Siefken, Katja; Schofield, Grant; Schulenkorf, Nico

2015-06-01

The South Pacific region is experiencing significant rates of chronic diseases. Well-evaluated health promotion programmes are needed as a central piece of a strategic solution. Just as important as the evaluation itself is how that evaluation outcome can be communicated for future programme use by local programme planners. The objective of this study is to evaluate a physical activity (PA) programme that was designed for Pacific women in urban Vanuatu, and subsequently to develop new techniques to display data that support the understanding and communication of programme success and challenges. Data collection methods included quantitative Likert scale questions and qualitative open-ended questions. A new analysis technique visualises open-ended process evaluation data. We present themes using word sizes proportional to the frequency of the themes identified through thematic analysis. The Likert scale technique revealed little meaningful information; almost all participants rated most elements of the programme highly. This may be related to Pacific people being frequently inclined to assent with external ideas. Open-ended questions provided more significant insights. For example, we found a stronger change in eating habits (68.9%) than in exercise behaviour (28.2%). We present an evaluation of the first pedometer-based PA intervention in the Pacific and respond to the paucity of process evaluations that have been carried out in the context of low- and middle-income countries. Moreover, the new thematic data visualisation (TDV) approach may aid in understanding complex and cluttered data in a constructive and coordinated way; we present a new approach in health promotion research. © The Author(s) 2014.

Computing in Qualitative Analysis: A Healthy Development?

ERIC Educational Resources Information Center

Richards, Lyn; Richards, Tom

1991-01-01

Discusses the potential impact of computers in qualitative health research. Describes the original goals, design, and implementation of NUDIST, a qualitative computing software. Argues for evaluation of the impact of computer techniques and for an opening of debate among program developers and users to address the purposes and power of computing…

Constructing core competency indicators for clinical teachers in Taiwan: a qualitative analysis and an analytic hierarchy process

PubMed Central

2014-01-01

Background The objective of this study was to construct a framework of core competency indicators of medical doctors who teach in the clinical setting in Taiwan and to evaluate the relative importance of the indicators among these clinical teachers. Methods The preliminary framework of the indicators was developed from an in-depth interview conducted with 12 clinical teachers who had previously been recognized and awarded for their teaching excellence in university hospitals. The framework was categorized into 4 dimensions: 1) Expertise (i.e., professional knowledge and skill); 2) Teaching Ability; 3) Attitudes and Traits; and 4) Beliefs and Values. These areas were further divided into 11 sub-dimensions and 40 indicators. Subsequently, a questionnaire built upon this qualitative analysis was distributed to another group of 17 clinical teachers. Saaty’s eigenvector approach, or the so-called analytic hierarchy process (AHP), was applied to perform the pairwise comparisons between indicators and to determine the ranking and relative importance of the indicators. Results Fourteen questionnaires were deemed valid for AHP assessment due to completeness of data input. The relative contribution of the four main dimensions was 31% for Attitudes and Traits, 30% for Beliefs and Values, 22% for Expertise, and 17% for Teaching Ability. Specifically, 9 out of the 10 top-ranked indicators belonged to the “Attitudes and Traits” or “Beliefs and Values” dimensions, indicating that inner characteristics (i.e., attitudes, traits, beliefs, and values) were perceived as more important than surface ones (i.e., professional knowledge, skills, and teaching competency). Conclusion We performed a qualitative analysis and developed a questionnaire based upon an interview with experienced clinical teachers in Taiwan, and used this tool to construct the key features for the role model. The application has also demonstrated the relative importance in the dimensions of the core

Constructing core competency indicators for clinical teachers in Taiwan: a qualitative analysis and an analytic hierarchy process.

PubMed

Li, Ai-Tzu; Lin, Jou-Wei

2014-04-11

The objective of this study was to construct a framework of core competency indicators of medical doctors who teach in the clinical setting in Taiwan and to evaluate the relative importance of the indicators among these clinical teachers. The preliminary framework of the indicators was developed from an in-depth interview conducted with 12 clinical teachers who had previously been recognized and awarded for their teaching excellence in university hospitals. The framework was categorized into 4 dimensions: 1) Expertise (i.e., professional knowledge and skill); 2) Teaching Ability; 3) Attitudes and Traits; and 4) Beliefs and Values. These areas were further divided into 11 sub-dimensions and 40 indicators. Subsequently, a questionnaire built upon this qualitative analysis was distributed to another group of 17 clinical teachers. Saaty's eigenvector approach, or the so-called analytic hierarchy process (AHP), was applied to perform the pairwise comparisons between indicators and to determine the ranking and relative importance of the indicators. Fourteen questionnaires were deemed valid for AHP assessment due to completeness of data input. The relative contribution of the four main dimensions was 31% for Attitudes and Traits, 30% for Beliefs and Values, 22% for Expertise, and 17% for Teaching Ability. Specifically, 9 out of the 10 top-ranked indicators belonged to the "Attitudes and Traits" or "Beliefs and Values" dimensions, indicating that inner characteristics (i.e., attitudes, traits, beliefs, and values) were perceived as more important than surface ones (i.e., professional knowledge, skills, and teaching competency). We performed a qualitative analysis and developed a questionnaire based upon an interview with experienced clinical teachers in Taiwan, and used this tool to construct the key features for the role model. The application has also demonstrated the relative importance in the dimensions of the core competencies for clinical teachers in Taiwan.

Quantitative and Qualitative Evaluation of Iranian Researchers’ Scientific Production in Dentistry Subfields

PubMed Central

Yaminfirooz, Mousa; Motallebnejad, Mina; Gholinia, Hemmat; Esbakian, Somayeh

2015-01-01

Background: As in other fields of medicine, scientific production in the field of dentistry has significant placement. This study aimed at quantitatively and qualitatively evaluating Iranian researchers’ scientific output in the field of dentistry and determining their contribution in each of dentistry subfields and branches. Methods: This research was a scientometric study that applied quantitative and qualitative indices of Web of Science (WoS). Research population consisted of927indexed documents published under the name of Iran in the time span of 1993-2012 which were extracted from WoS on 10 March 2013. The Mann-Whitney test and Pearson correlation coefficient were used to data analyses in SPSS 19. Results: 777 (83. 73%) of indexed items of all scientific output in WoS were scientific articles. The highest growth rate of scientific productionwith90% belonged to endodontic sub field. The correlation coefficient test showed that there was a significant positive relationship between the number of documents and their publication age (P < 0. 0001). There was a significant difference between the mean number of published articles in the first ten- year (1993-2003) and that of the second one (2004-2013), in favor of the latter (P = 0. 001). Conclusions: The distribution frequencies of scientific production in various subfields of dentistry were very different. It needs to reinforce the infrastructure for more balanced scientific production in the field and its related subfields. PMID:26635439

Developing Evaluation Capacity through Process Use

ERIC Educational Resources Information Center

King, Jean A.

2007-01-01

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

Conducting qualitative research in mental health: Thematic and content analyses.

PubMed

Crowe, Marie; Inder, Maree; Porter, Richard

2015-07-01

The objective of this paper is to describe two methods of qualitative analysis - thematic analysis and content analysis - and to examine their use in a mental health context. A description of the processes of thematic analysis and content analysis is provided. These processes are then illustrated by conducting two analyses of the same qualitative data. Transcripts of qualitative interviews are analysed using each method to illustrate these processes. The illustration of the processes highlights the different outcomes from the same set of data. Thematic and content analyses are qualitative methods that serve different research purposes. Thematic analysis provides an interpretation of participants' meanings, while content analysis is a direct representation of participants' responses. These methods provide two ways of understanding meanings and experiences and provide important knowledge in a mental health context. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Qualitative data analysis: conceptual and practical considerations.

PubMed

Liamputtong, Pranee

2009-08-01

Qualitative inquiry requires that collected data is organised in a meaningful way, and this is referred to as data analysis. Through analytic processes, researchers turn what can be voluminous data into understandable and insightful analysis. This paper sets out the different approaches that qualitative researchers can use to make sense of their data including thematic analysis, narrative analysis, discourse analysis and semiotic analysis and discusses the ways that qualitative researchers can analyse their data. I first discuss salient issues in performing qualitative data analysis, and then proceed to provide some suggestions on different methods of data analysis in qualitative research. Finally, I provide some discussion on the use of computer-assisted data analysis.

The Issue of Quality in Qualitative Research

ERIC Educational Resources Information Center

Hammersley, Martyn

2007-01-01

This article addresses the perennial issue of the criteria by which qualitative research should be evaluated. At the present time, there is a sharp conflict between demands for explicit criteria, for example in order to serve systematic reviewing and evidence-based practice, and arguments on the part of some qualitative researchers that such…

Proteus mirabilis biofilm - qualitative and quantitative colorimetric methods-based evaluation.

PubMed

Kwiecinska-Piróg, Joanna; Bogiel, Tomasz; Skowron, Krzysztof; Wieckowska, Ewa; Gospodarek, Eugenia

2014-01-01

Proteus mirabilis strains ability to form biofilm is a current topic of a number of research worldwide. In this study the biofilm formation of P. mirabilis strains derived from urine of the catheterized and non-catheterized patients has been investigated. A total number of 39 P. mirabilis strains isolated from the urine samples of the patients of dr Antoni Jurasz University Hospital No. 1 in Bydgoszcz clinics between 2011 and 2012 was used. Biofilm formation was evaluated using two independent quantitative and qualitative methods with TTC (2,3,5-triphenyl-tetrazolium chloride) and CV (crystal violet) application. The obtained results confirmed biofilm formation by all the examined strains, except quantitative method with TTC, in which 7.7% of the strains did not have this ability. It was shown that P. mirabilis rods have the ability to form biofilm on the surfaces of both biomaterials applied, polystyrene and polyvinyl chloride (Nelaton catheters). The differences in ability to form biofilm observed between P. mirabilis strains derived from the urine of the catheterized and non-catheterized patients were not statistically significant.

Quantitative and qualitative processes of change during staff-coaching sessions: an exploratory study.

PubMed

van Oorsouw, Wietske M W J; Embregts, Petri J C M; Bosman, Anna M T

2013-05-01

Staff training is one of the interventions that managers can embed in their organizations to help staff improve their professional competences related to challenging behaviour of clients with intellectual disabilities. Individual coaching adds learning opportunities that are feasible but difficult to achieve in an in-service setting. In the present study, we have followed the coaching process of three staff members. Based on differences in the Linell balance of power across sessions, we explored the question: do different coaching processes have similar patterns in the development of dominance and coherence in interactions between coach and staff? Additionally, a qualitative approach was conducted to illustrate and enrich the meaning of quantitative outcomes. Processes were different regarding the balance of power at the start of the coaching, probably due to differences in resistance and insecurity. As a consequence of different starting points and differences in learning styles, each coaching process had its unique development over time. At the end, all dyads were comparable in the sense that all dyads were highly satisfied about the outcomes and process of coaching. This is in line with similar levels of power at the end of the coaching sessions suggesting equal contributions and leadership. The present findings suggest some relevant competencies of coaches within health-care services. Due to the small number of participants, the results have to be interpreted with caution. The present study provides suggestions for future research and clinical practice. Copyright © 2013 Elsevier Ltd. All rights reserved.

Exploring challenges in the patient's discharge process from the internal medicine service: A qualitative study of patients' and providers' perceptions.

PubMed

Pinelli, Vincent; Stuckey, Heather L; Gonzalo, Jed D

2017-09-01

In hospital-based medicine units, patients have a wide range of complex medical conditions, requiring timely and accurate communication between multiple interprofessional providers at the time of discharge. Limited work has investigated the challenges in interprofessional collaboration and communication during the patient discharge process. In this study, authors qualitatively assessed the experiences of internal medicine providers and patients about roles, challenges, and potential solutions in the discharge process, with a phenomenological focus on the process of collaboration. Authors conducted interviews with 87 providers and patients-41 providers in eight focus-groups, 39 providers in individual interviews, and seven individual patient interviews. Provider roles included physicians, nurses, therapists, pharmacists, care coordinators, and social workers. Interviews were audio-recorded and transcribed verbatim, followed by iterative review of transcripts using qualitative coding and content analysis. Participants identified several barriers related to interprofessional collaboration during the discharge process, including systems insufficiencies (e.g., medication reconciliation process, staffing challenges); lack of understanding others' roles (e.g., unclear which provider should be completing the discharge summary); information-communication breakdowns (e.g., inaccurate information communicated to the primary medical team); patient issues (e.g., patient preferences misaligned with recommendations); and poor collaboration processes (e.g., lack of structured interprofessional rounds). These results provide context for targeting improvement in interprofessional collaboration in medicine units during patient discharges. Implementing changes in care delivery processes may increase potential for accurate and timely coordination, thereby improving the quality of care transitions.

TEXACO GASIFICATION PROCESS - INNOVATIVE TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

This report summarizes the evaluation of the Texaco Gasification Process (TGP) conducted under the U.S. Environmental Protection Agency (EPA) Superfund Innovative Technology Evaluation (SITE) Program. The Texaco Gasification Process was developed by Texaco Inc. The TGP is a comm...

Meta-Study as Diagnostic: Toward Content Over Form in Qualitative Synthesis.

PubMed

Frost, Julia; Garside, Ruth; Cooper, Chris; Britten, Nicky

2016-02-01

Having previously conducted qualitative syntheses of the diabetes literature, we wanted to explore the changes in theoretical approaches, methodological practices, and the construction of substantive knowledge which have recently been presented in the qualitative diabetes literature. The aim of this research was to explore the feasibility of synthesizing existing qualitative syntheses of patient perspectives of diabetes using meta-study methodology. A systematic review of qualitative literature, published between 2000 and 2013, was conducted. Six articles were identified as qualitative syntheses. The meta-study methodology was used to compare the theoretical, methodological, analytic, and synthetic processes across the six studies, exploring the potential for an overarching synthesis. We identified that while research questions have increasingly concentrated on specific aspects of diabetes, the focus on systematic review processes has led to the neglect of qualitative theory and methods. This can inhibit the production of compelling results with meaningful clinical applications. Although unable to produce a synthesis of syntheses, we recommend that researchers who conduct qualitative syntheses pay equal attention to qualitative traditions and systematic review processes, to produce research products that are both credible and applicable. © The Author(s) 2015.

A human factors systems approach to understanding team-based primary care: a qualitative analysis

PubMed Central

Mundt, Marlon P.; Swedlund, Matthew P.

2016-01-01

Background. Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. Objective. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. Methods. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Results. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Conclusions. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. PMID:27578837

The qualitative orientation in medical education research.

PubMed

Cleland, Jennifer Anne

2017-06-01

Qualitative research is very important in educational research as it addresses the "how" and "why" research questions and enables deeper understanding of experiences, phenomena and context. Qualitative research allows you to ask questions that cannot be easily put into numbers to understand human experience. Getting at the everyday realities of some social phenomenon and studying important questions as they are really practiced helps extend knowledge and understanding. To do so, you need to understand the philosophical stance of qualitative research and work from this to develop the research question, study design, data collection methods and data analysis. In this article, I provide an overview of the assumptions underlying qualitative research and the role of the researcher in the qualitative process. I then go on to discuss the type of research objectives which are common in qualitative research, then introduce the main qualitative designs, data collection tools, and finally the basics of qualitative analysis. I introduce the criteria by which you can judge the quality of qualitative research. Many classic references are cited in this article, and I urge you to seek out some of these further reading to inform your qualitative research program.

The qualitative orientation in medical education research

PubMed Central

2017-01-01

Qualitative research is very important in educational research as it addresses the “how” and “why” research questions and enables deeper understanding of experiences, phenomena and context. Qualitative research allows you to ask questions that cannot be easily put into numbers to understand human experience. Getting at the everyday realities of some social phenomenon and studying important questions as they are really practiced helps extend knowledge and understanding. To do so, you need to understand the philosophical stance of qualitative research and work from this to develop the research question, study design, data collection methods and data analysis. In this article, I provide an overview of the assumptions underlying qualitative research and the role of the researcher in the qualitative process. I then go on to discuss the type of research objectives which are common in qualitative research, then introduce the main qualitative designs, data collection tools, and finally the basics of qualitative analysis. I introduce the criteria by which you can judge the quality of qualitative research. Many classic references are cited in this article, and I urge you to seek out some of these further reading to inform your qualitative research program. PMID:28597869

Nursing students evaluation of problem based learning and the impact of culture on the learning process and outcomes: a pilot project.

PubMed

Al-Kloub, Manal Ibrahim; Salameh, Taghreed Nayel; Froelicher, Erika Sivarajan

2014-03-01

This study evaluates students' learning experiences in a clinical pediatric nursing course adopting Problem Based Learning (PBL) and investigates how students' cultural background impacts on self directed learning. A mixed-methods approach combining quantitative and qualitative methods was utilized to answer the research objectives. An observational technique for the PBL teaching sessions was employed; and 226 third-year students were asked to complete PBL evaluation questionnaire. Fifty seven percent (n = 130) responses to the questionnaire were analyzed. Overall, students considered PBL to be moderately effective in their learning experience, with a mean of 3.64 (S.D = 1.18). Students qualitative responses fell within four thematic categories including: developing cognitive abilities, independent learning, motivation to learn, and group learning. Difficulties encountered by students were: it is time-consuming, it has unclear objectives, it is a stressful process, and it results in an increased workload. A small number of students indicated that PBL tutorials were boring and complained about lack of contribution from instructors and limited recourses. Learning is intertwined with culture; students' previous educational experiences, uncertainty, English language proficiency, computer resources, gender, and achievement were identified as the most important cultural issues that impact the learning process and outcomes. Successful implementation of PBL does not come easily; teachers should be alert to the issues of culture in designing curriculum. Copyright © 2013 Elsevier Ltd. All rights reserved.

Analyzing the School Evaluation Use Process To Make Evaluation Worth the Effort.

ERIC Educational Resources Information Center

Pechman, Ellen M.; King, Jean A.

This paper describes a structure for assessing the school evaluation use process developed from a longitudinal case study of districtwide and school level evaluation procedures in a large urban school district. Two fundamental questions guided the study: (1) Why isn't the evaluation process more useful to decision-makers and practitioners? and (2)…

Qualitative Evaluation of Project P.A.T.H.S.: An Integration of Findings Based on Program Participants

PubMed Central

Shek, Daniel T. L.; Sun, Rachel C. F.

2012-01-01

An integration of the qualitative evaluation findings collected in different cohorts of students who participated in Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) (n = 252 students in 29 focus groups) was carried out. With specific focus on how the informants described the program, results showed that the descriptions were mainly positive in nature, suggesting that the program was well received by the program participants. When the informants were invited to name three metaphors that could stand for the program, positive metaphors were commonly used. Beneficial effects of the program in different psychosocial domains were also voiced by the program participants. The qualitative findings integrated in this paper provide further support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in promoting holistic development in Chinese adolescents in Hong Kong. PMID:22666134

How Do Contextual Factors Influence Implementation and Receipt of Positive Youth Development Programs Addressing Substance Use and Violence? A Qualitative Meta-Synthesis of Process Evaluations.

PubMed

Dickson, Kelly; Melendez-Torres, G J; Fletcher, Adam; Hinds, Kate; Thomas, James; Stansfield, Claire; Murphy, Simon; Campbell, Rona; Bonell, Chris

2018-05-01

Positive youth development (PYD) often aims to prevent tobacco, alcohol, and drugs use and violence. We systematically reviewed PYD interventions, synthesizing process, and outcomes evidence. Synthesis of outcomes, published elsewhere, found no overall evidence of reducing substance use or violence but notable variability of fidelity. Our synthesis of process evaluations examined how implementation varied and was influenced by context. Process evaluations of PYD aiming to reduce substance use and violence. Study Inclusion Criteria: Overall review published since 1985; written in English; focused on youth aged 11 to 18 years; focused on interventions addressing multiple positive assets; reported on theory, process, or outcomes; and concerned with reducing substance use or violence. Synthesis of process evaluations examined how implementation varies with or is influenced by context. Two reviewers in parallel. Thematic synthesis. We identified 12 reports. Community engagement enhanced program appeal. Collaboration with other agencies could broaden the activities offered. Calm but authoritative staff increased acceptability. Staff continuity underpinned diverse activities and durable relationships. Empowering participants were sometimes in tension with requiring them to engage in diverse activities. Our systematic review identified factors that might help improve the fidelity and acceptability of PYD interventions. Addressing these might enable PYD to fulfill its potential as a means of promoting health.

Positive Effects of a Stress Reduction Program Based on Mindfulness Meditation in Brazilian Nursing Professionals: Qualitative and Quantitative Evaluation.

PubMed

dos Santos, Teresa Maria; Kozasa, Elisa Harumi; Carmagnani, Isabel Sampaio; Tanaka, Luiza Hiromi; Lacerda, Shirley Silva; Nogueira-Martins, Luiz Antonio

2016-01-01

Mindfulness meditation has been shown to effectively mitigate the negative effects of stress among nursing professionals, but in countries like Brazil, these practices are relatively unexplored. To evaluate the effects of a Stress Reduction Program (SRP) including mindfulness and loving kindness meditation among nursing professionals working in a Brazilian hospital setting. Pilot study with a mixed model using quantitative and qualitative methods was used to evaluate a group of participants. The quantitative data were analyzed at three different time points: pre-intervention, post-intervention, and follow-up. The qualitative data were analyzed at post-intervention. Hospital São Paulo (Brazil). Sample 13 nursing professionals, including nurses, technicians, and nursing assistants working in a hospital. Participants underwent mindfulness and loving kindness meditation during a period of six weeks. Perceived Stress Scale (PSS), Maslach Burnout Inventory (MBI), Beck Depression Inventory (BDI), State-Trait Anxiety Inventory (STAI), Satisfaction With Life Scale (SWLS), Self-Compassion Scale (SCS), WHOQOL-BREF quality of life assessment, and Work Stress Scale (WSS). Qualitative data were collected via a group interview following six weeks participation in the SRP. The quantitative analyses revealed a significant reduction (P < .05) between pre-intervention and post-intervention scores for perceived stress, burnout, depression, and anxiety (trait). These variables showed no significant differences between post-intervention and follow-up scores. The WHOQOL-BREF revealed significant increase (P < .05) just in the physical and psychological domains at post-intervention scores, which remained at the follow-up. Qualitative results showed improvement in the reactivity to inner experience; a more attentive perception of internal and external experiences; greater attention and awareness of actions and attitudes at every moment; and a positive influence of the SRP in nursing

Recruitment and retention in a 10-month social network-based intervention promoting diabetes self-management in socioeconomically deprived patients: a qualitative process evaluation.

PubMed

Vissenberg, Charlotte; Nierkens, Vera; Uitewaal, Paul J M; Middelkoop, Barend J C; Stronks, Karien

2017-07-26

Socioeconomically deprived patients with type 2 diabetes often face challenges with self-management, resulting in more diabetes-related complications. However, these groups are often under-represented in self-management interventions. Evidence on effective recruitment and retention strategies is growing, but lacking for intensive self-management interventions. This study aims to explore recruitment, retention and effective intervention strategies in a 10-month group-based intervention among Dutch, Moroccan, Turkish and Surinamese patients from socioeconomically deprived neighbourhoods. Participants were recruited through general practitioners (GPs) and participated in a 10-month social network-based intervention (10 groups, n=69): Powerful Together with Diabetes . This intervention also targeted the significant others of participants and aimed to increase social support for self-management and to decrease social influences hindering self-management. A qualitative process evaluation was conducted. Retention was measured using log books kept by group leaders. Further, we conducted 17 in-depth interviews with participants (multiethnic sample) and 18 with group leaders. Interviews were transcribed, coded and analysed using framework analyses. The GP's letter and reminder calls, an informational meeting and the intervention's informal nature facilitated recruitment. During the first months, positive group atmosphere, the intervention's perceived usefulness, opportunities to socialise and a reduction in practical barriers facilitated retention. After the first months, conflicting responsibilities and changes in the intervention's nature and planning hindered retention. Calls from group leaders and the prospect of a diploma helped participants overcome these barriers. To promote retention in lengthy self-management interventions, it seems important that patients feel they are going on an outing to a social gathering that is enjoyable, recreational, useful and easy to

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

Evaluation of interventions on road traffic injuries in Peru: a qualitative approach

PubMed Central

2012-01-01

Background Evaluation of interventions on road traffic injuries (RTI) going beyond the assessment of impact to include factors underlying success or failure is an important complement to standard impact evaluations. We report here how we used a qualitative approach to assess current interventions implemented to reduce RTIs in Peru. Methods We performed in-depth interviews with policymakers and technical officers involved in the implementation of RTI interventions to get their insight on design, implementation and evaluation aspects. We then conducted a workshop with key stakeholders to analyze the results of in-depth interviews, and to further discuss and identify key programmatic considerations when designing and implementing RTI interventions. We finally performed brainstorming sessions to assess potential system-wide effects of a selected intervention (Zero Tolerance), and to identify adaptation and redesign needs for this intervention. Results Key programmatic components were consistently identified that should be considered when designing and implementing RTI interventions. They include effective and sustained political commitment and planning; sufficient and sustained budget allocation; training, supervision, monitoring and evaluation of implemented policies; multisectoral participation; and strong governance and accountability. Brainstorming sessions revealed major negative effects of the selected intervention on various system building blocks. Conclusions Our approach revealed substantial caveats in current RTI interventions in Peru, and fundamental negative effects on several components of the sectors and systems involved. It also highlighted programmatic issues that should be applied to guarantee an effective implementation and evaluation of these policies. The findings from this study were discussed with key stakeholders for consideration in further designing and planning RTI control interventions in Peru. PMID:22269578

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Evaluation of the visual performance of image processing pipes: information value of subjective image attributes

NASA Astrophysics Data System (ADS)

Nyman, G.; Häkkinen, J.; Koivisto, E.-M.; Leisti, T.; Lindroos, P.; Orenius, O.; Virtanen, T.; Vuori, T.

2010-01-01

Subjective image quality data for 9 image processing pipes and 8 image contents (taken with mobile phone camera, 72 natural scene test images altogether) from 14 test subjects were collected. A triplet comparison setup and a hybrid qualitative/quantitative methodology were applied. MOS data and spontaneous, subjective image quality attributes to each test image were recorded. The use of positive and negative image quality attributes by the experimental subjects suggested a significant difference between the subjective spaces of low and high image quality. The robustness of the attribute data was shown by correlating DMOS data of the test images against their corresponding, average subjective attribute vector length data. The findings demonstrate the information value of spontaneous, subjective image quality attributes in evaluating image quality at variable quality levels. We discuss the implications of these findings for the development of sensitive performance measures and methods in profiling image processing systems and their components, especially at high image quality levels.

A qualitative evaluation of fire safety education programs for older adults.

PubMed

Diekman, Shane T; Stewart, Tamara A; Teh, S Leesia; Ballesteros, Michael F

2010-03-01

This article presents a qualitative evaluation of six fire safety education programs for older adults delivered by public fire educators. Our main aims were to explore how these programs are implemented and to determine important factors that may lead to program success, from the perspectives of the public fire educators and the older adults. For each program, we interviewed the public fire educator(s), observed the program in action, and conducted focus groups with older adults attending the program. Analysis revealed three factors that were believed to facilitate program success (established relationships with the older adult community, rapport with older adult audiences, and presentation relevance) as well as three challenges (lack of a standardized curriculum and program implementation strategies, attendance difficulties, and physical limitations due to age). More fire safety education should be developed for older adult populations. For successful programs, public fire educators should address the specific needs of their local older adult community.

Knowledge representation and qualitative simulation of salmon redd functioning. Part II: qualitative model of redds.

PubMed

Guerrin, F; Dumas, J

2001-02-01

This paper describes a qualitative model of the functioning of salmon redds (spawning areas of salmon) and its impact on mortality rates of early stages. For this, we use Qsim, a qualitative simulator, which appeared adequate for representing available qualitative knowledge of freshwater ecology experts (see Part I of this paper). Since the number of relevant variables was relatively large, it appeared necessary to decompose the model into two parts, corresponding to processes occurring at separate time-scales. A qualitative clock allows us to submit the simulation of salmon developmental stages to the calculation of accumulated daily temperatures (degree-days), according to the clock ticks and a water temperature regime set by the user. Therefore, this introduces some way of real-time dating and duration in a purely qualitative model. Simulating both sub-models, either separately or by means of alternate transitions, allows us to generate the evolutions of variables of interest, such as the mortality rates according to two factors (flow of oxygenated water and plugging of gravel interstices near the bed surface), under various scenarios.

Modelling coupled microbial processes in the subsurface: Model development, verification, evaluation and application

NASA Astrophysics Data System (ADS)

Masum, Shakil A.; Thomas, Hywel R.

2018-06-01

To study subsurface microbial processes, a coupled model which has been developed within a Thermal-Hydraulic-Chemical-Mechanical (THCM) framework is presented. The work presented here, focuses on microbial transport, growth and decay mechanisms under the influence of multiphase flow and bio-geochemical reactions. In this paper, theoretical formulations and numerical implementations of the microbial model are presented. The model has been verified and also evaluated against relevant experimental results. Simulated results show that the microbial processes have been accurately implemented and their impacts on porous media properties can be predicted either qualitatively or quantitatively or both. The model has been applied to investigate biofilm growth in a sandstone core that is subjected to a two-phase flow and variable pH conditions. The results indicate that biofilm growth (if not limited by substrates) in a multiphase system largely depends on the hydraulic properties of the medium. When the change in porewater pH which occurred due to dissolution of carbon dioxide gas is considered, growth processes are affected. For the given parameter regime, it has been shown that the net biofilm growth is favoured by higher pH; whilst the processes are considerably retarded at lower pH values. The capabilities of the model to predict microbial respiration in a fully coupled multiphase flow condition and microbial fermentation leading to production of a gas phase are also demonstrated.

The experience of acute leukaemia in adult patients: a qualitative thematic synthesis.

PubMed

Papadopoulou, Constantina; Johnston, Bridget; Themessl-Huber, Markus

2013-10-01

The aim of this review was to systematically identify and synthesise all qualitative evidence on how adult patients diagnosed with acute leukaemia experience living with their illness. A systematic search strategy was developed comprising of two search strings: i) acute leukaemia and ii) qualitative methodology. The search strategy was run in seven electronic databases (Medline, CINAHL, PsychINFO, EMBASE, BNI & Archive, SSCI and ASSIA). Nine qualitative studies in adult patients with acute leukaemia, published in peer reviewed journals between 01/1990 and 01/2013 were included in the final sample. The qualitative thematic synthesis resulted in the development of a conceptual model describing a person's path to build a renewed self. Following the initial blow of diagnosis with the range of initial reactions, patients with acute leukaemia are living in a contracting world; they have to deal with the life in hospital, the several losses and the impact of their illness on their emotions and interpersonal relationships. Several factors take up a buffering role at that stage: coping, support, information and hope. Finally, patients accommodate acute leukaemia in their lives through re-evaluating personal values and assigning new meaning to their experience. Results from this thematic synthesis are indicative of the impact of acute leukaemia on patients' lives and the processes they use to make sense and accommodate the illness in their life. Increasing our understanding of these processes is warranted to improve patient care. Copyright © 2013. Published by Elsevier Ltd.

Professional Readiness Level of Candidate Teachers: A Qualitative Evaluation

ERIC Educational Resources Information Center

Yildirim, Nail

2016-01-01

The study investigates novice teachers? self-perceptions of their professional readiness. The study has a qualitative research design, adopting the phenomenology pattern. The study group comprised subject matter teachers employed at different educational stages (primary, secondary and high schools). The participants were selected according to the…

Improving identification and management of partner violence: examining the process of academic detailing: a qualitative study

PubMed Central

2011-01-01

Background Many physicians do not routinely inquire about intimate partner violence. Purpose This qualitative study explores the process of academic detailing as an intervention to change physician behavior with regard to intimate partner violence (IPV) identification and documentation. Method A non-physician academic detailer provided a seven-session modular curriculum over a two-and-a-half month period. The detailer noted written details of each training session. Audiotapes of training sessions and semi-structured exit interviews with each physician were recorded and transcribed. Transcriptions were qualitatively and thematically coded and analyzed using Atlas ti®. Results All three study physicians reported increased clarity with regard to the scope of their responsibility to their patients experiencing IPV. They also reported increased levels of comfort in the effective identification and appropriate documentation of IPV and the provision of ongoing support to the patient, including referrals to specialized community services. Conclusion Academic detailing, if presented by a supportive and knowledgeable academic detailer, shows promise to improve physician attitudes and practices with regards to patients in violent relationships. PMID:21679450

Visualizing the qualitative: making sense of written comments from an evaluative satisfaction survey.

PubMed

Bletzer, Keith V

2015-01-01

Satisfaction surveys are common in the field of health education, as a means of assisting organizations to improve the appropriateness of training materials and the effectiveness of facilitation-presentation. Data can be qualitative of which analysis often become specialized. This technical article aims to reveal whether qualitative survey results can be visualized by presenting them as a Word Cloud. Qualitative materials in the form of written comments on an agency-specific satisfaction survey were coded and quantified. The resulting quantitative data were used to convert comments into "input terms" to generate Word Clouds to increase comprehension and accessibility through visualization of the written responses. A three-tier display incorporated a Word Cloud at the top, followed by the corresponding frequency table, and a textual summary of the qualitative data represented by the Word Cloud imagery. This mixed format adheres to recognition that people vary in what format is most effective for assimilating new information. The combination of visual representation through Word Clouds complemented by quantified qualitative materials is one means of increasing comprehensibility for a range of stakeholders, who might not be familiar with numerical tables or statistical analyses.

Using a Systematic Conceptual Model for a Process Evaluation of a Middle School Obesity Risk-Reduction Nutrition Curriculum Intervention: Choice, Control & Change

PubMed Central

Lee, Heewon; Contento, Isobel R.; Koch, Pamela

2012-01-01

Objective To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. Design A process evaluation study based on a systematic conceptual model. Setting Five middle schools in New York City. Participants 562 students in 20 classes and their science teachers (n=8). Main Outcome Measures Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers’ curriculum evaluation, and satisfaction with teaching the curriculum. Analysis Descriptive statistics and Spearman’s Rho Correlation for quantitative analysis and content analysis for qualitative data were used. Results Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teachers’ satisfaction with teaching the curriculum was highly correlated with students’ satisfaction (p <.05). Teachers’ perception of amount of student work was negatively correlated with implementation and with student satisfaction (p<.05). Conclusions and implications Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. PMID:23321021

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change.

PubMed

Lee, Heewon; Contento, Isobel R; Koch, Pamela

2013-03-01

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. A process evaluation study based on a systematic conceptual model. Five middle schools in New York City. Five hundred sixty-two students in 20 classes and their science teachers (n = 8). Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum. Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used. Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05). Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

A qualitative case study of the legislative process of the hygienist-therapist bill in a large Midwestern state.

PubMed

Dollins, Haley E; Bray, Kimberly Krust; Gadbury-Amyot, Cynthia C

2013-10-01

Inequitable access to dental care contributes to oral health disparities. Midlevel dental provider models are utilized across the globe as a way to bridge the gap between preventive and restorative dental professionals and increase access to dental care. The purpose of this study was threefold: to examine lessons learned from the state legislative process related to creation of the hygienist-therapist in a Midwestern state, to improve understanding of the relationship between alternative oral health delivery models and public policy and to inform the development and passage of future policies aimed at addressing the unmet dental needs of the public. This research investigation utilized a qualitative research methodology to examine the process of legislation relating to an alternative oral health delivery model (hygienist-therapist) through the eyes of key stakeholders. Interview data was analyzed and then triangulated with 3 data sources: interviews with key stakeholders, documents and researcher participant field notes. Data analysis resulted in consensus on 3 emergent themes with accompanying categories. The themes that emerged included social justice, partnerships and coalitions, and the legislative process. This qualitative case study suggests that the creation of a new oral health workforce model was a long and arduous process involving multiple stakeholders and negotiation between the parties involved. The creation of this new workforce model was recognized as a necessary step to increasing access to dental care at the state and national level. The research in this case study may serve to inform advocates of access to oral health care as other states pursue their own workforce models.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A

Qualitative research in nutrition and dietetics: getting started.

PubMed

Swift, J A; Tischler, V

2010-12-01

Qualitative research is well placed to answer complex questions about food-related behaviour because it investigates how and why individuals act in certain ways. The field of qualitative health research is undoubtedly gaining momentum and, increasingly, there is a recognition that it should be a vital part of the decision-making processes that direct the development of health policy and practice. Much of the guidance available, however, is difficult to navigate for those new to 'qualitative research', and there is little discussion of qualitative research issues specifically in relation to nutrition and dietetics. This review, the first in a series, outlines the field of qualitative enquiry, its potential usefulness in nutrition and dietetics, and how to embark upon this type of research. Furthermore, it describes a process to guide high-quality qualitative research in this area that proceeds from the research question(s) and considers the key philosophical assumptions about ontology, epistemology and methodology that underpin the overall design of a study. Other reviews in this series provide an overview of the principal techniques of data collection and sampling, data analysis, and quality assessment of qualitative work, and provide some practical advice relevant to nutrition and dietetics, along with glossaries of key terms. © 2010 The Authors. Journal compilation © 2010 The British Dietetic Association Ltd.

Qualitative radiology assessment of tumor response: does it measure up?

PubMed

Gottlieb, Ronald H; Litwin, Alan; Gupta, Bhavna; Taylor, John; Raczyk, Cheryl; Mashtare, Terry; Wilding, Gregory; Fakih, Marwan

2008-01-01

Our purpose was to assess whether a simpler qualitative evaluation of tumor response by computed tomography is as reproducible and predictive of clinical outcome as the Response Evaluation Criteria in Solid Tumors (RECIST) and World Health Organization (WHO) methods. This study was a two-reader retrospective evaluation in which qualitative assessment resulted in agreement in 21 of 23 patients with metastatic colorectal carcinoma (91.3%, kappa=0.78; 95% CI, 0.51-1.00). Hepatic metastases were classified as increased, decreased, or unchanged, compared with agreement in 20 of 23 patients (87.0%) for RECIST (kappa=0.62; 95% CI, 0.23-1.00) and WHO (kappa=0.67; 95% CI, 0.34-1.00) methods. Patients were placed into partial response, stable disease, and disease progression categories. Time to progression of disease was better predicted qualitatively than by RECIST or WHO. Our pilot data suggest that our qualitative scoring system is more reproducible and predictive of patient clinical outcome than the RECIST and WHO methods.

A qualitative assessment of Toxoplasma gondii risk in ready-to-eat smallgoods processing.

PubMed

Mie, Tanya; Pointon, Andrew M; Hamilton, David R; Kiermeier, Andreas

2008-07-01

Toxoplasma gondii is one of the most common parasitic infections of humans and other warm-blooded animals. In most adults, it does not cause serious illness, but severe disease may result from infection in fetuses and immunocompromised people. Consumption of raw or undercooked meats has consistently been identified as an important source of exposure to T. gondii. Several studies indicate the potential failure to inactivate T. gondii in the processes of cured meat products, This article presents a qualitative risk-based assessment of the processing of ready-to-eat smallgoods, which include cooked or uncooked fermented meat, pâté, dried meat, slow cured meat, luncheon meat, and cooked muscle meat including ham and roast beef. The raw meat ingredients are rated with respect to their likelihood of containing T. gondii cysts and an adjustment is made based on whether all the meat from a particular source is frozen. Next, the effectiveness of common processing steps to inactivate T. gondii cysts is assessed, including addition of spices, nitrates, nitrites and salt, use of fermentation, smoking and heat treatment, and the time and temperature during maturation. It is concluded that processing steps that may be effective in the inactivation of T. gondii cysts include freezing, heat treatment, and cooking, and the interaction between salt concentration, maturation time, and temperature. The assessment is illustrated using a Microsoft Excel-based software tool that was developed to facilitate the easy assessment of four hypothetical smallgoods products.

Bracketing as a skill in conducting unstructured qualitative interviews.

PubMed

Sorsa, Minna Anneli; Kiikkala, Irma; Åstedt-Kurki, Päivi

2015-03-01

To provide an overview of bracketing as a skill in unstructured qualitative research interviews. Researchers affect the qualitative research process. Bracketing in descriptive phenomenology entails researchers setting aside their pre-understanding and acting non-judgementally. In interpretative phenomenology, previous knowledge is used intentionally to create new understanding. A literature search of bracketing in phenomenology and qualitative research. This is a methodology paper examining the researchers' impact in creating data in creating data in qualitative research. Self-knowledge, sensitivity and reflexivity of the researcher enable bracketing. Skilled and experienced researchers are needed to use bracketing in unstructured qualitative research interviews. Bracketing adds scientific rigour and validity to any qualitative study.

Task sharing in rural Haiti: Qualitative assessment of a brief, structured training with and without apprenticeship supervision for community health workers

PubMed Central

McLean, Kristen E; Kaiser, Bonnie N; Hagaman, Ashley K; Wagenaar, Bradley H; Therosme, Tatiana P; Kohrt, Brandon A

2015-01-01

Despite growing support for supervision after task sharing trainings in humanitarian settings, there is limited research on the experience of trainees in apprenticeship and other supervision approaches. Studying apprenticeships from trainees’ perspectives is crucial to refine supervision and enhance motivation for service implementation. The authors implemented a multi-stage, transcultural adaptation for a pilot task sharing training in Haiti entailing three phases: 1) literature review and qualitative research to adapt a mental health and psychosocial support training; 2) implementation and qualitative process evaluation of a brief, structured group training; and 3) implementation and qualitative evaluation of an apprenticeship training, including a two year follow-up of trainees. Structured group training revealed limited knowledge acquisition, low motivation, time and resource constraints on mastery, and limited incorporation of skills into practice. Adding an apprenticeship component was associated with subjective clinical competency, increased confidence regarding utilising skills, and career advancement. Qualitative findings support the added value of apprenticeship according to trainees. PMID:26190953

Bridging the gap between the economic evaluation literature and daily practice in occupational health: a qualitative study among decision-makers in the healthcare sector

PubMed Central

2013-01-01

Background Continued improvements in occupational health can only be ensured if decisions regarding the implementation and continuation of occupational health and safety interventions (OHS interventions) are based on the best available evidence. To ensure that this is the case, scientific evidence should meet the needs of decision-makers. As a first step in bridging the gap between the economic evaluation literature and daily practice in occupational health, this study aimed to provide insight into the occupational health decision-making process and information needs of decision-makers. Methods An exploratory qualitative study was conducted with a purposeful sample of occupational health decision-makers in the Ontario healthcare sector. Eighteen in-depth interviews were conducted to explore the process by which occupational health decisions are made and the importance given to the financial implications of OHS interventions. Twenty-five structured telephone interviews were conducted to explore the sources of information used during the decision-making process, and decision-makers’ knowledge on economic evaluation methods. In-depth interview data were analyzed according to the constant comparative method. For the structured telephone interviews, summary statistics were prepared. Results The occupational health decision-making process generally consists of three stages: initiation stage, establishing the need for an intervention; pre-implementation stage, developing an intervention and its business case in order to receive senior management approval; and implementation and evaluation stage, implementing and evaluating an intervention. During this process, information on the financial implications of OHS interventions was found to be of great importance, especially the employer’s costs and benefits. However, scientific evidence was rarely consulted, sound ex-post program evaluations were hardly ever performed, and there seemed to be a need to advance the economic

Comparative evaluation of the remineralizing efficacy of calcium sodium phosphosilicate agent and fluoride based on quantitative and qualitative analysis.

PubMed

Mony, Saranya; Rao, Arathi; Shenoy, Ramya; Suprabha, Baranya Srikrishna

2015-01-01

Calcium sodium phosphosilicate (NovaMin) is an agent that is claimed to release calcium and phosphate ions intraorally to help the self-repair process of enamel. It is used extensively as a desensitizing agent, but the chemical reactions that occur may promote apatite formation enhancing remineralization. The present study was undertaken to evaluate the ability of NovaMin to remineralize an experimentally induced demineralized lesion. The evaluation was done based on the quantitative and qualitative analysis of enamel over the period of 15 and 30 days. A sample of 120 noncarious premolar teeth extracted for orthodontic reasons were used for the study. Baseline data for hardness, Ca/PO 4 , and surface characteristics before and after demineralization process was obtained. All the teeth were brushed twice daily at 12 h interval with the test agents using a powered toothbrush for 2 min. The samples were tested on the 15 th and 30 th day. Calcium phosphate ratio and hardness in both the groups improved during the study period. Fluoride group showed higher values for Ca/PO 4 and hardness but was not statistically significant with the P > 0.05. Scanning electron microscope pictures showed that the deposition of the material over the decalcified enamel is more smoother and uniform with NovaMin and more irregular with fluoride. NovaMin is found to be as effective in improving the Ca/PO 4 ratio and hardness in a demineralized enamel as fluoride. Hence, it can be a new alternate material for remineralization of enamel with less toxic effects compared to fluorides.

Effects of an Advocacy Trial on Food Industry Salt Reduction Efforts—An Interim Process Evaluation

PubMed Central

Trevena, Helen; Petersen, Kristina; Thow, Anne Marie; Neal, Bruce

2017-01-01

The decisions made by food companies are a potent factor shaping the nutritional quality of the food supply. A number of non-governmental organizations (NGOs) advocate for corporate action to reduce salt levels in foods, but few data define the effectiveness of advocacy. This present report describes the process evaluation of an advocacy intervention delivered by one Australian NGO directly to food companies to reduce the salt content of processed foods. Food companies were randomly assigned to intervention (n = 22) or control (n = 23) groups. Intervention group companies were exposed to pre-planned and opportunistic communications, and control companies to background activities. Seven pre-defined interim outcome measures provided an indication of the effect of the intervention and were assessed using intention-to-treat analysis. These were supplemented by qualitative data from nine semi-structured interviews. The mean number of public communications supporting healthy food made by intervention companies was 1.5 versus 1.8 for control companies (p = 0.63). Other outcomes, including the mean number of news articles, comments and reports (1.2 vs. 1.4; p = 0.72), a published nutrition policy (23% vs. 44%; p = 0.21), public commitment to the Australian government’s Food and Health Dialogue (FHD) (41% vs. 61%; p = 0.24), evidence of a salt reduction plan (23% vs. 30%; p = 0.56), and mean number of communications with the NGO (15 vs. 11; p = 0.28) were also not significantly different. Qualitative data indicated the advocacy trial had little effect. The absence of detectable effects of the advocacy intervention on the interim markers indicates there may be no impact of the NGO advocacy trial on the primary outcome of salt reduction in processed foods. PMID:29039802

Effects of an Advocacy Trial on Food Industry Salt Reduction Efforts-An Interim Process Evaluation.

PubMed

Trevena, Helen; Petersen, Kristina; Thow, Anne Marie; Dunford, Elizabeth K; Wu, Jason H Y; Neal, Bruce

2017-10-17

The decisions made by food companies are a potent factor shaping the nutritional quality of the food supply. A number of non-governmental organizations (NGOs) advocate for corporate action to reduce salt levels in foods, but few data define the effectiveness of advocacy. This present report describes the process evaluation of an advocacy intervention delivered by one Australian NGO directly to food companies to reduce the salt content of processed foods. Food companies were randomly assigned to intervention ( n = 22) or control ( n = 23) groups. Intervention group companies were exposed to pre-planned and opportunistic communications, and control companies to background activities. Seven pre-defined interim outcome measures provided an indication of the effect of the intervention and were assessed using intention-to-treat analysis. These were supplemented by qualitative data from nine semi-structured interviews. The mean number of public communications supporting healthy food made by intervention companies was 1.5 versus 1.8 for control companies ( p = 0.63). Other outcomes, including the mean number of news articles, comments and reports (1.2 vs. 1.4; p = 0.72), a published nutrition policy (23% vs. 44%; p = 0.21), public commitment to the Australian government's Food and Health Dialogue (FHD) (41% vs. 61%; p = 0.24), evidence of a salt reduction plan (23% vs. 30%; p = 0.56), and mean number of communications with the NGO (15 vs. 11; p = 0.28) were also not significantly different. Qualitative data indicated the advocacy trial had little effect. The absence of detectable effects of the advocacy intervention on the interim markers indicates there may be no impact of the NGO advocacy trial on the primary outcome of salt reduction in processed foods.

Appraising Qualitative Research in Health Education: Guidelines for Public Health Educators

PubMed Central

Jeanfreau, Scharalda G.; Jack, Leonard

2010-01-01

Research studies, including qualitative studies, form the basis for evidence-based practice among health professionals. However, many practicing health educators do not feel fully confident in their ability to critically appraise qualitative research studies. This publication presents an overview of qualitative research approaches, defines key terminology used in qualitative research, and provides guidelines for appraising the strengths and weaknesses of published qualitative research. On reading, health educators will be better equipped to evaluate the quality of the evidence through critical appraisals of qualitative research publications. PMID:20817630

The acoustical design of vehicles-a challenge for qualitative evaluation

NASA Astrophysics Data System (ADS)

Schulte-Fortkamp, Brigitte; Genuit, Klaus; Fiebig, Andre

2005-09-01

Whenever the acoustical design of vehicles is explored, the crucial question about the appropriate method of evaluation arises. Research shows that not only acoustic but also non-acoustic parameters have a major influence on the way sounds are evaluated. Therefore, new methods of evaluation have to be implemented. Methods are needed which give the opportunity to test the quality of the given ambience and to register the effects and evaluations in their functional interdependence as well as the influence of personal and contextual factors. Moreover, new methods have to give insight into processes of evaluation and their contextual parameters. In other words, the task of evaluating acoustical ambiences consists of designating a set of social, psychological, and cultural conditions which are important to determine particular individual and collective behavior, attitudes, and also emotions relative to the given ambience. However, no specific recommendations exist yet which comprise particular descriptions of how to assess those specific sound effects. That is why there is a need to develop alternative methods of evaluation with whose help effects of acoustical ambiences can be better predicted. A method of evaluation will be presented which incorporates a new sensitive approach for the evaluation of vehicle sounds.

Non-financial conflicts of interest in academic grant evaluation: a qualitative study of multiple stakeholders in France.

PubMed

Abdoul, Hendy; Perrey, Christophe; Tubach, Florence; Amiel, Philippe; Durand-Zaleski, Isabelle; Alberti, Corinne

2012-01-01

Peer review is the most widely used method for evaluating grant applications in clinical research. Criticisms of peer review include lack of equity, suspicion of biases, and conflicts of interest (CoI). CoIs raise questions of fairness, transparency, and trust in grant allocation. Few observational studies have assessed these issues. We report the results of a qualitative study on reviewers' and applicants' perceptions and experiences of CoIs in reviews of French academic grant applications. We designed a qualitative study using semi-structured interviews and direct observation. We asked members of assessment panels, external reviewers, and applicants to participate in semi-structured interviews. Two independent researchers conducted in-depth reviews and line-by-line coding of all transcribed interviews, which were also subjected to Tropes® software text analysis, to detect and qualify themes associated with CoIs. Most participants (73/98) spontaneously reported that non-financial CoIs predominated over financial CoIs. Non-financial CoIs mainly involved rivalry among disciplines, cronyism, and geographic and academic biases. However, none of the participants challenged the validity of peer review. Reviewers who felt they might be affected by CoIs said they reacted in a variety of ways: routine refusal to review, routine attempt to conduct an impartial review, or decision on a case-by-case basis. Multiple means of managing non-financial CoIs were suggested, including increased transparency throughout the review process, with public disclosure of non-financial CoIs, and careful selection of independent reviewers, including foreign experts and methodologists. Our study underscores the importance of considering non-financial CoIs when reviewing research grant applications, in addition to financial CoIs. Specific measures are needed to prevent a negative impact of non-financial CoIs on the fairness of resource allocation. Whether and how public disclosure of non

Comparing the Cognitive Process of Circular Causality in Two Patients with Strokes through Qualitative Analysis.

PubMed

Derakhshanrad, Seyed Alireza; Piven, Emily; Ghoochani, Bahareh Zeynalzadeh

2017-10-01

Walter J. Freeman pioneered the neurodynamic model of brain activity when he described the brain dynamics for cognitive information transfer as the process of circular causality at intention, meaning, and perception (IMP) levels. This view contributed substantially to establishment of the Intention, Meaning, and Perception Model of Neuro-occupation in occupational therapy. As described by the model, IMP levels are three components of the brain dynamics system, with nonlinear connections that enable cognitive function to be processed in a circular causality fashion, known as Cognitive Process of Circular Causality (CPCC). Although considerable research has been devoted to study the brain dynamics by sophisticated computerized imaging techniques, less attention has been paid to study it through investigating the adaptation process of thoughts and behaviors. To explore how CPCC manifested thinking and behavioral patterns, a qualitative case study was conducted on two matched female participants with strokes, who were of comparable ages, affected sides, and other characteristics, except for their resilience and motivational behaviors. CPCC was compared by matrix analysis between two participants, using content analysis with pre-determined categories. Different patterns of thinking and behavior may have happened, due to disparate regulation of CPCC between two participants.

Qualitative Analysis on Stage: Making the Research Process More Public.

ERIC Educational Resources Information Center

Anfara, Vincent A., Jr.; Brown, Kathleen M.

The increased use of qualitative research methods has spurred interest in developing formal standards for assessing its validity. These standards, however, fall short if they do not include public disclosure of methods as a criterion. The researcher must be accountable in documenting the actions associated with establishing internal validity…

Qualitative evaluation of a self-management intervention for people in the early stage of dementia.

PubMed

Martin, Faith; Turner, Andrew; Wallace, Louise M; Stanley, Damian; Jesuthasan, Jana; Bradbury, Nicola

2015-07-01

Self-management programs are effective for people living with chronic illnesses. However, there has been little research addressing self-management for people with dementia in the early stages. This study presents a qualitative evaluation of the experiences of attending a novel self-management program and initial process evaluation. The program was designed with and for people with dementia. It addresses: (a) relationship with family, (b) maintenance of an active lifestyle, (c) psychological well-being, (d) techniques to cope with memory changes and (e) information about dementia. Six participants with early stage dementia completed the intervention that was co-delivered by lay and clinical professional tutors. Participants and tutors attended focus group and interviews at the end of the program to explore their perceptions of the intervention. These were audio-recorded, transcribed verbatim and analysed thematically. Participants reported enjoyment and benefits from the intervention. This was despite some reporting concerns relating to their memory difficulties. The program's flexible nature, focus on strengths and the opportunity to spend time with other people living with dementia were particularly well received. Participants and tutors outlined areas for further improvement. The program was feasible and its flexible delivery appeared to facilitate participant benefit. Emphasis should be placed on maintaining activity and relationships, improving positive well-being and social interaction during the program. Memory of the pleasant experience and strengths focus was evidenced, which may impact positively on quality of life. The results highlight the usefulness and acceptability of self-management for people with early stage dementia and provide initial support for the program's structure and content. © The Author(s) 2013.

The applicability of normalisation process theory to speech and language therapy: a review of qualitative research on a speech and language intervention.

PubMed

James, Deborah M

2011-08-12

The Bercow review found a high level of public dissatisfaction with speech and language services for children. Children with speech, language, and communication needs (SLCN) often have chronic complex conditions that require provision from health, education, and community services. Speech and language therapists are a small group of Allied Health Professionals with a specialist skill-set that equips them to work with children with SLCN. They work within and across the diverse range of public service providers. The aim of this review was to explore the applicability of Normalisation Process Theory (NPT) to the case of speech and language therapy. A review of qualitative research on a successfully embedded speech and language therapy intervention was undertaken to test the applicability of NPT. The review focused on two of the collective action elements of NPT (relational integration and interaction workability) using all previously published qualitative data from both parents and practitioners' perspectives on the intervention. The synthesis of the data based on the Normalisation Process Model (NPM) uncovered strengths in the interpersonal processes between the practitioners and parents, and weaknesses in how the accountability of the intervention is distributed in the health system. The analysis based on the NPM uncovered interpersonal processes between the practitioners and parents that were likely to have given rise to successful implementation of the intervention. In previous qualitative research on this intervention where the Medical Research Council's guidance on developing a design for a complex intervention had been used as a framework, the interpersonal work within the intervention had emerged as a barrier to implementation of the intervention. It is suggested that the design of services for children and families needs to extend beyond the consideration of benefits and barriers to embrace the social processes that appear to afford success in embedding

Bridging the Qualitative/Quantitative Software Divide

PubMed Central

Annechino, Rachelle; Antin, Tamar M. J.; Lee, Juliet P.

2011-01-01

To compare and combine qualitative and quantitative data collected from respondents in a mixed methods study, the research team developed a relational database to merge survey responses stored and analyzed in SPSS and semistructured interview responses stored and analyzed in the qualitative software package ATLAS.ti. The process of developing the database, as well as practical considerations for researchers who may wish to use similar methods, are explored. PMID:22003318

A qualitative evaluation of medication management services in six Minnesota health systems.

PubMed

Sorensen, Todd D; Pestka, Deborah; Sorge, Lindsay A; Wallace, Margaret L; Schommer, Jon

2016-03-01

The initiation, establishment, and sustainability of medication management programs in six Minnesota health systems are described. Six Minnesota health systems with well-established medication management programs were invited to participate in this study: Essentia Health, Fairview Health Services, HealthPartners, Hennepin County Medical Center, Mayo Clinic, and Park Nicollet Health Services. Qualitative methods were employed by conducting group interviews with key staff from each institution who were influential in the development of medication management services within their organization. Kotter's theory of eight steps for leading organizational change served as the framework for the question guide. The interviews were audio recorded, transcribed, and analyzed for recurring and emergent themes. A total of 13 distinct themes were associated with the successful integration of medication management services across the six healthcare systems. Identified themes clustered within three stages of Kotter's model for leading organizational change: creating a climate for change, engaging and enabling the whole organization, and implementing and sustaining change. The 13 themes included (1) external influences, (2) pharmacists as an untapped resource, (3) principles and professionalism, (4) organizational culture, (5) momentum champions, (6) collaborative relationships, (7) service promotion, (8) team-based care, (9) implementation strategies, (10) overcoming challenges, (11) supportive care model process, (12) measuring and reporting results, and (13) sustainability strategies. A qualitative survey of six health systems that successfully implemented medication management services in ambulatory care clinics revealed that a supportive culture and team-based collaborative care are among the themes identified as necessary for service sustainability. Copyright © 2016 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

A human factors systems approach to understanding team-based primary care: a qualitative analysis.

PubMed

Mundt, Marlon P; Swedlund, Matthew P

2016-12-01

Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of a Patient-Reported Outcome Instrument to Evaluate Symptoms of Advanced NSCLC: Qualitative Research and Content Validity of the Non-Small Cell Lung Cancer Symptom Assessment Questionnaire (NSCLC-SAQ)

PubMed Central

Atkinson, Thomas M.; DeBusk, Kendra P.A.; Liepa, Astra M.; Scanlon, Michael; Coons, Stephen Joel

2016-01-01

PURPOSE To describe the process and results of the preliminary qualitative development of a new symptom-based PRO measure intended to assess treatment benefit in advanced non-small cell lung cancer (NSCLC) clinical trials. METHODS Individual qualitative interviews were conducted with adult NSCLC (Stage I–IV) patients in the US. Experienced interviewers conducted concept elicitation (CE) and cognitive interviews using semi-structured interview guides. The CE interview guide was used to elicit spontaneous reports of symptom experiences along with probing to further explore and confirm concepts. Interview transcripts were coded and analyzed by professional qualitative coders using Atlas.ti software, and were summarized by like-content using an iterative coding framework. Data from the CE interviews were considered alongside existing literature and clinical expert opinion during an item-generation process, leading to development of a preliminary version of the NSCLC Symptom Assessment Questionnaire (NSCLC-SAQ). Three waves of cognitive interviews were conducted to evaluate concept relevance, item interpretability, and structure of the draft items to facilitate further instrument refinement. FINDINGS Fifty-one patients (mean age 64.9 [SD=11.2]; 51.0% female) participated in the CE interviews. A total of 1,897 expressions of NSCLC-related symptoms were identified and coded in interview transcripts, representing approximately 42 distinct symptom concepts. A 9-item initial draft instrument was developed for testing in three waves of cognitive interviews with additional NSCLC patients (n=20), during which both paper and electronic versions of the instrument were evaluated and refined. Participant responses and feedback during cognitive interviews led to the removal of 2 items and substantial modifications to others. IMPLICATIONS The NSCLC-SAQ is a 7-item PRO measure intended for use in advanced NSCLC clinical trials to support medical product labelling. The NSCLC-SAQ uses

Knowledge mobilized by a critical thinking process deployed by nursing students in practical care situations: a qualitative study.

PubMed

Lechasseur, Kathleen; Lazure, Ginette; Guilbert, Louise

2011-09-01

This paper is a report of a qualitative study of mobilization of knowledge within the critical thinking process deployed by female undergraduate nursing students in practical care situations. Holistic practice is based on variety of knowledge mobilized by a critical thinking process. Novices and, more specifically, students experience many difficulties in this regard. Therefore, a better understanding of the knowledge they mobilize in their practice is important for nurse educators. A qualitative study, guided by grounded theory, was carried out. Sixteen nursing students, registered in an undergraduate programme in an Eastern Canadian university, were recruited. Descriptions of practical care situations were obtained through explicitation interviews in 2007. A sociodemographic questionnaire, semi-structured interviews and field notes were also used. Data were analysed using an approach based on grounded theory. An additional stage of analysis involved data condensation. Various types of knowledge guide nursing students' practice. These include intrapersonal, interpersonal, perceptual, moral/ethical, experiential, practical, scientific and contextual knowledge. The mobilization of these types of knowledge is only possible when the process of critical thinking has attained a higher level, giving rise to a new knowledge that we have termed combinational constructive knowledge rather than aesthetic knowledge. Clarification of the types of knowledge guiding the practice of student nurses and of the role of critical thinking in their mobilization could lead to innovative educational strategies. The findings provide guidance for the revision and development of both academic and clinical training programmes. © 2011 Blackwell Publishing Ltd.

‘It's trying to manage the work’: a qualitative evaluation of recruitment processes within a UK multicentre trial

PubMed Central

Skea, Zoë Christina; Treweek, Shaun; Gillies, Katie

2017-01-01

Objectives To explore trial site staff's perceptions regarding barriers and facilitators to local recruitment. Design Qualitative semi-structured interviews with a range of trial site staff from four trial sites in the UK. Interviews were analysed thematically to identify common themes across sites, barriers that could be addressed and facilitators that could be shared with other sites. Participants 11 members of staff from four trial sites: clinical grant Co-applicant (n=1); Principal Investigators (n=3); Consultant Urologist (n=1); Research Nurses (n=5); Research Assistant (n=1). Setting Embedded within an ongoing randomised controlled trial (the TISU trial). TISU is a UK multicentre trial comparing therapeutic interventions for ureteric stones. Results Our study draws attention to the initial and ongoing burden of trial work that is involved throughout the duration of a clinical trial. In terms of building and sustaining a research culture, trial staff described the ongoing work of engagement that was required to ensure that clinical staff were both educated and motivated to help with the process of identifying and screening potential participants. Having adequate and sufficient organisational and staffing resources was highlighted as being a necessary prerequisite to successful recruitment both in terms of accessing potentially eligible patients and being able to maximise recruitment after patient identification. The nature of the research study design can also potentially generate challenging communicative work for recruiting staff which can prove particularly problematic. Conclusions Our paper adds to existing research highlighting the importance of the hidden and complex work that is involved in clinical trial recruitment. Those designing and supporting the operationalisation of clinical trials must recognise and support the mitigation of this ‘work’. While much of the work is likely to be contextually sensitive at the level of local sites and for

A Qualitative Metasynthesis of Consultation Process Research: What We Know and Where to Go

ERIC Educational Resources Information Center

Newman, Daniel S.; McKenney, Elizabeth L. W.; Silva, Arlene E.; Clare, Mary; Salmon, Diane; Jackson, Safiyah

2017-01-01

Qualitative metasynthesis (QM) is a research methodology that permits the meaningful integration and interpretation of qualitative research. This study applies a QM approach combined with constructivist grounded theory methods, bolstered by several features of research credibility, to examine the state of consultee-centered consultation (CCC) and…

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets.

PubMed

Jones, Janet E; Jones, Laura L; Keeley, Thomas J H; Calvert, Melanie J; Mathers, Jonathan

2017-01-01

To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate the time and resources required to

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets

PubMed Central

2017-01-01

Background To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. Methods In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Results Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Conclusions Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate

Evaluating Process Sustainability Using Flowsheet Monitoring

EPA Science Inventory

Environmental metric software can be used to evaluate the sustainability of a chemical based on data from the chemical process that is used to manufacture it. One problem in developing environmental metric software is that chemical process simulation packages typically do not rea...

Defining Leadership: Collegiate Women's Learning Circles: A Qualitative Approach

ERIC Educational Resources Information Center

Preston-Cunningham, Tammie; Elbert, Chanda D.; Dooley, Kim E.

2017-01-01

The researchers employed qualitative methods to evaluate first-year female students' definition of "leadership" through involvement in the Women's Learning Circle. The findings revealed that students defined leadership in two dimensions: traits and behaviors. The qualitative findings explore a multidimensional approach to the voices of…

Facility Monitoring: A Qualitative Theory for Sensor Fusion

NASA Technical Reports Server (NTRS)

Figueroa, Fernando

2001-01-01

Data fusion and sensor management approaches have largely been implemented with centralized and hierarchical architectures. Numerical and statistical methods are the most common data fusion methods found in these systems. Given the proliferation and low cost of processing power, there is now an emphasis on designing distributed and decentralized systems. These systems use analytical/quantitative techniques or qualitative reasoning methods for date fusion.Based on other work by the author, a sensor may be treated as a highly autonomous (decentralized) unit. Each highly autonomous sensor (HAS) is capable of extracting qualitative behaviours from its data. For example, it detects spikes, disturbances, noise levels, off-limit excursions, step changes, drift, and other typical measured trends. In this context, this paper describes a distributed sensor fusion paradigm and theory where each sensor in the system is a HAS. Hence, given the reach qualitative information from each HAS, a paradigm and formal definitions are given so that sensors and processes can reason and make decisions at the qualitative level. This approach to sensor fusion makes it possible the implementation of intuitive (effective) methods to monitor, diagnose, and compensate processes/systems and their sensors. This paradigm facilitates a balanced distribution of intelligence (code and/or hardware) to the sensor level, the process/system level, and a higher controller level. The primary application of interest is in intelligent health management of rocket engine test stands.

Implementing nutrition guidelines for older people in residential care homes: a qualitative study using Normalization Process Theory

PubMed Central

2012-01-01

Background Optimizing the dietary intake of older people can prevent nutritional deficiencies and diet-related diseases, thereby improving quality of life. However, there is evidence that the nutritional intake of older people living in care homes is suboptimal, with high levels of saturated fat, salt, and added sugars. The UK Food Standards Agency therefore developed nutrient- and food-based guidance for residential care homes. The acceptability of these guidelines and their feasibility in practice is unknown. This study used the Normalization Process Theory (NPT) to understand the barriers and facilitators to implementing the guidelines and inform future implementation. Methods We conducted a process evaluation in five care homes in the north of England using qualitative methods (observation and interviews) to explore the views of managers, care staff, catering staff, and domestic staff. Data were analyzed thematically and discussed in data workshops; emerging themes were then mapped to the constructs of NPT. Results Many staff perceived the guidelines as unnecessarily restrictive and irrelevant to older people. In terms of NPT, the guidelines simply did not make sense (coherence), and as a result, relatively few staff invested in the guidelines (cognitive participation). Even where staff supported the guidelines, implementation was hampered by a lack of nutritional knowledge and institutional support (collective action). Finally, the absence of observable benefits to clients confirmed the negative preconceptions of many staff, with limited evidence of reappraisal following implementation (reflexive monitoring). Conclusions The successful implementation of the nutrition guidelines requires that the fundamental issues relating to their perceived value and fit with other priorities and goals be addressed. Specialist support is needed to equip staff with the technical knowledge and skills required for menu analysis and development and to devise ways of evaluating

A process evaluation accompanying an attempted randomized controlled trial of an evidence service for health system policymakers.

PubMed

Wilson, Michael G; Grimshaw, Jeremy M; Haynes, R Brian; Hanna, Steven E; Raina, Parminder; Gruen, Russell; Ouimet, Mathieu; Lavis, John N

2015-12-12

We developed an evidence service that draws inputs from Health Systems Evidence (HSE), which is a comprehensive database of research evidence about governance, financial and delivery arrangements within health systems and about implementation strategies relevant to health systems. Our goal was to evaluate whether, how and why a 'full-serve' evidence service increases the use of synthesized research evidence by policy analysts and advisors in the Ontario Ministry of Health and Long-Term Care as compared to a 'self-serve' evidence service. We attempted to conduct a two-arm, 10-month randomized controlled trial (RCT), along with a follow-up qualitative process evaluation, but we terminated the RCT when we failed to reach our recruitment target. For the qualitative process evaluation we modified the original interview guide to allow us to explore the (1) factors influencing participation in the trial; (2) usage of HSE, factors explaining usage patterns, and strategies to increase usage; (3) participation in training workshops and use of other supports; and (4) views about and experiences with key HSE features. We terminated the RCT given our 15% recruitment rate. Six factors were identified by those who had agreed to participate in the trial as encouraging their participation: relevance of the study to participants' own work; familiarity with the researchers; personal view of the importance of using research evidence in policymaking; academic background; support from supervisors; and participation of colleagues. Most reported that they never, infrequently or inconsistently used HSE and suggested strategies to increase its use, including regular email reminders and employee training. However, only two participants indicated that employee training, in the form of a workshop about finding and using research evidence, had influenced their use of HSE. Most participants found HSE features to be intuitive and helpful, although registration/sign-in and some page formats

Processing and property evaluation of metal matrix superconducting materials

NASA Technical Reports Server (NTRS)

Rao, Appajosula S.

1995-01-01

Metal - superconductor (YBCO) systems have been prepared and characterized by resistivity, ac susceptibility and dc SQUID magnetic moment measurements. The silver composites showed superconducting transition for all the composites processed and the superconducting transition temperature tends to depend upon the concentration of the silver in the composite. Aluminum composites showed an unusual resistivity results with two transitions around 90 K and 120 K. The superconducting property of silver composites can be explained qualitatively in terms of the proximity theory that has been suggested for the low temperature superconductors.

The Challenges of a Complex and Innovative Telehealth Project: A Qualitative Evaluation of the Eastern Quebec Telepathology Network.

PubMed

Alami, Hassane; Fortin, Jean-Paul; Gagnon, Marie-Pierre; Pollender, Hugo; Têtu, Bernard; Tanguay, France

2017-09-13

The Eastern Quebec Telepathology Network (EQTN) has been implemented in the province of Quebec (Canada) to support pathology and surgery practices in hospitals that are lack of pathologists, especially in rural and remote areas. This network includes 22 hospitals and serves a population of 1.7 million inhabitants spread over a vast territory. An evaluation of this network was conducted in order to identify and analyze the factors and issues associated with its implementation and deployment, as well as those related to its sustainability and expansion. Qualitative evaluative research based on a case study using: (1) historical analysis of the project documentation (newsletters, minutes of meetings, articles, ministerial documents, etc); (2) participation in meetings of the committee in charge of telehealth programs and the project; and (3) interviews, focus groups, and discussions with different stakeholders, including decision-makers, clinical and administrative project managers, clinicians (pathologists and surgeons), and technologists. Data from all these sources were cross-checked and synthesized through an integrative and interpretative process. The evaluation revealed numerous socio-political, regulatory, organizational, governance, clinical, professional, economic, legal and technological challenges related to the emergence and implementation of the project. In addition to technical considerations, the development of this network was associated with major changes and transformations of production procedures, delivery and organization of services, clinical practices, working methods, and clinicaladministrative processes and cultures (professional/organizational). The EQTN reflects the complex, structuring, and innovative projects that organizations and health systems are required to implement today. Future works should be more sensitive to the complexity associated with the emergence of telehealth networks and no longer reduce them to technological

How Qualitative Methods Can be Used to Inform Model Development.

PubMed

Husbands, Samantha; Jowett, Susan; Barton, Pelham; Coast, Joanna

2017-06-01

Decision-analytic models play a key role in informing healthcare resource allocation decisions. However, there are ongoing concerns with the credibility of models. Modelling methods guidance can encourage good practice within model development, but its value is dependent on its ability to address the areas that modellers find most challenging. Further, it is important that modelling methods and related guidance are continually updated in light of any new approaches that could potentially enhance model credibility. The objective of this article was to highlight the ways in which qualitative methods have been used and recommended to inform decision-analytic model development and enhance modelling practices. With reference to the literature, the article discusses two key ways in which qualitative methods can be, and have been, applied. The first approach involves using qualitative methods to understand and inform general and future processes of model development, and the second, using qualitative techniques to directly inform the development of individual models. The literature suggests that qualitative methods can improve the validity and credibility of modelling processes by providing a means to understand existing modelling approaches that identifies where problems are occurring and further guidance is needed. It can also be applied within model development to facilitate the input of experts to structural development. We recommend that current and future model development would benefit from the greater integration of qualitative methods, specifically by studying 'real' modelling processes, and by developing recommendations around how qualitative methods can be adopted within everyday modelling practice.

Doctors on Values and Advocacy: A Qualitative and Evaluative Study.

PubMed

Gallagher, Siun; Little, Miles

2017-12-01

Doctors are increasingly enjoined by their professional organisations to involve themselves in supraclinical advocacy, which embraces activities focused on changing practice and the system in order to address the social determinants of health. The moral basis for doctors' decisions on whether or not to do so has been the subject of little empirical research. This opportunistic qualitative study of the values of medical graduates associated with the Sydney Medical School explores the processes that contribute to doctors' decisions about taking up the advocate role. Our findings show that personal ideals were more important than professional commitments in shaping doctors' decisions on engagement in advocacy. Experiences in early life and during training, including exposure to power and powerlessness, significantly influenced their role choices. Doctors included supraclinical advocacy in their mature practices if it satisfied their desire to achieve excellence. These findings suggest that common approaches to promoting and facilitating advocacy as an individual professional obligation are not fully congruent with the experiences and values of doctors that are significant in creating the advocate. It would seem important to understand better the moral commitments inherent in advocacy to inform future developments in codes of medical ethics and medical education programs.

Decision making processes in people with symptoms of acute myocardial infarction: qualitative study

PubMed Central

Pattenden, Jill; Watt, Ian; Lewin, Robert J P; Stanford, Neil

2002-01-01

Objective To identify the themes that influence decision making processes used by patients with symptoms of acute myocardial infarction. Design Qualitative study using semistructured interviews. Setting Two district hospitals in North Yorkshire. Participants 22 patients admitted to hospital with confirmed second, third, or fourth acute myocardial infarction. Main outcome measure Patients' perceptions of their experience between the onset of symptoms and the decision to seek medical help. Results Six main themes that influence the decision making process were identified: appraisal of symptoms, perceived risk, previous experience, psychological and emotional factors, use of the NHS, and context of the event. Conclusions Knowledge of symptoms may not be enough to promote prompt action in the event of an acute myocardial infarction. Cognitive and emotional processes, individual beliefs and values, and the influence of the context of the event should also be considered in individual interventions designed to reduce delay in the event of symptoms of acute myocardial infarction. What is already known on this topicIndividual sociodemographic and clinical characteristics affect the time to seeking medical care in patients with symptoms of acute myocardial infarctionAppraisal of symptoms is difficult; people with classic and severe symptoms are more likely to take prompt actionWhat this study addsThe decision to seek medical help in patients who have had one or more previous myocardial infarctions is a complex processSimply providing patients with information on symptoms of acute myocardial infarction, and what to do in the event of these symptoms, may not be sufficient to promote prompt action PMID:11976241

10 CFR 709.15 - Processing counterintelligence evaluation results.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Processing counterintelligence evaluation results. 709.15... and Protection of National Security § 709.15 Processing counterintelligence evaluation results. (a) If... are significant unresolved issues, not exclusively related to polygraph examination results...

10 CFR 709.15 - Processing counterintelligence evaluation results.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 4 2014-01-01 2014-01-01 false Processing counterintelligence evaluation results. 709.15... and Protection of National Security § 709.15 Processing counterintelligence evaluation results. (a) If... are significant unresolved issues, not exclusively related to polygraph examination results...

10 CFR 709.15 - Processing counterintelligence evaluation results.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 4 2013-01-01 2013-01-01 false Processing counterintelligence evaluation results. 709.15... and Protection of National Security § 709.15 Processing counterintelligence evaluation results. (a) If... are significant unresolved issues, not exclusively related to polygraph examination results...

Automated Plasma Spray (APS) process feasibility study: Plasma spray process development and evaluation

NASA Technical Reports Server (NTRS)

Fetheroff, C. W.; Derkacs, T.; Matay, I. M.

1979-01-01

An automated plasma spray (APS) process was developed to apply two layer (NiCrAlY and ZrO2-12Y2O3) thermal-barrier coatings to aircraft gas turbine engine blade airfoils. The APS process hardware consists of four subsystems: a mechanical blade positioner incorporating two interlaced six-degree-of-freedom assemblies; a noncoherent optical metrology subsystem; a microprocessor-based adaptive system controller; and commercial plasma spray equipment. Over fifty JT9D first stage turbine blades specimens were coated with the APS process in preliminary checkout and evaluation studies. The best of the preliminary specimens achieved an overall coating thickness uniformity of + or - 53 micrometers, much better than is achievable manually. Factors limiting this performance were identified and process modifications were initiated accordingly. Comparative evaluations of coating thickness uniformity for manually sprayed and APS coated specimens were initiated. One of the preliminary evaluation specimens was subjected to a torch test and metallographic evaluation.

Methods for quantitative and qualitative evaluation of vaginal microflora during menstruation.

PubMed Central

Onderdonk, A B; Zamarchi, G R; Walsh, J A; Mellor, R D; Muñoz, A; Kass, E H

1986-01-01

The quantitative and qualitative changes in the bacterial flora of the vagina during menstruation have received inadequate study. Similarly, the effect of vaginal tampons on the microbial flora as well as the relationship between the microbial flora of the vagina and that of the tampon has not been adequately evaluated. The purposes of the present study were (i) to develop quantitative methods for studying the vaginal flora and the flora of tampons obtained during menstruation and (ii) to determine whether there were differences between the microflora of the tampon and that of the vaginal vault. Tampon and swab samples were obtained at various times from eight young healthy volunteers for 8 to 10 menstrual cycles. Samples consisted of swabs from women wearing menstrual pads compared with swab and tampon samples taken at various times during the menstrual cycle. Samples were analyzed for total facultative and anaerobic bacterial counts, and the six dominant bacterial species in each culture were identified. Statistical evaluation of the results indicates that total bacterial counts decreased during menstruation and that swab and tampon samples yielded similar total counts per unit weight of sample. The numbers of bacteria in tampons tended to be lower than in swabs taken at the same time. Overall, during menstruation, the concentrations of lactobacilli declined, but otherwise there was little difference among the species found during menstruation compared with those found in intermenstrual samples. Cotton tampons had little discernible effect on the microbial flora. PMID:3954346

Analyzing qualitative data with computer software.

PubMed Central

Weitzman, E A

1999-01-01

OBJECTIVE: To provide health services researchers with an overview of the qualitative data analysis process and the role of software within it; to provide a principled approach to choosing among software packages to support qualitative data analysis; to alert researchers to the potential benefits and limitations of such software; and to provide an overview of the developments to be expected in the field in the near future. DATA SOURCES, STUDY DESIGN, METHODS: This article does not include reports of empirical research. CONCLUSIONS: Software for qualitative data analysis can benefit the researcher in terms of speed, consistency, rigor, and access to analytic methods not available by hand. Software, however, is not a replacement for methodological training. PMID:10591282

Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series.

PubMed

Lewin, Simon; Booth, Andrew; Glenton, Claire; Munthe-Kaas, Heather; Rashidian, Arash; Wainwright, Megan; Bohren, Meghan A; Tunçalp, Özge; Colvin, Christopher J; Garside, Ruth; Carlsen, Benedicte; Langlois, Etienne V; Noyes, Jane

2018-01-25

The GRADE-CERQual ('Confidence in the Evidence from Reviews of Qualitative research') approach provides guidance for assessing how much confidence to place in findings from systematic reviews of qualitative research (or qualitative evidence syntheses). The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. Confidence in the evidence from qualitative evidence syntheses is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. CERQual provides a systematic and transparent framework for assessing confidence in individual review findings, based on consideration of four components: (1) methodological limitations, (2) coherence, (3) adequacy of data, and (4) relevance. A fifth component, dissemination (or publication) bias, may also be important and is being explored. As with the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach for effectiveness evidence, CERQual suggests summarising evidence in succinct, transparent, and informative Summary of Qualitative Findings tables. These tables are designed to communicate the review findings and the CERQual assessment of confidence in each finding. This article is the first of a seven-part series providing guidance on how to apply the CERQual approach. In this paper, we describe the rationale and conceptual basis for CERQual, the aims of the approach, how the approach was developed, and its main components. We also outline the purpose and structure of this series and discuss the growing role for qualitative evidence in decision-making. Papers 3, 4, 5, 6, and 7 in this series discuss each CERQual component, including the rationale for including the component in the approach, how the component is conceptualised, and how it should be assessed. Paper 2 discusses how to make an overall assessment of confidence in a review

Qualitative Evaluation of a New Tobacco Cessation Training Curriculum for Patient Navigators

PubMed Central

Shuk, Elyse; Krebs, Paul; Lu, Wei-Hsin; Burkhalter, Jack; Cortez-Weir, Jeralyn; Rodriguez, Rian; Burnside, Vanessa N.; Lubetkin, Erica I.

2011-01-01

Treatments for tobacco dependence exist but are underutilized, particularly among low-income and minority smokers. Patient navigation has been shown to help patients overcome barriers to quality care. In preparation for testing the feasibility of integrating tobacco cessation patient navigation into primary care, this paper describes the development and qualitative evaluation of a new curriculum for training patient navigators to address cessation treatment barriers faced by low-income, minority smokers who are advised to quit by their physicians. Thematic text analysis of transcripts obtained from focus groups with experienced patient navigators (n = 19) was conducted. Participants endorsed patient navigation as a relevant strategy for addressing tobacco cessation treatment barriers and made several recommendations regarding the knowledge, core competencies, and skills needed to conduct tobacco cessation patient navigation. This curriculum could be used by existing patient navigation training centers or made available as a self-guided continuing education program for experienced navigators who wish to expand their navigation interventions to include a tobacco cessation focus. PMID:21553331

Beyond Constant Comparison Qualitative Data Analysis: Using NVivo

ERIC Educational Resources Information Center

Leech, Nancy L.; Onwuegbuzie, Anthony J.

2011-01-01

The purposes of this paper are to outline seven types of qualitative data analysis techniques, to present step-by-step guidance for conducting these analyses via a computer-assisted qualitative data analysis software program (i.e., NVivo9), and to present screenshots of the data analysis process. Specifically, the following seven analyses are…

Secondary Students' Perceptions about Learning Qualitative Analysis in Inorganic Chemistry

NASA Astrophysics Data System (ADS)

Tan, Kim-Chwee Daniel; Goh, Ngoh-Khang; Chia, Lian-Sai; Treagust, David F.

2001-02-01

Grade 10 students in Singapore find qualitative analysis one of the more difficult topics in their external examinations. Fifty-one grade 10 students (15-17 years old) from three schools were interviewed to investigate their perceptions about learning qualitative analysis and the aspects of qualitative analysis they found difficult. The results showed that students found qualitative analysis tedious, difficult to understand and found the practical sessions unrelated to what they learned in class. They also believed that learning qualitative analysis required a great amount of memory work. It is proposed that their difficulties may arise from not knowing explicitly what is required in qualitative analysis, the content of qualitative analysis, the lack of motivation to understand qualitative analysis, cognitive overloading, and the lack of mastery of the required process skills.

EVALUATION OF ALTERNATIVE STRONIUM AND TRANSURANIC SEPARATION PROCESSES

DOE Office of Scientific and Technical Information (OSTI.GOV)

SMALLEY CS

2011-04-25

In order to meet contract requirements on the concentrations of strontium-90 and transuranic isotopes in the immobilized low-activity waste, strontium-90 and transuranics must be removed from the supernate of tanks 241-AN-102 and 241-AN-107. The process currently proposed for this application is an in-tank precipitation process using strontium nitrate and sodium permanganate. Development work on the process has not proceeded since 2005. The purpose of the evaluation is to identify whether any promising alternative processes have been developed since this issue was last examined, evaluate the alternatives and the baseline process, and recommend which process should be carried forward.

Validity, reliability, and generalizability in qualitative research

PubMed Central

Leung, Lawrence

2015-01-01

In general practice, qualitative research contributes as significantly as quantitative research, in particular regarding psycho-social aspects of patient-care, health services provision, policy setting, and health administrations. In contrast to quantitative research, qualitative research as a whole has been constantly critiqued, if not disparaged, by the lack of consensus for assessing its quality and robustness. This article illustrates with five published studies how qualitative research can impact and reshape the discipline of primary care, spiraling out from clinic-based health screening to community-based disease monitoring, evaluation of out-of-hours triage services to provincial psychiatric care pathways model and finally, national legislation of core measures for children's healthcare insurance. Fundamental concepts of validity, reliability, and generalizability as applicable to qualitative research are then addressed with an update on the current views and controversies. PMID:26288766

Swiss Armed Forces Organizational Level Leader Development: A Qualitative Case Study

DTIC Science & Technology

2017-06-09

chapter, divided in five distinct parts, describes the chosen research methodology , explain why the qualitative case study is appropriate to conduct...research study uses a qualitative methodology by performing a qualitative case study on the organizational level leader’s development process within...develop an in-depth understsanding of the phenomen.”82 Summary This research study uses a qualitative methodology by performing a case study on the

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Process evaluation to explore internal and external validity of the "Act in Case of Depression" care program in nursing homes.

PubMed

Leontjevas, Ruslan; Gerritsen, Debby L; Koopmans, Raymond T C M; Smalbrugge, Martin; Vernooij-Dassen, Myrra J F J

2012-06-01

A multidisciplinary, evidence-based care program to improve the management of depression in nursing home residents was implemented and tested using a stepped-wedge design in 23 nursing homes (NHs): "Act in case of Depression" (AiD). Before effect analyses, to evaluate AiD process data on sampling quality (recruitment and randomization, reach) and intervention quality (relevance and feasibility, extent to which AiD was performed), which can be used for understanding internal and external validity. In this article, a model is presented that divides process evaluation data into first- and second-order process data. Qualitative and quantitative data based on personal files of residents, interviews of nursing home professionals, and a research database were analyzed according to the following process evaluation components: sampling quality and intervention quality. Nursing home. The pattern of residents' informed consent rates differed for dementia special care units and somatic units during the study. The nursing home staff was satisfied with the AiD program and reported that the program was feasible and relevant. With the exception of the first screening step (nursing staff members using a short observer-based depression scale), AiD components were not performed fully by NH staff as prescribed in the AiD protocol. Although NH staff found the program relevant and feasible and was satisfied with the program content, individual AiD components may have different feasibility. The results on sampling quality implied that statistical analyses of AiD effectiveness should account for the type of unit, whereas the findings on intervention quality implied that, next to the type of unit, analyses should account for the extent to which individual AiD program components were performed. In general, our first-order process data evaluation confirmed internal and external validity of the AiD trial, and this evaluation enabled further statistical fine tuning. The importance of

Local media monitoring in process evaluation. Experiences from the Stockholm Diabetes Prevention Programme.

PubMed

Andersson, Camilla Maria; Bjärås, Gunilla; Tillgren, Per; Ostenson, Claes-Göran

2007-01-01

We present a rationale and approach for longitudinal analyses of media coverage and content, and illustrate how media monitoring can be used in process evaluations. Within a community-based diabetes prevention project, the Stockholm Diabetes Prevention Program, we analyzed the frequency, prominence, and framing of physical activity in local newspapers of three intervention and two control municipalities. In total, 2,128 stories and advertisements related to physical activity were identified between the years 1997 and 2002. Although stories about physical activity were relatively few (n = 224), they were prominently located in all five local newspapers. Physical activity was framed rather similarly in the municipalities. Health aspects, however, were expressed to a greater extent in stories in two of the intervention municipalities. A limited portion (14%) of the articles could be linked directly to the program. It is not possible to assess to what extent the program has had a disseminating effect on the newspapers' health-related content in general, due to weaknesses of the process tracking system and limitations of the study design. Implications for the design is that an evaluative framework should be preplanned and include data collection about media relationships, media's interest in public health, media coverage prior to the program and coverage in other media for comparisons of general trends in the reporting. The material and the current database, however, provide a good basis for quantitative content analysis and qualitative discourse analysis to yield information on the type, frequency, and content of health reporting in local newspapers.

Gaining insight into the Clinical Practice Guideline development processes: qualitative study in a workshop to implement the GRADE proposal in Spain

PubMed Central

Calderón, Carlos; Rotaeche, Rafael; Etxebarria, Arritxu; Marzo, Mercé; Rico, Rosa; Barandiaran, Marta

2006-01-01

Background The GRADE method represents a new approach to grading the quality of evidence and strength of recommendations in the preparation of Clinical Practice Guidelines (CPG). In the context of a pilot study to assess the implementability of the system in Spain, we considered it relevant to gain an insight into the significance of the perceptions and attitudes expressed by the actual experts participating in the system try-out. Methods Qualitative research with an ethnographic approach, through non-participant observation and focus groups within the context of a consensus workshop in which 19 CPG experts participated to evaluate the GRADE proposal using 12 evidence tables taken from hypertension, asthma and arthritis CPGs. The interventions were recorded, under a guarantee of confidentiality. The transcriptions and field notes were analyzed, based on a sociological discourse analysis model, and the provisional findings were re-sent to participants in order to improve their validity. Results 1) Certain problems over procedure and terminology hindered the acceptance of this new method as a common reference system for the preparation of CPGs. 2). A greater closeness to clinical practice was accompanied by concerns over value judgments and subjectivity, with a demand for greater explicitness in the consensus process. 3). The type of "evidence" on which the guidelines are based, how and by whom the evidence is prepared, and what the role of the different actors should be, all constitute unresolved concerns in the CPG preparation and implementation processes. 4). The grading process is not neutral: professional background, prior experience and the degree of leadership all condition the participants' input and interactions. Conclusion The findings obtained allow the quantitative evaluation to be better interpreted and, in turn, go beyond the particularities of the GRADE method. Adaptation to the complexities of clinical practice, the need for carefully designed multi

The Evaluator's Perspective: Evaluating the State Capacity Building Program.

ERIC Educational Resources Information Center

Madey, Doren L.

A historical antagonism between the advocates of quantitative evaluation methods and the proponents of qualitative evaluation methods has stymied the recognition of the value to be gained by utilizing both methodologies in the same study. The integration of quantitative and qualitative methods within a single evaluation has synergistic effects in…

Evaluation of Models of the Reading Process.

ERIC Educational Resources Information Center

Balajthy, Ernest

A variety of reading process models have been proposed and evaluated in reading research. Traditional approaches to model evaluation specify the workings of a system in a simplified fashion to enable organized, systematic study of the system's components. Following are several statistical methods of model evaluation: (1) empirical research on…

Qualitatively similar processing for own- and other-race faces: Evidence from efficiency and equivalent input noise.

PubMed

Shafai, Fakhri; Oruc, Ipek

2018-02-01

The other-race effect is the finding of diminished performance in recognition of other-race faces compared to those of own-race. It has been suggested that the other-race effect stems from specialized expert processes being tuned exclusively to own-race faces. In the present study, we measured recognition contrast thresholds for own- and other-race faces as well as houses for Caucasian observers. We have factored face recognition performance into two invariant aspects of visual function: efficiency, which is related to neural computations and processing demanded by the task, and equivalent input noise, related to signal degradation within the visual system. We hypothesized that if expert processes are available only to own-race faces, this should translate into substantially greater recognition efficiencies for own-race compared to other-race faces. Instead, we found similar recognition efficiencies for both own- and other-race faces. The other-race effect manifested as increased equivalent input noise. These results argue against qualitatively distinct perceptual processes. Instead they suggest that for Caucasian observers, similar neural computations underlie recognition of own- and other-race faces. Copyright © 2018 Elsevier Ltd. All rights reserved.

GoActive: a protocol for the mixed methods process evaluation of a school-based physical activity promotion programme for 13-14year old adolescents.

PubMed

Jong, Stephanie T; Brown, Helen Elizabeth; Croxson, Caroline H D; Wilkinson, Paul; Corder, Kirsten L; van Sluijs, Esther M F

2018-05-21

Process evaluations are critical for interpreting and understanding outcome trial results. By understanding how interventions function across different settings, process evaluations have the capacity to inform future dissemination of interventions. The complexity of Get others Active (GoActive), a 12-week, school-based physical activity intervention implemented in eight schools, highlights the need to investigate how implementation is achieved across a variety of school settings. This paper describes the mixed methods GoActive process evaluation protocol that is embedded within the outcome evaluation. In this detailed process evaluation protocol, we describe the flexible and pragmatic methods that will be used for capturing the process evaluation data. A mixed methods design will be used for the process evaluation, including quantitative data collected in both the control and intervention arms of the GoActive trial, and qualitative data collected in the intervention arm. Data collection methods will include purposively sampled, semi-structured interviews and focus group interviews, direct observation, and participant questionnaires (completed by students, teachers, older adolescent mentors, and local authority-funded facilitators). Data will be analysed thematically within and across datasets. Overall synthesis of findings will address the process of GoActive implementation, and through which this process affects outcomes, with careful attention to the context of the school environment. This process evaluation will explore the experience of participating in GoActive from the perspectives of key groups, providing a greater understanding of the acceptability and process of implementation of the intervention across the eight intervention schools. This will allow for appraisal of the intervention's conceptual base, inform potential dissemination, and help optimise post-trial sustainability. The process evaluation will also assist in contextualising the trial