Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles

PubMed Central

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-01-01

Objectives Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. Data Sources All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. Study Design All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Principal Findings Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ2(1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ2(1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Conclusion Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the

Qualitative versus quantitative methods in psychiatric research.

PubMed

Razafsha, Mahdi; Behforuzi, Hura; Azari, Hassan; Zhang, Zhiqun; Wang, Kevin K; Kobeissy, Firas H; Gold, Mark S

2012-01-01

Qualitative studies are gaining their credibility after a period of being misinterpreted as "not being quantitative." Qualitative method is a broad umbrella term for research methodologies that describe and explain individuals' experiences, behaviors, interactions, and social contexts. In-depth interview, focus groups, and participant observation are among the qualitative methods of inquiry commonly used in psychiatry. Researchers measure the frequency of occurring events using quantitative methods; however, qualitative methods provide a broader understanding and a more thorough reasoning behind the event. Hence, it is considered to be of special importance in psychiatry. Besides hypothesis generation in earlier phases of the research, qualitative methods can be employed in questionnaire design, diagnostic criteria establishment, feasibility studies, as well as studies of attitude and beliefs. Animal models are another area that qualitative methods can be employed, especially when naturalistic observation of animal behavior is important. However, since qualitative results can be researcher's own view, they need to be statistically confirmed, quantitative methods. The tendency to combine both qualitative and quantitative methods as complementary methods has emerged over recent years. By applying both methods of research, scientists can take advantage of interpretative characteristics of qualitative methods as well as experimental dimensions of quantitative methods.

"Phenomenology" and qualitative research methods.

PubMed

Nakayama, Y

1994-01-01

Phenomenology is generally based on phenomenological tradition from Husserl to Heidegger and Merleau-Ponty. As philosophical stances provide the assumptions in research methods, different philosophical stances produce different methods. However, the term "phenomenology" is used in various ways without the definition being given, such as phenomenological approach, phenomenological method, phenomenological research, etc. The term "phenomenology" is sometimes used as a paradigm and it is sometimes even viewed as synonymous with qualitative methods. As a result, the term "phenomenology" leads to conceptual confusions in qualitative research methods. The purpose of this paper is to examine the term "phenomenology" and explore philosophical assumptions, and discuss the relationship between philosophical stance and phenomenology as a qualitative research method in nursing.

Qualitative research methods for medical educators.

PubMed

Hanson, Janice L; Balmer, Dorene F; Giardino, Angelo P

2011-01-01

This paper provides a primer for qualitative research in medical education. Our aim is to equip readers with a basic understanding of qualitative research and prepare them to judge the goodness of fit between qualitative research and their own research questions. We provide an overview of the reasons for choosing a qualitative research approach and potential benefits of using these methods for systematic investigation. We discuss developing qualitative research questions, grounding research in a philosophical framework, and applying rigorous methods of data collection, sampling, and analysis. We also address methods to establish the trustworthiness of a qualitative study and introduce the reader to ethical concerns that warrant special attention when planning qualitative research. We conclude with a worksheet that readers may use for designing a qualitative study. Medical educators ask many questions that carefully designed qualitative research would address effectively. Careful attention to the design of qualitative studies will help to ensure credible answers that will illuminate many of the issues, challenges, and quandaries that arise while doing the work of medical education. Copyright © 2011 Academic Pediatric Association. All rights reserved.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

PubMed

Noyes, Jane; Booth, Andrew; Flemming, Kate; Garside, Ruth; Harden, Angela; Lewin, Simon; Pantoja, Tomas; Hannes, Karin; Cargo, Margaret; Thomas, James

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodological reporting in qualitative, quantitative, and mixed methods health services research articles.

PubMed

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-04-01

Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and

[Modality of combined methods of quantitative and qualitative research in evaluation of therapeutic effects of Chinese medicine].

PubMed

Liu, Jian-ping

2011-05-01

The core of evidence-based medicine lies in implementing the current best available evidence of clinical research to direct the decision making in clinical practice, incorporation of individual experience and value and preference of patients. However, the current evaluation method for clinical therapeutic effect cannot reflect the humanity and wholesomeness as well as individualized tailored treatment of Chinese medicine (CM) by using randomized controlled trials. This assay addressed the complex intervention of highly individualized treatment of CM and its societal characteristics, and the author proposes a model for the evaluation of therapeutic effects of CM in which quantitative and qualitative methods are combined, embodying the characteristics of the social and natural sciences in CM. The model can show the dynamic process of CM diagnosis and treatment from a perspective of the whole system and can be used for the evaluation of complex intervention of CM. We hope to raise a different thinking and method from the new drug development in the therapeutic effect evaluation.

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

PubMed

Holtrop, Jodi Summers; Rabin, Borsika A; Glasgow, Russell E

2018-03-13

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Qualitative methods in environmental health research.

PubMed Central

Brown, Phil

2003-01-01

Public health researchers increasingly turn to qualitative methods either on their own or in combination with quantitative methods. Qualitative methods are especially important to community environmental health research, as they provide a way to produce community narratives that give voice to individuals and characterize the community in a full and complex fashion. This article first traces the legacy of qualitative research in environmental health, then uses a case study of the author's experiences studying the Woburn, Massachusetts, childhood leukemia cluster to provide personal and scholarly insights on qualitative approaches. That material then informs a discussion of important components of qualitative methods in environmental health research, including flexible study design, access, trust, empathy, and personal shifts in the researcher's worldview, bias, and the nature of the researcher's roles. A concluding discussion addresses issues in funding policy and research practices. PMID:14594634

Teaching Qualitative Research Methods through Service-Learning

ERIC Educational Resources Information Center

Machtmes, Krisanna; Johnson, Earl; Fox, Janet; Burke, Mary S.; Harper, Jeannie; Arcemont, Lisa; Hebert, Lanette; Tarifa, Todd; Brooks, Roy C., Jr.; Reynaud, Andree L.; Deggs, David; Matzke, Brenda; Aguirre, Regina T. P.

2009-01-01

This paper is the result of a voluntary service-learning component in a qualitative research methods course. For this course, the service-learning project was the evaluation of the benefits to volunteers who work a crisis hotline for a local crisis intervention center. The service-learning course model used in this paper most closely resembles the…

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

Qualitative methods: beyond the cookbook.

PubMed

Harding, G; Gantley, M

1998-02-01

Qualitative methods appear increasingly in vogue in health services research (HSR). Such research, however, has utilized, often uncritically, a 'cookbook' of methods for data collection, and common-sense principles for data analysis. This paper argues that qualitative HSR benefits from recognizing and drawing upon theoretical principles underlying qualitative data collection and analysis. A distinction is drawn between problem-orientated and theory-orientated research, in order to illustrate how problem-orientated research would benefit from the introduction of theoretical perspectives in order to develop the knowledge base of health services research.

Teaching Qualitative Research Methods Using "Undercover Boss"

ERIC Educational Resources Information Center

Graham, LaKresha; Schuwerk, Tara J.

2017-01-01

Course(s): Research Methods, Qualitative Research Methods, Organizational Communication, Business Communication. Objectives: After completing this class exercise, students should be able to identify the major components of a qualitative research study, along with the ethical dilemmas that come with doing qualitative research.

Using Qualitative Research Methods in Higher Education

ERIC Educational Resources Information Center

Savenye, Wilhelmina C.; Robinson, Rhonda S.

2005-01-01

Researchers investigating issues related to computing in higher education are increasingly using qualitative research methods to conduct their investigations. However, they may have little training or experience in qualitative research. The purpose of this paper is to introduce researchers to the appropriate use of qualitative methods. It begins…

Further assessment of a method to estimate reliability and validity of qualitative research findings.

PubMed

Hinds, P S; Scandrett-Hibden, S; McAulay, L S

1990-04-01

The reliability and validity of qualitative research findings are viewed with scepticism by some scientists. This scepticism is derived from the belief that qualitative researchers give insufficient attention to estimating reliability and validity of data, and the differences between quantitative and qualitative methods in assessing data. The danger of this scepticism is that relevant and applicable research findings will not be used. Our purpose is to describe an evaluative strategy for use with qualitative data, a strategy that is a synthesis of quantitative and qualitative assessment methods. Results of the strategy and factors that influence its use are also described.

Qualitative Methods in Patient-Centered Outcomes Research.

PubMed

Vandermause, Roxanne; Barg, Frances K; Esmail, Laura; Edmundson, Lauren; Girard, Samantha; Perfetti, A Ross

2017-02-01

The Patient-Centered Outcomes Research Institute (PCORI), created to fund research guided by patients, caregivers, and the broader health care community, offers a new research venue. Many (41 of 50) first funded projects involved qualitative research methods. This study was completed to examine the current state of the science of qualitative methodologies used in PCORI-funded research. Principal investigators participated in phenomenological interviews to learn (a) how do researchers using qualitative methods experience seeking funding for, implementing and disseminating their work; and (b) how may qualitative methods advance the quality and relevance of evidence for patients? Results showed the experience of doing qualitative research in the current research climate as "Being a bona fide qualitative researcher: Staying true to research aims while negotiating challenges," with overlapping patterns: (a) researching the elemental, (b) expecting surprise, and (c) pushing boundaries. The nature of qualitative work today was explicitly described and is rendered in this article.

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

Methods for quantitative and qualitative evaluation of vaginal microflora during menstruation.

PubMed Central

Onderdonk, A B; Zamarchi, G R; Walsh, J A; Mellor, R D; Muñoz, A; Kass, E H

1986-01-01

The quantitative and qualitative changes in the bacterial flora of the vagina during menstruation have received inadequate study. Similarly, the effect of vaginal tampons on the microbial flora as well as the relationship between the microbial flora of the vagina and that of the tampon has not been adequately evaluated. The purposes of the present study were (i) to develop quantitative methods for studying the vaginal flora and the flora of tampons obtained during menstruation and (ii) to determine whether there were differences between the microflora of the tampon and that of the vaginal vault. Tampon and swab samples were obtained at various times from eight young healthy volunteers for 8 to 10 menstrual cycles. Samples consisted of swabs from women wearing menstrual pads compared with swab and tampon samples taken at various times during the menstrual cycle. Samples were analyzed for total facultative and anaerobic bacterial counts, and the six dominant bacterial species in each culture were identified. Statistical evaluation of the results indicates that total bacterial counts decreased during menstruation and that swab and tampon samples yielded similar total counts per unit weight of sample. The numbers of bacteria in tampons tended to be lower than in swabs taken at the same time. Overall, during menstruation, the concentrations of lactobacilli declined, but otherwise there was little difference among the species found during menstruation compared with those found in intermenstrual samples. Cotton tampons had little discernible effect on the microbial flora. PMID:3954346

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

PubMed

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development. To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care. Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients' experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor's knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. 'Resistance' emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a

Qualitative methods in PhD theses from general practice in Scandinavia.

PubMed

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-12-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox.

Qualitative methods in PhD theses from general practice in Scandinavia

PubMed Central

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-01-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox. PMID:29094644

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

PubMed

Tonkin-Crine, Sarah; Anthierens, Sibyl; Hood, Kerenza; Yardley, Lucy; Cals, Jochen W L; Francis, Nick A; Coenen, Samuel; van der Velden, Alike W; Godycki-Cwirko, Maciek; Llor, Carl; Butler, Chris C; Verheij, Theo J M; Goossens, Herman; Little, Paul

2016-05-12

Mixed methods are commonly used in health services research; however, data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point-of-care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs' and patients' experiences of taking part in the trial. Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with (1) 62 patients and (2) 66 GPs and quantitative data collected via questionnaires with (3) 2886 patients and (4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence. Three instances of dissonance occurred in 39 independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt that the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested that this was unnecessary if a full explanation was given. Whilst qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet. Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient

Criteria for quantitative and qualitative data integration: mixed-methods research methodology.

PubMed

Lee, Seonah; Smith, Carrol A M

2012-05-01

Many studies have emphasized the need and importance of a mixed-methods approach for evaluation of clinical information systems. However, those studies had no criteria to guide integration of multiple data sets. Integrating different data sets serves to actualize the paradigm that a mixed-methods approach argues; thus, we require criteria that provide the right direction to integrate quantitative and qualitative data. The first author used a set of criteria organized from a literature search for integration of multiple data sets from mixed-methods research. The purpose of this article was to reorganize the identified criteria. Through critical appraisal of the reasons for designing mixed-methods research, three criteria resulted: validation, complementarity, and discrepancy. In applying the criteria to empirical data of a previous mixed methods study, integration of quantitative and qualitative data was achieved in a systematic manner. It helped us obtain a better organized understanding of the results. The criteria of this article offer the potential to produce insightful analyses of mixed-methods evaluations of health information systems.

Promoting and evaluating scientific rigour in qualitative research.

PubMed

Baillie, Lesley

2015-07-15

This article explores perspectives on qualitative research and the variety of views concerning rigour in the research process. Evaluating and ensuring the quality of research are essential considerations for practitioners who are appraising evidence to inform their practice or research. Several criteria and principles for evaluating quality in qualitative research are presented, recognising that their application in practice is influenced by the qualitative methodology used. The article examines a range of techniques that a qualitative researcher can use to promote rigour and apply it to practice.

A quantitative and qualitative evaluation of trainee opinions of four methods of personality disorder diagnosis.

PubMed

Nelson, Sharon M; Huprich, Steven K; Shankar, Sneha; Sohnleitner, Aimee; Paggeot, Amy V

2017-07-01

Four methods of how to assess and diagnose personality disorders have received much attention within the literature: the Shedler-Westen Assessment Procedure (Shedler & Westen, 1998), the DSM-5 Section III Personality Disorders section (APA, 2011), the DSM-5 Section III trait model (APA, 2013), and the Psychodynamic Diagnostic Manual (PDM; PDM Task Force, 2006) descriptions of 15 personality disorders. Given that much of the debate has been driven by clinician concerns, it is important to consider clinical utility when evaluating the usefulness of each method. The present study compares the 4 models on ratings of several dimensions of clinical utility provided by 329 graduate student clinicians and psychology interns from across the United States. Findings suggest that participants rated the DSM-5 trait model significantly higher in most clinical utility domains. Additionally, qualitative analyses of the open-ended responses provided by participants indicated that each method had strengths and weaknesses. Most notably, participants commented positively on the PDM's level of comprehensiveness and appreciated the SWAP-II's inclusion of a health category, despite the ease of use not being as highly rated for these methods. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Comparison study on qualitative and quantitative risk assessment methods for urban natural gas pipeline network.

PubMed

Han, Z Y; Weng, W G

2011-05-15

In this paper, a qualitative and a quantitative risk assessment methods for urban natural gas pipeline network are proposed. The qualitative method is comprised of an index system, which includes a causation index, an inherent risk index, a consequence index and their corresponding weights. The quantitative method consists of a probability assessment, a consequences analysis and a risk evaluation. The outcome of the qualitative method is a qualitative risk value, and for quantitative method the outcomes are individual risk and social risk. In comparison with previous research, the qualitative method proposed in this paper is particularly suitable for urban natural gas pipeline network, and the quantitative method takes different consequences of accidents into consideration, such as toxic gas diffusion, jet flame, fire ball combustion and UVCE. Two sample urban natural gas pipeline networks are used to demonstrate these two methods. It is indicated that both of the two methods can be applied to practical application, and the choice of the methods depends on the actual basic data of the gas pipelines and the precision requirements of risk assessment. Crown Copyright © 2011. Published by Elsevier B.V. All rights reserved.

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

1988-01-01

Discusses qualitative research and its application to educational evaluation. Approaches discussed include the following: (1) ethnography; (2) naturalistic inquiry; (3) generic pragmatic (sociological) inquiry; (4) connoisseurship/criticism; (5) metaphors; and (6) phenomenography. (FMW)

Qualitative research methods in renal medicine: an introduction.

PubMed

Bristowe, Katherine; Selman, Lucy; Murtagh, Fliss E M

2015-09-01

Qualitative methodologies are becoming increasingly widely used in health research. However, within some specialties, including renal medicine, qualitative approaches remain under-represented in the high-impact factor journals. Qualitative research can be undertaken: (i) as a stand-alone research method, addressing specific research questions; (ii) as part of a mixed methods approach alongside quantitative approaches or (iii) embedded in clinical trials, or during the development of complex interventions. The aim of this paper is to introduce qualitative research, including the rationale for choosing qualitative approaches, and guidance for ensuring quality when undertaking and reporting qualitative research. In addition, we introduce types of qualitative data (observation, interviews and focus groups) as well as some of the most commonly encountered methodological approaches (case studies, ethnography, phenomenology, grounded theory, thematic analysis, framework analysis and content analysis). © The Author 2015. Published by Oxford University Press on behalf of ERA-EDTA. All rights reserved.

Educational Accountability: A Qualitatively Driven Mixed-Methods Approach

ERIC Educational Resources Information Center

Hall, Jori N.; Ryan, Katherine E.

2011-01-01

This article discusses the importance of mixed-methods research, in particular the value of qualitatively driven mixed-methods research for quantitatively driven domains like educational accountability. The article demonstrates the merits of qualitative thinking by describing a mixed-methods study that focuses on a middle school's system of…

Qualitative methods: what are they and why use them?

PubMed Central

Sofaer, S

1999-01-01

OBJECTIVE: To provide an overview of reasons why qualitative methods have been used and can be used in health services and health policy research, to describe a range of specific methods, and to give examples of their application. DATA SOURCES: Classic and contemporary descriptions of the underpinnings and applications of qualitative research methods and studies that have used such methods to examine important health services and health policy issues. PRINCIPAL FINDINGS: Qualitative research methods are valuable in providing rich descriptions of complex phenomena; tracking unique or unexpected events; illuminating the experience and interpretation of events by actors with widely differing stakes and roles; giving voice to those whose views are rarely heard; conducting initial explorations to develop theories and to generate and even test hypotheses; and moving toward explanations. Qualitative and quantitative methods can be complementary, used in sequence or in tandem. The best qualitative research is systematic and rigorous, and it seeks to reduce bias and error and to identify evidence that disconfirms initial or emergent hypotheses. CONCLUSIONS: Qualitative methods have much to contribute to health services and health policy research, especially as such research deals with rapid change and develops a more fully integrated theory base and research agenda. However, the field must build on the best traditions and techniques of qualitative methods and must recognize that special training and experience are essential to the application of these methods. PMID:10591275

Qualitative methods in quantum theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Migdal, A.B.

The author feels that the solution of most problems in theoretical physics begins with the application of qualitative methods - dimensional estimates and estimates made from simple models, the investigation of limiting cases, the use of the analytic properties of physical quantities, etc. This book proceeds in this spirit, rather than in a formal, mathematical way with no traces of the sweat involved in the original work left to show. The chapters are entitled Dimensional and model approximations, Various types of perturbation theory, The quasi-classical approximation, Analytic properties of physical quantities, Methods in the many-body problem, and Qualitative methods inmore » quantum field theory. Each chapter begins with a detailed introduction, in which the physical meaning of the results obtained in that chapter is explained in a simple way. 61 figures. (RWR)« less

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing

Qualitative Descriptive Methods in Health Science Research.

PubMed

Colorafi, Karen Jiggins; Evans, Bronwynne

2016-07-01

The purpose of this methodology paper is to describe an approach to qualitative design known as qualitative descriptive that is well suited to junior health sciences researchers because it can be used with a variety of theoretical approaches, sampling techniques, and data collection strategies. It is often difficult for junior qualitative researchers to pull together the tools and resources they need to embark on a high-quality qualitative research study and to manage the volumes of data they collect during qualitative studies. This paper seeks to pull together much needed resources and provide an overview of methods. A step-by-step guide to planning a qualitative descriptive study and analyzing the data is provided, utilizing exemplars from the authors' research. This paper presents steps to conducting a qualitative descriptive study under the following headings: describing the qualitative descriptive approach, designing a qualitative descriptive study, steps to data analysis, and ensuring rigor of findings. The qualitative descriptive approach results in a summary in everyday, factual language that facilitates understanding of a selected phenomenon across disciplines of health science researchers. © The Author(s) 2016.

African Swine Fever in Uganda: Qualitative Evaluation of Three Surveillance Methods with Implications for Other Resource-Poor Settings.

PubMed

Chenais, Erika; Sternberg-Lewerin, Susanna; Boqvist, Sofia; Emanuelson, Ulf; Aliro, Tonny; Tejler, Emma; Cocca, Giampaolo; Masembe, Charles; Ståhl, Karl

2015-01-01

Animal diseases impact negatively on households and on national economies. In low-income countries, this pertains especially to socio-economic effects on household level. To control animal diseases and mitigate their impact, it is necessary to understand the epidemiology of the disease in its local context. Such understanding, gained through disease surveillance, is often lacking in resource-poor settings. Alternative surveillance methods have been developed to overcome some of the hurdles obstructing surveillance. The objective of this study was to evaluate and qualitatively compare three methods for surveillance of acute infectious diseases using African swine fever in northern Uganda as an example. Report-driven outbreak investigations, participatory rural appraisals (PRAs), and a household survey using a smartphone application were evaluated. All three methods had good disease-detecting capacity, and each of them detected many more outbreaks compared to those reported to the World Organization for Animal Health during the same time period. Apparent mortality rates were similar for the three methods although highest for the report-driven outbreak investigations, followed by the PRAs, and then the household survey. The three methods have different characteristics and the method of choice will depend on the surveillance objective. The optimal situation might be achieved by a combination of the methods: outbreak detection via smartphone-based real-time surveillance, outbreak investigation for collection of biological samples, and a PRA for a better understanding of the epidemiology of the specific outbreak. All three methods require initial investments and continuous efforts. The sustainability of the surveillance system should, therefore, be carefully evaluated before making such investments.

Single-Case Designs and Qualitative Methods: Applying a Mixed Methods Research Perspective

ERIC Educational Resources Information Center

Hitchcock, John H.; Nastasi, Bonnie K.; Summerville, Meredith

2010-01-01

The purpose of this conceptual paper is to describe a design that mixes single-case (sometimes referred to as single-subject) and qualitative methods, hereafter referred to as a single-case mixed methods design (SCD-MM). Minimal attention has been given to the topic of applying qualitative methods to SCD work in the literature. These two…

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment.

PubMed

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment

PubMed Central

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action. PMID:28992759

Active thermography in qualitative evaluation of protective materials.

PubMed

Gralewicz, Grzegorz; Wiecek, Bogusław

2009-01-01

This is a study of the possibilities of a qualitative evaluation of protective materials with active thermography. It presents a simulation of a periodic excitation of a multilayer composite material. Tests were conducted with lock-in thermography on Kevlar composite consisting of 16 layers of Kevlar fabric reinforced with formaldehyde resin with implanted delamination defects. Lock-in thermography is a versatile tool for nondestructive evaluation. It is a fast, remote and nondestructive procedure. Hence, it was used to detect delaminations in the composite structure of materials used in the production of components designed for personal protection. This method directly contributes to an improvement in safety.

Origins, Methods and Advances in Qualitative Meta-Synthesis

ERIC Educational Resources Information Center

Nye, Elizabeth; Melendez-Torres, G. J.; Bonell, Chris

2016-01-01

Qualitative research is a broad term encompassing many methods. Critiques of the field of qualitative research argue that while individual studies provide rich descriptions and insights, the absence of connections drawn between studies limits their usefulness. In response, qualitative meta-synthesis serves as a design to interpret and synthesise…

Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

PubMed

Wang, Karen E; Fitzpatrick, Caroline; George, David; Lane, Lindsey

2012-01-01

Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their effectiveness as evaluators. The objective is to examine affiliate faculty members' attitudes toward clinical clerkship evaluation using primarily qualitative research methods. The study used a nonexperimental research design and employed mixed methods. Data were collected through interviews, focus groups, and a questionnaire from 11 affiliate faculty members. Themes emerging from the data fell into three broad categories: (a) factors that influence grading, (b) consequences of negative evaluations, and (c) disconnections in the grading process. The quantitative portion of the study revealed important discrepancies supporting the use of qualitative methods. The study highlights faculty members' struggles with the evaluative process and emphasizes the need for improvements in evaluation tools and faculty development.

Challenges of teacher-based clinical evaluation from nursing students' point of view: Qualitative content analysis.

PubMed

Sadeghi, Tabandeh; Seyed Bagheri, Seyed Hamid

2017-01-01

Clinical evaluation is very important in the educational system of nursing. One of the most common methods of clinical evaluation is evaluation by the teacher, but the challenges that students would face in this evaluation method, have not been mentioned. Thus, this study aimed to explore the experiences and views of nursing students about the challenges of teacher-based clinical evaluation. This study was a descriptive qualitative study with a qualitative content analysis approach. Data were gathered through semi-structured focused group sessions with undergraduate nursing students who were passing their 8 th semester at Rafsanjan University of Medical Sciences. Date were analyzed using Graneheim and Lundman's proposed method. Data collection and analysis were concurrent. According to the findings, "factitious evaluation" was the main theme of study that consisted of three categories: "Personal preferences," "unfairness" and "shirking responsibility." These categories are explained using quotes derived from the data. According to the results of this study, teacher-based clinical evaluation would lead to factitious evaluation. Thus, changing this approach of evaluation toward modern methods of evaluation is suggested. The finding can help nursing instructors to get a better understanding of the nursing students' point of view toward this evaluation approach and as a result could be planning for changing of this approach.

[Qualitative Research in Health Services Research - Discussion Paper, Part 3: Quality of Qualitative Research].

PubMed

Stamer, M; Güthlin, C; Holmberg, C; Karbach, U; Patzelt, C; Meyer, T

2015-12-01

The third and final discussion paper of the German Network of Health Services Research's (DNVF) "Qualitative Methods Working Group" demonstrates methods for the evaluation and quality of qualitative research in health services research. In this paper we discuss approaches described in evaluating qualitative studies, including: an orientation to the general principles of empirical research, an approach-specific course of action, as well as procedures based on the research-process and criteria-oriented approaches. Divided into general and specific aspects to be considered in a qualitative study quality evaluation, the central focus of the discussion paper undertakes an extensive examination of the process and criteria-oriented approaches. The general aspects include the participation of relevant groups in the research process as well as ethical aspects of the research and data protection issues. The more specific aspects in evaluating the quality of qualitative research include considerations about the research interest, research questions, and the selection of data collection methods and types of analyses. The formulated questions are intended to guide reviewers and researchers to evaluate and to develop qualitative research projects appropriately. The intention of this discussion paper is to ensure a transparent research culture, and to reflect on and discuss the methodological and research approach of qualitative studies in health services research. With this paper we aim to initiate a discussion on high quality evaluation of qualitative health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Qualitative data collection and analysis methods: the INSTINCT trial.

PubMed

Meurer, William J; Frederiksen, Shirley M; Majersik, Jennifer J; Zhang, Lingling; Sandretto, Annette; Scott, Phillip A

2007-11-01

Patient care practices often lag behind current scientific evidence and professional guidelines. The failure of such knowledge translation (KT) efforts may reflect inadequate assessment and management of specific barriers confronting both physicians and patients at the point of treatment level. Effective KT in this setting may benefit from the use of qualitative methods to identify and overcome these barriers. Qualitative methodology allows in-depth exploration of the barriers involved in adopting practice change and has been infrequently used in emergency medicine research. The authors describe the methodology for qualitative analysis within the INcreasing Stroke Treatment through INteractive behavioral Change Tactics (INSTINCT) trial. This includes processes for valid data collection and reliable analysis of the textual data from focus group and interview transcripts. INSTINCT is a 24-hospital, randomized, controlled study that is designed to evaluate a system-based barrier assessment and interactive educational intervention to increase appropriate tissue plasminogen activator (tPA) use in ischemic stroke. Intervention hospitals undergo baseline barrier assessment using both qualitative as well as quantitative (survey) techniques. Investigators obtain data on local barriers to tPA use, as well as information on local attitudes, knowledge, and beliefs regarding acute stroke treatment. Targeted groups at each site include emergency physicians, emergency nurses, neurologists, radiologists, and hospital administrators. Transcript analysis using NVivo7 with a predefined barrier taxonomy is described. This will provide both qualitative insight on thrombolytic use and importance of specific barrier types for each site. The qualitative findings subsequently direct the form of professional education efforts and system interventions at treatment sites.

What can acute medicine learn from qualitative methods?

PubMed

Heasman, Brett; Reader, Tom W

2015-10-01

The contribution of qualitative methods to evidence-based medicine is growing, with qualitative studies increasingly used to examine patient experience and unsafe organizational cultures. The present review considers qualitative research recently conducted on teamwork and organizational culture in the ICU and also other acute domains. Qualitative studies have highlighted the importance of interpersonal and social aspects of healthcare on managing and responding to patient care needs. Clear/consistent communication, compassion, and trust underpin successful patient-physician interactions, with improved patient experiences linked to patient safety and clinical effectiveness across a wide range of measures and outcomes. Across multidisciplinary teams, good communication facilitates shared understanding, decision-making and coordinated action, reducing patient risk in the process. Qualitative methods highlight the complex nature of risk management in hospital wards, which is highly contextualized to the demands and resources available, and influenced by multilayered social contexts. In addition to augmenting quantitative research, qualitative investigations enable the investigation of questions on social behaviour that are beyond the scope of quantitative assessment alone. To develop improved patient-centred care, health professionals should therefore consider integrating qualitative procedures into their existing assessments of patient/staff satisfaction.

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

[Advantages and disadvantages of incorporating qualitative methodology in the evaluation of health services. A practical case: evaluation of a high-resolution clinic].

PubMed

Alvarez Del Arco, D; Rodríguez Rieiro, C; Sanchidrián De Blás, C; Alejos, B; Plá Mestre, R

2012-01-01

We examined the usefulness of incorporating a qualitative phase in the evaluation of the quality of care in a high-resolution medical service carried out with quantitative methods. A quantitative research was performed using a structured questionnaire and selecting interviewees by systematic randomized sampling methods (n=320). In addition, a qualitative research was carried on through semi-structured interviews with patients selected by convenience criteria (n=11), observations in the care assistance circuit, and a group interview with health professionals working in the service. A multidisciplinary research team conducted an individual analysis of the information collected in both quantitative and qualitative phases. Subsequently, three meetings based on group brainstorming techniques were held to identify the diverse contributions of each of the methodologies employed to the research, using affinity graphs to analyse the different results obtained in both phases and evaluate possible bias arising from the use of qualitative methods. Qualitative research allowed examining specific aspects of the health care service that had been collected in the quantitative phase, harmonizing the results obtained in the previous phase, giving in-depth data on the reasons for patient dissatisfaction with specific aspects, such as waiting times and available infrastructures, and identifying emerging issues of the service which had not been previously assessed. Overall, the qualitative phase enriched the results of the research. It is appropriate and recommendable to incorporate this methodological approach in research aimed at evaluating the quality of the service in specific health care settings, since it is provided first hand, by the voice of the customer. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

How Qualitative Methods Can be Used to Inform Model Development.

PubMed

Husbands, Samantha; Jowett, Susan; Barton, Pelham; Coast, Joanna

2017-06-01

Decision-analytic models play a key role in informing healthcare resource allocation decisions. However, there are ongoing concerns with the credibility of models. Modelling methods guidance can encourage good practice within model development, but its value is dependent on its ability to address the areas that modellers find most challenging. Further, it is important that modelling methods and related guidance are continually updated in light of any new approaches that could potentially enhance model credibility. The objective of this article was to highlight the ways in which qualitative methods have been used and recommended to inform decision-analytic model development and enhance modelling practices. With reference to the literature, the article discusses two key ways in which qualitative methods can be, and have been, applied. The first approach involves using qualitative methods to understand and inform general and future processes of model development, and the second, using qualitative techniques to directly inform the development of individual models. The literature suggests that qualitative methods can improve the validity and credibility of modelling processes by providing a means to understand existing modelling approaches that identifies where problems are occurring and further guidance is needed. It can also be applied within model development to facilitate the input of experts to structural development. We recommend that current and future model development would benefit from the greater integration of qualitative methods, specifically by studying 'real' modelling processes, and by developing recommendations around how qualitative methods can be adopted within everyday modelling practice.

Expediting the Analysis of Qualitative Data in Evaluation: A Procedure for the Rapid Identification of Themes from Audio Recordings (RITA)

ERIC Educational Resources Information Center

Neal, Jennifer Watling; Neal, Zachary P.; VanDyke, Erika; Kornbluh, Mariah

2015-01-01

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

Critiquing qualitative research.

PubMed

Beck, Cheryl Tatano

2009-10-01

The ability to critique research is a valuable skill that is fundamental to a perioperative nurse's ability to base his or her clinical practice on evidence derived from research. Criteria differ for critiquing a quantitative versus a qualitative study (ie, statistics are evaluated in a quantitative study, but not in a qualitative study). This article provides on guidelines for assessing qualitative research. Excerpts from a published qualitative research report are summarized and then critiqued. Questions are provided that help evaluate different sections of a research study (eg, sample, data collection methods, data analysis).

New method for qualitative simulations of water resources systems. 2. Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Antunes, M.P.; Seixas, M.J.; Camara, A.S.

1987-11-01

SLIN (Simulacao Linguistica) is a new method for qualitative dynamic simulation. As was presented previously, SLIN relies upon a categorical representation of variables which are manipulated by logical rules. Two applications to water resources systems are included to illustrate SLIN's potential usefulness: the environmental impact evaluation of a hydropower plant and the assessment of oil dispersion in the sea after a tanker wreck.

Ethnographic methods for process evaluations of complex health behaviour interventions.

PubMed

Morgan-Trimmer, Sarah; Wood, Fiona

2016-05-04

This article outlines the contribution that ethnography could make to process evaluations for trials of complex health-behaviour interventions. Process evaluations are increasingly used to examine how health-behaviour interventions operate to produce outcomes and often employ qualitative methods to do this. Ethnography shares commonalities with the qualitative methods currently used in health-behaviour evaluations but has a distinctive approach over and above these methods. It is an overlooked methodology in trials of complex health-behaviour interventions that has much to contribute to the understanding of how interventions work. These benefits are discussed here with respect to three strengths of ethnographic methodology: (1) producing valid data, (2) understanding data within social contexts, and (3) building theory productively. The limitations of ethnography within the context of process evaluations are also discussed.

Qualitative Research Methods in Education and Educational Technology. Research Methods for Educational Technology

ERIC Educational Resources Information Center

Willis, Jerry W.

2008-01-01

"Qualitative Research Methods in Education and Educational Technology" was written for students and scholars interested in exploring the many qualitative methods developed over the last 50 years in the social sciences. The book does not stop, however, at the boundaries of the social sciences. Social scientists now consume and use research methods…

The Use of Triangulation Methods in Qualitative Educational Research

ERIC Educational Resources Information Center

Oliver-Hoyo, Maria; Allen, DeeDee

2006-01-01

Triangulation involves the careful reviewing of data collected through different methods in order to achieve a more accurate and valid estimate of qualitative results for a particular construct. This paper describes how we used three qualitative methods of data collection to study attitudes of students toward graphing, hands-on activities, and…

The norm and the text: Denzin and Lincoln's handbooks of qualitative method.

PubMed

Fielding, N G

1999-09-01

Qualitative methods have lately enjoyed enhanced legitimacy and are increasingly used in academic and applied social research. Yet the field is marked by controversy about virtually every key tenet of qualitative inquiry, from matters of epistemology to purely practical matters of relations with research subjects. Not only is the practice of qualitative research hotly contested, consensus is lacking about the purpose of qualitative research and whether it has a distinctive role to play relative to other approaches to the study of social phenomena. Against this context, the handbooks of qualitative method edited by Norman Denzin and Yvonna Lincoln represent a significant attempt to capture the breadth of contemporary approaches to qualitative method. The article examines key contributions from the handbooks, drawing on these to develop a view of qualitative method from a pragmatic, realist perspective. Among the issues considered are the significance of relativism, subjectivity, post-modernism and feminist method, the politicization of the purposes of qualitative research, the debate over criteria of validity, and the move to treat qualitative research as an entertainment rather than a scientific practice.

The scope for qualitative methods in research and clinical trials in dementia.

PubMed

Gibson, Grant; Timlin, Alison; Curran, Stephen; Wattis, John

2004-07-01

In the evaluation of drugs, the randomised double-blind placebo controlled trial is the 'gold standard'. This method, based on a positivist paradigm, answers questions about efficacy and side-effects of treatments that are accepted as valid, reliable and generalisable, provided the study is well designed and properly conducted. In contrast, qualitative research methodologies, originating from the social sciences, embrace a variety of approaches, including phenomenological and other paradigms. Within clinical and health services research, qualitative approaches view the world more subjectively, acknowledging that the researcher is part of what is researched, focusing on meanings and understanding of experience, rather than on what can be reduced to quantitative measures. They can develop new ideas through induction from data, rather than confirming or refuting hypotheses. Qualitative methods have improved our understanding of the experiences of people with dementia and, if used alongside clinical trials, could be used to improve the relevance of outcomes to patients, compliance and user involvement. They could also possibly generate new measures of efficacy and effectiveness in severe dementia.

The Role of Qualitative Research Methods in Discrete Choice Experiments

PubMed Central

Vass, Caroline; Rigby, Dan; Payne, Katherine

2017-01-01

Background. The use of qualitative research (QR) methods is recommended as good practice in discrete choice experiments (DCEs). This study investigated the use and reporting of QR to inform the design and/or interpretation of healthcare-related DCEs and explored the perceived usefulness of such methods. Methods. DCEs were identified from a systematic search of the MEDLINE database. Studies were classified by the quantity of QR reported (none, basic, or extensive). Authors (n = 91) of papers reporting the use of QR were invited to complete an online survey eliciting their views about using the methods. Results. A total of 254 healthcare DCEs were included in the review; of these, 111 (44%) did not report using any qualitative methods; 114 (45%) reported “basic” information; and 29 (11%) reported or cited “extensive” use of qualitative methods. Studies reporting the use of qualitative methods used them to select attributes and/or levels (n = 95; 66%) and/or pilot the DCE survey (n = 26; 18%). Popular qualitative methods included focus groups (n = 63; 44%) and interviews (n = 109; 76%). Forty-four studies (31%) reported the analytical approach, with content (n = 10; 7%) and framework analysis (n = 5; 4%) most commonly reported. The survey identified that all responding authors (n = 50; 100%) found that qualitative methods added value to their DCE study, but many (n = 22; 44%) reported that journals were uninterested in the reporting of QR results. Conclusions. Despite recommendations that QR methods be used alongside DCEs, the use of QR methods is not consistently reported. The lack of reporting risks the inference that QR methods are of little use in DCE research, contradicting practitioners’ assessments. Explicit guidelines would enable more clarity and consistency in reporting, and journals should facilitate such reporting via online supplementary materials. PMID:28061040

Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research

PubMed Central

SALE, JOANNA E. M.; LOHFELD, LYNNE H.; BRAZIL, KEVIN

2015-01-01

Health care research includes many studies that combine quantitative and qualitative methods. In this paper, we revisit the quantitative-qualitative debate and review the arguments for and against using mixed-methods. In addition, we discuss the implications stemming from our view, that the paradigms upon which the methods are based have a different view of reality and therefore a different view of the phenomenon under study. Because the two paradigms do not study the same phenomena, quantitative and qualitative methods cannot be combined for cross-validation or triangulation purposes. However, they can be combined for complementary purposes. Future standards for mixed-methods research should clearly reflect this recommendation. PMID:26523073

The Role of Qualitative Research Methods in Discrete Choice Experiments.

PubMed

Vass, Caroline; Rigby, Dan; Payne, Katherine

2017-04-01

The use of qualitative research (QR) methods is recommended as good practice in discrete choice experiments (DCEs). This study investigated the use and reporting of QR to inform the design and/or interpretation of healthcare-related DCEs and explored the perceived usefulness of such methods. DCEs were identified from a systematic search of the MEDLINE database. Studies were classified by the quantity of QR reported (none, basic, or extensive). Authors ( n = 91) of papers reporting the use of QR were invited to complete an online survey eliciting their views about using the methods. A total of 254 healthcare DCEs were included in the review; of these, 111 (44%) did not report using any qualitative methods; 114 (45%) reported "basic" information; and 29 (11%) reported or cited "extensive" use of qualitative methods. Studies reporting the use of qualitative methods used them to select attributes and/or levels ( n = 95; 66%) and/or pilot the DCE survey ( n = 26; 18%). Popular qualitative methods included focus groups ( n = 63; 44%) and interviews ( n = 109; 76%). Forty-four studies (31%) reported the analytical approach, with content ( n = 10; 7%) and framework analysis ( n = 5; 4%) most commonly reported. The survey identified that all responding authors ( n = 50; 100%) found that qualitative methods added value to their DCE study, but many ( n = 22; 44%) reported that journals were uninterested in the reporting of QR results. Despite recommendations that QR methods be used alongside DCEs, the use of QR methods is not consistently reported. The lack of reporting risks the inference that QR methods are of little use in DCE research, contradicting practitioners' assessments. Explicit guidelines would enable more clarity and consistency in reporting, and journals should facilitate such reporting via online supplementary materials.

High Resolution Qualitative and Quantitative MR Evaluation of the Glenoid Labrum

PubMed Central

Iwasaki, Kenyu; Tafur, Monica; Chang, Eric Y.; SherondaStatum; Biswas, Reni; Tran, Betty; Bae, Won C.; Du, Jiang; Bydder, Graeme M.; Chung, Christine B.

2015-01-01

Objective To implement qualitative and quantitative MR sequences for the evaluation of labral pathology. Methods Six glenoid labra were dissected and the anterior and posterior portions were divided into normal, mildly degenerated, or severely degenerated groups using gross and MR findings. Qualitative evaluation was performed using T1-weighted, proton density-weighted (PD), spoiled gradient echo (SPGR) and ultra-short echo time (UTE) sequences. Quantitative evaluation included T2 and T1rho measurements as well as T1, T2*, and T1rho measurements acquired with UTE techniques. Results SPGR and UTE sequences best demonstrated labral fiber structure. Degenerated labra had a tendency towards decreased T1 values, increased T2/T2* values and increased T1 rho values. T2* values obtained with the UTE sequence allowed for delineation between normal, mildly degenerated and severely degenerated groups (p<0.001). Conclusion Quantitative T2* measurements acquired with the UTE technique are useful for distinguishing between normal, mildly degenerated and severely degenerated labra. PMID:26359581

[Essential characteristics of qualitative research and its commonly used methods].

PubMed

Zhang, Hong-wei

2008-02-01

The main objectives of qualitative research lies in exploring the opinion, attitude, behavior, and experience of a person as a social role, also a patient. This essay introduces the basic characteristics of qualitative research, including its natural property, inductive method adopted, open character and wholism concept; the results of qualitative research are presented in a text form; and its commonly used methods include observation, individual interview and focus group discussion.

Developing students' qualitative muscles in an introductory methods course.

PubMed

SmithBattle, Lee

2014-08-30

The exponential growth of qualitative research (QR) has coincided with methodological innovations, the proliferation of qualitative textbooks and journals, and the greater availability of qualitative methods courses. In spite of these advances, the pedagogy for teaching qualitative methods has received little attention. This paper provides a philosophical foundation for teaching QR with active learning strategies and shows how active learning is fully integrated into a one-semester course. The course initiates students into qualitative dispositions and skills as students develop study aims and procedures; enter the field to gather data; analyze the full set of student-generated data; and write results in a final report. Conducting a study in one semester is challenging but has proven feasible and disabuses students of the view that QR is simple, unscientific, or non-rigorous. Student reflections on course assignments are integrated into the paper. The strengths and limitations of this pedagogical approach are also described.

Enhancing Institutional Assessment Efforts through Qualitative Methods

ERIC Educational Resources Information Center

Van Note Chism, Nancy; Banta, Trudy W.

2007-01-01

Qualitative methods can do much to describe context and illuminate the why behind patterns encountered in institutional assessment. Alone, or in combination with quantitative methods, they should be the approach of choice for many of the most important assessment questions. (Contains 1 table.)

Clustering Methods with Qualitative Data: A Mixed Methods Approach for Prevention Research with Small Samples

PubMed Central

Henry, David; Dymnicki, Allison B.; Mohatt, Nathaniel; Allen, James; Kelly, James G.

2016-01-01

Qualitative methods potentially add depth to prevention research, but can produce large amounts of complex data even with small samples. Studies conducted with culturally distinct samples often produce voluminous qualitative data, but may lack sufficient sample sizes for sophisticated quantitative analysis. Currently lacking in mixed methods research are methods allowing for more fully integrating qualitative and quantitative analysis techniques. Cluster analysis can be applied to coded qualitative data to clarify the findings of prevention studies by aiding efforts to reveal such things as the motives of participants for their actions and the reasons behind counterintuitive findings. By clustering groups of participants with similar profiles of codes in a quantitative analysis, cluster analysis can serve as a key component in mixed methods research. This article reports two studies. In the first study, we conduct simulations to test the accuracy of cluster assignment using three different clustering methods with binary data as produced when coding qualitative interviews. Results indicated that hierarchical clustering, K-Means clustering, and latent class analysis produced similar levels of accuracy with binary data, and that the accuracy of these methods did not decrease with samples as small as 50. Whereas the first study explores the feasibility of using common clustering methods with binary data, the second study provides a “real-world” example using data from a qualitative study of community leadership connected with a drug abuse prevention project. We discuss the implications of this approach for conducting prevention research, especially with small samples and culturally distinct communities. PMID:25946969

Clustering Methods with Qualitative Data: a Mixed-Methods Approach for Prevention Research with Small Samples.

PubMed

Henry, David; Dymnicki, Allison B; Mohatt, Nathaniel; Allen, James; Kelly, James G

2015-10-01

Qualitative methods potentially add depth to prevention research but can produce large amounts of complex data even with small samples. Studies conducted with culturally distinct samples often produce voluminous qualitative data but may lack sufficient sample sizes for sophisticated quantitative analysis. Currently lacking in mixed-methods research are methods allowing for more fully integrating qualitative and quantitative analysis techniques. Cluster analysis can be applied to coded qualitative data to clarify the findings of prevention studies by aiding efforts to reveal such things as the motives of participants for their actions and the reasons behind counterintuitive findings. By clustering groups of participants with similar profiles of codes in a quantitative analysis, cluster analysis can serve as a key component in mixed-methods research. This article reports two studies. In the first study, we conduct simulations to test the accuracy of cluster assignment using three different clustering methods with binary data as produced when coding qualitative interviews. Results indicated that hierarchical clustering, K-means clustering, and latent class analysis produced similar levels of accuracy with binary data and that the accuracy of these methods did not decrease with samples as small as 50. Whereas the first study explores the feasibility of using common clustering methods with binary data, the second study provides a "real-world" example using data from a qualitative study of community leadership connected with a drug abuse prevention project. We discuss the implications of this approach for conducting prevention research, especially with small samples and culturally distinct communities.

Methodological Reflections on the Contribution of Qualitative Research to the Evaluation of Clinical Ethics Support Services.

PubMed

Wäscher, Sebastian; Salloch, Sabine; Ritter, Peter; Vollmann, Jochen; Schildmann, Jan

2017-05-01

This article describes a process of developing, implementing and evaluating a clinical ethics support service intervention with the goal of building up a context-sensitive structure of minimal clinical-ethics in an oncology department without prior clinical ethics structure. Scholars from different disciplines have called for an improvement in the evaluation of clinical ethics support services (CESS) for different reasons over several decades. However, while a lot has been said about the concepts and methodological challenges of evaluating CESS up to the present time, relatively few empirical studies have been carried out. The aim of this article is twofold. On the one hand, it describes a process of development, modifying and evaluating a CESS intervention as part of the ETHICO research project, using the approach of qualitative-formative evaluation. On the other hand, it provides a methodological analysis which specifies the contribution of qualitative empirical methods to the (formative) evaluation of CESS. We conclude with a consideration of the strengths and limitations of qualitative evaluation research with regards to the evaluation and development of context sensitive CESS. We further discuss our own approach in contrast to rather traditional consult or committee models. © 2017 John Wiley & Sons Ltd.

Evaluating Student-Generated Film as a Learning Tool for Qualitative Methods: Geographical "Drifts" and the City

ERIC Educational Resources Information Center

Anderson, Jon

2013-01-01

Film as a tool for learning offers considerable opportunity for enhancing student understanding. This paper reflects on the experiences of a project that required students to make a short film demonstrating their practical understanding of qualitative methods. In the psychogeographical tradition, students were asked to "drift" across the…

Using Radar Charts with Qualitative Evaluation: Techniques to Assess Change in Blended Learning

ERIC Educational Resources Information Center

Kaczynski, Dan; Wood, Leigh; Harding, Ansie

2008-01-01

When university academics implement changes in learning, such as introducing blended learning, it is conventional practice to examine and evaluate the impact of the resulting curriculum reform. Judging the worth and impact of an educational development is a complex task involving subtle differences in learning. Qualitative methods to explore these…

Qualitative Parameters for Evaluation Procedures of Non-Formal and Informal Learning Achievements

ERIC Educational Resources Information Center

Stasiunaitiene, Egle; Kaminskiene, Lina

2009-01-01

The article introduces evaluation principles of non-formal and informal learning that determine the quality of evaluation, describes stages of the evaluation procedure, differentiates their qualitative parameters and defines their criteria and indicators. It also brings in the discussion that consideration of qualitative parameters for the…

[Application and Integration of Qualitative and Quantitative Research Methods in Intervention Studies in Rehabilitation Research].

PubMed

Wirtz, M A; Strohmer, J

2016-06-01

In order to develop and evaluate interventions in rehabilitation research a wide range of empirical research methods may be adopted. Qualitative research methods emphasize the relevance of an open research focus and a natural proximity to research objects. Accordingly, using qualitative methods special benefits may arise if researchers strive to identify and organize unknown information aspects (inductive purpose). Particularly, quantitative research methods require a high degree of standardization and transparency of the research process. Furthermore, a clear definition of efficacy and effectiveness exists (deductive purpose). These paradigmatic approaches are characterized by almost opposite key characteristics, application standards, purposes and quality criteria. Hence, specific aspects have to be regarded if researchers aim to select or combine those approaches in order to ensure an optimal gain in knowledge. © Georg Thieme Verlag KG Stuttgart · New York.

Qualitative Assessment of Inquiry-Based Teaching Methods

ERIC Educational Resources Information Center

Briggs, Michael; Long, George; Owens, Katrina

2011-01-01

A new approach to teaching method assessment using student focused qualitative studies and the theoretical framework of mental models is proposed. The methodology is considered specifically for the advantages it offers when applied to the assessment of inquiry-based teaching methods. The theoretical foundation of mental models is discussed, and…

Myths and Misconceptions about Using Qualitative Methods in Assessment

ERIC Educational Resources Information Center

Harper, Shaun R.; Kuh, George D.

2007-01-01

The value of qualitative assessment approaches has been underestimated primarily because they are often juxtaposed against long-standing quantitative traditions and the widely accepted premise that the best research produces generalizable and statistically significant findings. Institutional researchers avoid qualitative methods for at least three…

Using mixed methods to develop and evaluate an online weight management intervention.

PubMed

Bradbury, Katherine; Dennison, Laura; Little, Paul; Yardley, Lucy

2015-02-01

This article illustrates the use of mixed methods in the development and evaluation of the Positive Online Weight Reduction (POWeR) programme, an e-health intervention designed to support sustainable weight loss. The studies outlined also explore how human support might enhance intervention usage and weight loss. Mixed methods were used to develop and evaluate POWeR. In the development phase, we drew on both quantitative and qualitative findings to plan and gain feedback on the intervention. Next, a feasibility trial, with nested qualitative study, explored what level of human support might lead to the most sustainable weight loss. Finally, a large community-based trial of POWeR, with nested qualitative study, explored whether the addition of brief telephone coaching enhances usage. Findings suggest that POWeR is acceptable and potentially effective. Providing human support enhanced usage in our trials, but was not unproblematic. Interestingly, there were some indications that more basic (brief) human support may produce more sustainable weight loss outcomes than more regular support. Qualitative interviews suggested that more regular support might foster reliance, meaning patients cannot sustain their weight losses when support ends. Qualitative findings in the community trial also suggested explanations for why many people may not take up the opportunity for human support. Integrating findings from both our qualitative and quantitative studies provided far richer insights than would have been gained using only a single method of inquiry. Further research should investigate the optimum delivery of human support needed to maximize sustainable weight loss in online interventions. Statement of contribution What is already known on this subject? There is evidence that human support may increase the effectiveness of e-health interventions. It is unclear what level of human support might be optimal or how human support improves effectiveness. Triangulation of

A Critical Review of Qualitative Research Methods in Evaluating Nursing Curriculum Models: Implication for Nursing Education in the Arab World

ERIC Educational Resources Information Center

Devadas, Briliya

2016-01-01

Aim: The purpose of this critical literature review was to examine qualitative studies done on innovative nursing curriculums in order to determine which qualitative methods have been most effective in investigating the effectiveness of the curriculum and which would be most appropriate in an Arab Islamic country. Data Sources: At least 25 studies…

Blending quantitative and qualitative methods in language research and intervention.

PubMed

Brinton, Bonnie; Fujiki, Martin

2003-05-01

Best practice in speech-language pathology should be informed by current research findings. Traditional research methods are not always geared to address some of the complex, individual questions that arise in clinical intervention, however. Qualitative research methods may provide useful tools for bridging the gap from research to practice. Combinations of qualitative and quantitative procedures may be particularly helpful in sorting out some of the important issues surrounding language intervention in both clinical and research contexts. Examples of research blending qualitative and quantitative methods, as well as the case study of Sid, an 11-year-old boy with specific language impairment, are presented to illustrate how a combination of procedures can be used to enhance language research and intervention.

A new method for qualitative simulation of water resources systems: 2. Applications

NASA Astrophysics Data System (ADS)

Antunes, M. P.; Seixas, M. J.; Camara, A. S.; Pinheiro, M.

1987-11-01

SLIN (Simulação Linguistica) is a new method for qualitative dynamic simulation. As was presented previously (Camara et al., this issue), SLIN relies upon a categorical representation of variables which are manipulated by logical rules. Two applications to water resources systems are included to illustrate SLIN's potential usefulness: the environmental impact evaluation of a hydropower plant and the assessment of oil dispersion in the sea after a tanker wreck.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

Moving Beyond a Deficit Perspective with Qualitative Research Methods.

ERIC Educational Resources Information Center

Anzul, Margaret; Evans, Judith F.; King, Rita; Tellier-Robinson, Dora

2001-01-01

Four researchers argue the merits of qualitative methodology and its particular relevance to those in special education who seek to move beyond a deficit perspective. Unconstrained by defined variables and decontextualized settings, qualitative methods allowed the researchers to extend the scope of their studies beyond originally stated research…

Qualitative PCR method for Roundup Ready soybean: interlaboratory study.

PubMed

Kodama, Takashi; Kasahara, Masaki; Minegishi, Yasutaka; Futo, Satoshi; Sawada, Chihiro; Watai, Masatoshi; Akiyama, Hiroshi; Teshima, Reiko; Kurosawa, Yasunori; Furui, Satoshi; Hino, Akihiro; Kitta, Kazumi

2011-01-01

Quantitative and qualitative methods based on PCR have been developed for genetically modified organisms (GMO). Interlaboratory studies were previously conducted for GMO quantitative methods; in this study, an interlaboratory study was conducted for a qualitative method for a GM soybean, Roundup Ready soy (RR soy), with primer pairs designed for the quantitative method of RR soy studied previously. Fourteen laboratories in Japan participated. Each participant extracted DNA from 1.0 g each of the soy samples containing 0, 0.05, and 0.10% of RR soy, and performed PCR with primer pairs for an internal control gene (Le1) and RR soy followed by agarose gel electrophoresis. The PCR product amplified in this PCR system for Le1 was detected from all samples. The sensitivity, specificity, and false-negative and false-positive rates of the method were obtained from the results of RR soy detection. False-negative rates at the level of 0.05 and 0.10% of the RR soy samples were 6.0 and 2.3%, respectively, revealing that the LOD of the method was somewhat below 0.10%. The current study demonstrated that the qualitative method would be practical for monitoring the labeling system of GM soy in kernel lots.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

Qualitative Reasoning methods for CELSS modeling.

PubMed

Guerrin, F; Bousson, K; Steyer JPh; Trave-Massuyes, L

1994-11-01

Qualitative Reasoning (QR) is a branch of Artificial Intelligence that arose from research on engineering problem solving. This paper describes the major QR methods and techniques, which, we believe, are capable of addressing some of the problems that are emphasized in the literature and posed by CELSS modeling, simulation, and control at the supervisory level.

How are qualitative methods used in diabetes research? A 30-year systematic review.

PubMed

Hennink, Monique M; Kaiser, Bonnie N; Sekar, Swathi; Griswold, Emily P; Ali, Mohammed K

2017-02-01

We aimed to describe how qualitative methods are used in global research on diabetes and identify opportunities whereby qualitative methods could further benefit our understanding of the human experience of diabetes and interventions to address it. We conducted a systematic review of National Library of Medicine, EMBASE, and Web of Science electronic databases to identify original research articles that used qualitative methods to study diabetes between 1980 and 2011. We identified 554 eligible articles and categorised these by geographic region, year of publication, study population, study design, research question, qualitative data collection methods, and journal type. Results show low use of qualitative methods in diabetes research over the past 30 years. The majority of articles (75%) reported using substantive qualitative research, while mixed-methods research has remained underutilised. Eighty-five per cent of articles reported studies conducted in North America or Europe, with few studies in developing countries. Most articles reported recruiting clinic-based populations (58%). Over half (54%) of research questions focused on patient experience and 24% on diabetes management. Qualitative methods can provide important insights about socio-cultural aspects of disease to improve disease management. However, they remain underutilised for understanding the diabetes experience, especially in Africa and Asia and amongst non-clinic populations.

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 4: methods for assessing evidence on intervention implementation.

PubMed

Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Booth, Andrew; Harden, Angela; Hannes, Karin; Thomas, James; Flemming, Kate; Garside, Ruth; Noyes, Jane

2018-05-01

This article provides reviewers with guidance on methods for identifying and processing evidence to understand intervention implementation. Strategies, tools, and methods are applied to the systematic review process to illustrate how process and implementation can be addressed using quantitative, qualitative, and other sources of evidence (i.e., descriptive textual and nonempirical). Reviewers can take steps to navigate the heterogeneity and level of uncertainty present in the concepts, measures, and methods used to assess implementation. Activities can be undertaken in advance of a Cochrane quantitative review to develop program theory and logic models that situate implementation in the causal chain. Four search strategies are offered to retrieve process and implementation evidence. Recommendations are made for addressing rigor or risk of bias in process evaluation or implementation evidence. Strategies are recommended for locating and extracting data from primary studies. The basic logic is presented to assist reviewers to make initial review-level judgments about implementation failure and theory failure. Although strategies, tools, and methods can assist reviewers to address process and implementation using quantitative, qualitative, and other forms of evidence, few exemplar reviews exist. There is a need for further methodological development and trialing of proposed approaches. Copyright © 2017 Elsevier Inc. All rights reserved.

Advancing the study of violence against women using mixed methods: integrating qualitative methods into a quantitative research program.

PubMed

Testa, Maria; Livingston, Jennifer A; VanZile-Tamsen, Carol

2011-02-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women's sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided.

Health systems research training enhances workplace research skills: a qualitative evaluation.

PubMed

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager perceptions of the usefulness, in the work setting, of skills taught on a health systems research education course in South Africa and to assess the extent to which the course stimulated awareness and development of health systems research in the work setting. The education course was evaluated using a qualitative approach. Respondents were selected for interview using purposive sampling. Interviews were conducted with 39 respondents, including all of the major stakeholders. The interviews lasted between 20 and 60 minutes and were conducted either face to face or over the telephone. Thematic analysis was applied to the data, and key themes were identified. The course demystified health systems research and stimulated interest in reading and applying research findings. The course also changed participants' attitudes to routine data collection and was reported to have facilitated the application of informal research or problem-solving methods to everyday work situations. However, inadequate support within the workplace was a significant obstacle to applying the skills learned. A 2-week intensive, experiential course in health systems research methods can provide a mechanism for introducing basic research skills to a wide range of learners. Qualitative evaluation is a useful approach for assessing the impacts of education courses.

Qualitative research in CKD: an overview of methods and applications.

PubMed

Tong, Allison; Winkelmayer, Wolfgang C; Craig, Jonathan C

2014-09-01

There recently has been a paradigm shift in health care policies and research toward greater patient centeredness. A core tenet of patient-centered care is that patients' needs, values, and preferences are respected in clinical decision making. Qualitative research methods are designed to generate insights about patients' priorities, values, and beliefs. However, in the past 5 years (2008-2013), only 23 (0.4%) of the 6,043 original articles published in the top 5 nephrology journals (assessed by impact factor) were qualitative studies. Given this observation, it seems important to promote awareness and better understanding within the nephrology community about qualitative research and how the findings can contribute to improving the quality and outcomes of care for patients with chronic kidney disease. This article outlines examples of how qualitative research can generate insight into the values and preferences of patients with chronic kidney disease, provides an overview of qualitative health research methods, and discusses practical applications for research, practice, and policy. Copyright © 2014 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

ADVANCING THE STUDY OF VIOLENCE AGAINST WOMEN USING MIXED METHODS: INTEGRATING QUALITATIVE METHODS INTO A QUANTITATIVE RESEARCH PROGRAM

PubMed Central

Testa, Maria; Livingston, Jennifer A.; VanZile-Tamsen, Carol

2011-01-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women’s sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided. PMID:21307032

Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study

PubMed Central

Glenton, Claire; Oxman, Andrew D

2009-01-01

Objective To examine the use of qualitative approaches alongside randomised trials of complex healthcare interventions. Design Review of randomised controlled trials of interventions to change professional practice or the organisation of care. Data sources Systematic sample of 100 trials published in English from the register of the Cochrane Effective Practice and Organisation of Care Review Group. Methods Published and unpublished qualitative studies linked to the randomised controlled trials were identified through database searches and contact with authors. Data were extracted from each study by two reviewers using a standard form. We extracted data describing the randomised controlled trials and qualitative studies, the quality of these studies, and how, if at all, the qualitative and quantitative findings were combined. A narrative synthesis of the findings was done. Results 30 of the 100 trials had associated qualitative work and 19 of these were published studies. 14 qualitative studies were done before the trial, nine during the trial, and four after the trial. 13 studies reported an explicit theoretical basis and 11 specified their methodological approach. Approaches to sampling and data analysis were poorly described. For most cases (n=20) we found no indication of integration of qualitative and quantitative findings at the level of either analysis or interpretation. The quality of the qualitative studies was highly variable. Conclusions Qualitative studies alongside randomised controlled trials remain uncommon, even where relatively complex interventions are being evaluated. Most of the qualitative studies were carried out before or during the trials with few studies used to explain trial results. The findings of the qualitative studies seemed to be poorly integrated with those of the trials and often had major methodological shortcomings. PMID:19744976

The Design, Development, and Evaluation of a Qualitative Data Collection Application for Pregnant Women.

PubMed

Keedle, Hazel; Schmied, Virginia; Burns, Elaine; Dahlen, Hannah

2018-01-01

This article explores the development and evaluation of a smartphone mobile software application (app) to collect qualitative data. The app was specifically designed to capture real-time qualitative data from women planning a vaginal birth after caesarean delivery. This article outlines the design and development of the app to include funding, ethics, and the recruitment of an app developer, as well as the evaluation of using the app by seven participants. Data collection methods used in qualitative research include interviews and focus groups (either online, face-to-face, or by phone), participant diaries, or observations of interactions. This article identifies an alternative data collection methodology using a smartphone app to collect real-time data. The app provides real-time data and instant access to data alongside the ability to access participants from a variety of locations. This allows the researcher to gain insight into the experiences of participants through audio or video recordings in longitudinal studies without the need for constant interactions or interviews with participants. Using smartphone applications can allow researchers to access participants who are traditionally hard to reach and access their data in real time. Evaluating these apps before use in research is invaluable. © 2017 Sigma Theta Tau International.

"Hand in Glove": Using Qualitative Methods to Connect Research and Practice.

PubMed

Harper, Liam D; McCunn, Robert

2017-08-01

Recent work has espoused the idea that in applied sporting environments, "fast"-working practitioners should work together with "slow"-working researchers. However, due to economical and logistical constraints, such a coupling may not always be practical. Therefore, alternative means of combining research and applied practice are needed. A particular methodology that has been used in recent years is qualitative research. Examples of qualitative methods include online surveys, 1-on-1 interviews, and focus groups. This article discusses the merits of using qualitative methods to combine applied practice and research in sport science. This includes a discussion of recent examples of the use of such methods in published journal articles, a critique of the approaches employed, and future directions and recommendations. The authors encourage both practitioners and researchers to use and engage with qualitative research with the ultimate goal of benefiting athlete health and sporting performance.

Reporting Qualitative Research: Standards, Challenges, and Implications for Health Design.

PubMed

Peditto, Kathryn

2018-04-01

This Methods column describes the existing reporting standards for qualitative research, their application to health design research, and the challenges to implementation. Intended for both researchers and practitioners, this article provides multiple perspectives on both reporting and evaluating high-quality qualitative research. Two popular reporting standards exist for reporting qualitative research-the Consolidated Criteria for Reporting Qualitative Research (COREQ) and the Standards for Reporting Qualitative Research (SRQR). Though compiled using similar procedures, they differ in their criteria and the methods to which they apply. Creating and applying reporting criteria is inherently difficult due to the undefined and fluctuating nature of qualitative research when compared to quantitative studies. Qualitative research is expansive and occasionally controversial, spanning many different methods of inquiry and epistemological approaches. A "one-size-fits-all" standard for reporting qualitative research can be restrictive, but COREQ and SRQR both serve as valuable tools for developing responsible qualitative research proposals, effectively communicating research decisions, and evaluating submissions. Ultimately, tailoring a set of standards specific to health design research and its frequently used methods would ensure quality research and aid reviewers in their evaluations.

Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute.

PubMed

Petticrew, Mark; Rehfuess, Eva; Noyes, Jane; Higgins, Julian P T; Mayhew, Alain; Pantoja, Tomas; Shemilt, Ian; Sowden, Amanda

2013-11-01

Although there is increasing interest in the evaluation of complex interventions, there is little guidance on how evidence from complex interventions may be reviewed and synthesized, and the relevance of the plethora of evidence synthesis methods to complexity is unclear. This article aims to explore how different meta-analytical approaches can be used to examine aspects of complexity; describe the contribution of various narrative, tabular, and graphical approaches to synthesis; and give an overview of the potential choice of selected qualitative and mixed-method evidence synthesis approaches. The methodological discussions presented here build on a 2-day workshop held in Montebello, Canada, in January 2012, involving methodological experts from the Campbell and Cochrane Collaborations and from other international review centers (Anderson L, Petticrew M, Chandler J, et al. systematic reviews of complex interventions. In press). These systematic review methodologists discussed the broad range of existing methods and considered the relevance of these methods to reviews of complex interventions. The evidence from primary studies of complex interventions may be qualitative or quantitative. There is a wide range of methodological options for reviewing and presenting this evidence. Specific contributions of statistical approaches include the use of meta-analysis, meta-regression, and Bayesian methods, whereas narrative summary approaches provide valuable precursors or alternatives to these. Qualitative and mixed-method approaches include thematic synthesis, framework synthesis, and realist synthesis. A suitable combination of these approaches allows synthesis of evidence for understanding complex interventions. Reviewers need to consider which aspects of complex interventions should be a focus of their review and what types of quantitative and/or qualitative studies they will be including, and this will inform their choice of review methods. These may range from

Methodology or method? A critical review of qualitative case study reports.

PubMed

Hyett, Nerida; Kenny, Amanda; Dickson-Swift, Virginia

2014-01-01

Despite on-going debate about credibility, and reported limitations in comparison to other approaches, case study is an increasingly popular approach among qualitative researchers. We critically analysed the methodological descriptions of published case studies. Three high-impact qualitative methods journals were searched to locate case studies published in the past 5 years; 34 were selected for analysis. Articles were categorized as health and health services (n=12), social sciences and anthropology (n=7), or methods (n=15) case studies. The articles were reviewed using an adapted version of established criteria to determine whether adequate methodological justification was present, and if study aims, methods, and reported findings were consistent with a qualitative case study approach. Findings were grouped into five themes outlining key methodological issues: case study methodology or method, case of something particular and case selection, contextually bound case study, researcher and case interactions and triangulation, and study design inconsistent with methodology reported. Improved reporting of case studies by qualitative researchers will advance the methodology for the benefit of researchers and practitioners.

Methodology or method? A critical review of qualitative case study reports

PubMed Central

Hyett, Nerida; Kenny, Amanda; Dickson-Swift, Virginia

2014-01-01

Despite on-going debate about credibility, and reported limitations in comparison to other approaches, case study is an increasingly popular approach among qualitative researchers. We critically analysed the methodological descriptions of published case studies. Three high-impact qualitative methods journals were searched to locate case studies published in the past 5 years; 34 were selected for analysis. Articles were categorized as health and health services (n=12), social sciences and anthropology (n=7), or methods (n=15) case studies. The articles were reviewed using an adapted version of established criteria to determine whether adequate methodological justification was present, and if study aims, methods, and reported findings were consistent with a qualitative case study approach. Findings were grouped into five themes outlining key methodological issues: case study methodology or method, case of something particular and case selection, contextually bound case study, researcher and case interactions and triangulation, and study design inconsistent with methodology reported. Improved reporting of case studies by qualitative researchers will advance the methodology for the benefit of researchers and practitioners. PMID:24809980

So you want to do research? 3. An introduction to qualitative methods.

PubMed

Meadows, Keith A

2003-10-01

This article describes some of the key issues in the use of qualitative research methods. Starting with a description of what qualitative research is and outlining some of the distinguishing features between quantitative and qualitative research, examples of the type of setting where qualitative research can be applied are provided. Methods of collecting information through in-depth interviews and group discussions are discussed in some detail, including issues around sampling and recruitment, the use of topic guides and techniques to encourage participants to talk openly. An overview on the analysis of qualitative data discusses aspects on data reduction, display and drawing conclusions from the data. Approaches to ensuring rigour in the collection, analysis and reporting of qualitative research are discussed and the concepts of credibility, transferability, dependability and confirmability are described. Finally, guidelines for the reporting of qualitative research are outlined and the need to write for a particular audience is discussed.

An Online Forum As a Qualitative Research Method: Practical Issues

PubMed Central

Im, Eun-Ok; Chee, Wonshik

2008-01-01

Background Despite positive aspects of online forums as a qualitative research method, very little is known about practical issues involved in using online forums for data collection, especially for a qualitative research project. Objectives The purpose of this paper is to describe the practical issues that the researchers encountered in implementing an online forum as a qualitative component of a larger study on cancer pain experience. Method Throughout the study process, the research staff recorded issues ranged from minor technical problems to serious ethical dilemmas as they arose and wrote memos about them. The memos and written records of discussions were reviewed and analyzed using the content analysis suggested by Weber. Results Two practical issues related to credibility were identified: a high response and retention rate and automatic transcripts. An issue related to dependability was the participants’ easy forgetfulness. The issues related to confirmability were difficulties in theoretical saturation and unstandardized computer and Internet jargon. A security issue related to hacking attempts was noted as well. Discussion The analysis of these issues suggests several implications for future researchers who want to use online forums as a qualitative data collection method. PMID:16849979

A comparative study of qualitative and quantitative methods for the assessment of adhesive remnant after bracket debonding.

PubMed

Cehreli, S Burcak; Polat-Ozsoy, Omur; Sar, Cagla; Cubukcu, H Evren; Cehreli, Zafer C

2012-04-01

The amount of the residual adhesive after bracket debonding is frequently assessed in a qualitative manner, utilizing the adhesive remnant index (ARI). This study aimed to investigate whether quantitative assessment of the adhesive remnant yields more precise results compared to qualitative methods utilizing the 4- and 5-point ARI scales. Twenty debonded brackets were selected. Evaluation and scoring of the adhesive remnant on bracket bases were made consecutively using: 1. qualitative assessment (visual scoring) and 2. quantitative measurement (image analysis) on digital photographs. Image analysis was made on scanning electron micrographs (SEM) and high-precision elemental maps of the adhesive remnant as determined by energy dispersed X-ray spectrometry. Evaluations were made in accordance with the original 4-point and the modified 5-point ARI scales. Intra-class correlation coefficients (ICCs) were calculated, and the data were evaluated using Friedman test followed by Wilcoxon signed ranks test with Bonferroni correction. ICC statistics indicated high levels of agreement for qualitative visual scoring among examiners. The 4-point ARI scale was compliant with the SEM assessments but indicated significantly less adhesive remnant compared to the results of quantitative elemental mapping. When the 5-point scale was used, both quantitative techniques yielded similar results with those obtained qualitatively. These results indicate that qualitative visual scoring using the ARI is capable of generating similar results with those assessed by quantitative image analysis techniques. In particular, visual scoring with the 5-point ARI scale can yield similar results with both the SEM analysis and elemental mapping.

Qualitative Epidemiologic Methods Can Improve Local Prevention Programming among Adolescents

ERIC Educational Resources Information Center

Daniulaityte, Raminta; Siegal, Harvey A.; Carlson, Robert G.; Kenne, Deric R.; Starr, Sanford; DeCamp, Brad

2004-01-01

The Ohio Substance Abuse Monitoring Network (OSAM) is designed to provide accurate, timely, qualitatively-oriented epidemiologic descriptions of substance abuse trends and emerging problems in the state's major urban and rural areas. Use of qualitative methods in identifying and assessing substance abuse practices in local communities is one of…

Discovering the Future of the Case Study Method in Evaluation Research.

ERIC Educational Resources Information Center

Yin, Robert K.

1994-01-01

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

Using qualitative methods in research with people who have intellectual disabilities.

PubMed

Beail, Nigel; Williams, Katie

2014-03-01

JARID has a long and positive association with qualitative research dating back to its first issue. This paper looks at the development of qualitative methods and their application in the field of intellectual disability (ID). When invited to make a contribution on qualitative research for the 25th Anniversary of JARID, the present authors considered the options. We examined the frequency with which qualitative studies have been published in three major intellectual disability journals over a decade, and we considered attempting a systematic review or a meta-synthesis. The volume of published studies has increased, but there were too many across a diverse range of topics for a systematic review of qualitative research in general; but not enough for a systematic review or meta-synthesis with a particular focus. However, there were many issues that needed to be aired. This paper therefore contains some critical reflections on the use of qualitative methods. If we want to hear the voices of people who have ID then we need appropriate ways to do this. Qualitative methods are playing an increasing role in bringing the unknown about people who have ID into the known. The approach plays a valuable role in informing us about the experiences and lives of people who have ID. However, we have identified many methodological issues which will need to be further explored. At the same time, we need to develop methods to enable increased participation of people who have ID in some aspects of research. The participatory paradigm is more established in qualitative approaches as it lends itself to participation in generating research questions, developing interview questions, conducting interviews and even stages of the analysis. There are clearly areas that need to be addressed by trained researchers and the whole process will need some facilitation and support. Writing up for journals is one aspect that could be very problematic: so other forms of dissemination need to be explored

[Quantitative and qualitative research methods, can they coexist yet?].

PubMed

Hunt, Elena; Lavoie, Anne-Marise

2011-06-01

Qualitative design is gaining ground in Nursing research. In spite of a relative progress however, the evidence based practice movement continues to dominate and to underline the exclusive value of quantitative design (particularly that of randomized clinical trials) for clinical decision making. In the actual context convenient to those in power making utilitarian decisions on one hand, and facing nursing criticism of the establishment in favor of qualitative research on the other hand, it is difficult to chose a practical and ethical path that values the nursing role within the health care system, keeping us committed to quality care and maintaining researcher's integrity. Both qualitative and quantitative methods have advantages and disadvantages, and clearly, none of them can, by itself, capture, describe and explain reality adequately. Therefore, a balance between the two methods is needed. Researchers bare responsibility to society and science, and they should opt for the appropriate design susceptible to answering the research question, not promote the design favored by the research funding distributors.

Frameworks for evaluating health research capacity strengthening: a qualitative study

PubMed Central

2013-01-01

Background Health research capacity strengthening (RCS) projects are often complex and hard to evaluate. In order to inform health RCS evaluation efforts, we aimed to describe and compare key characteristics of existing health RCS evaluation frameworks: their process of development, purpose, target users, structure, content and coverage of important evaluation issues. A secondary objective was to explore what use had been made of the ESSENCE framework, which attempts to address one such issue: harmonising the evaluation requirements of different funders. Methods We identified and analysed health RCS evaluation frameworks published by seven funding agencies between 2004 and 2012, using a mixed methods approach involving structured qualitative analyses of documents, a stakeholder survey and consultations with key contacts in health RCS funding agencies. Results The frameworks were intended for use predominantly by the organisations themselves, and most were oriented primarily towards funders’ internal organisational performance requirements. The frameworks made limited reference to theories that specifically concern RCS. Generic devices, such as logical frameworks, were typically used to document activities, outputs and outcomes, but with little emphasis on exploring underlying assumptions or contextual constraints. Usage of the ESSENCE framework appeared limited. Conclusions We believe that there is scope for improving frameworks through the incorporation of more accessible information about how to do evaluation in practice; greater involvement of stakeholders, following evaluation capacity building principles; greater emphasis on explaining underlying rationales of frameworks; and structuring frameworks so that they separate generic and project-specific aspects of health RCS evaluation. The third and fourth of these improvements might assist harmonisation. PMID:24330628

Use of qualitative methods in published health services and management research: a 10-year review.

PubMed

Weiner, Bryan J; Amick, Halle R; Lund, Jennifer L; Lee, Shoou-Yih Daniel; Hoff, Timothy J

2011-02-01

Over the past 10 years, the field of health services and management research has seen renewed interest in the use of qualitative research methods. This article examines the volume and characteristics of qualitative research articles published in nine major health services and management journals between 1998 and 2008. Qualitative research articles comprise 9% of research articles published in these journals. Although the publication rate of qualitative research articles has not kept pace with that of quantitative research articles, citation analysis suggests that qualitative research articles contribute comparably to the field's knowledge base. A wide range of policy and management topics has been examined using qualitative methods. Case study designs, interviews, and documentary sources were the most frequently used methods. Half of qualitative research articles provided little or no detail about key aspects the study's methods. Implications are discussed and recommendations are offered for promoting the publication of qualitative research.

Implications for Application of Qualitative Methods to Library and Information Science Research.

ERIC Educational Resources Information Center

Grover, Robert; Glazier, Jack

1985-01-01

Presents conceptual framework for library and information science research and analyzes research methodology that has application for information science, using as example results of study conducted by authors. Rationale for use of qualitative research methods in theory building is discussed and qualitative and quantitative research methods are…

Using Blogs in Qualitative Educational Research: An Exploration of Method

ERIC Educational Resources Information Center

Harricharan, Michelle; Bhopal, Kalwant

2014-01-01

When compared with wider social research, qualitative educational research has been relatively slow to take up online research methods (ORMs). There is some very notable research in the area but, in general, ORMs have not achieved wide applicability in qualitative educational contexts apart from research that is inherently linked to the Internet,…

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

Random Qualitative Validation: A Mixed-Methods Approach to Survey Validation

ERIC Educational Resources Information Center

Van Duzer, Eric

2012-01-01

The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants'…

An online forum as a qualitative research method: practical issues.

PubMed

Im, Eun-Ok; Chee, Wonshik

2006-01-01

Despite the positive aspects of online forums as a qualitative research method, very little is known on the practical issues involved in using online forums for data collection, especially for a qualitative research project. The aim of this study was to describe the practical issues encountered in implementing an online forum as a qualitative component of a larger study on cancer pain experience. Throughout the study process, the research staff recorded issues ranging from minor technical problems to serious ethical dilemmas as they arose and wrote memos about them. The memos and written records of the discussions were reviewed and analyzed using content analysis. Two practical issues related to credibility were identified: (a) a high response and retention rate and (b) automatic transcripts. An issue related to dependability was the participants' forgetfulness. The issues related to confirmability were difficulties in theoretical saturation and unstandardized computer and Internet jargon. A security issue related to hacking attempts was noted as well. The analysis of these issues suggests several implications for future researchers who want to use online forums as a qualitative data collection method.

Use of Qualitative Methods in Published Health Services and Management Research: A 10-Year Review

PubMed Central

Weiner, Bryan J.; Amick, Halle R.; Lund, Jennifer L.; Lee, Shoou-Yih Daniel; Hoff, Timothy J.

2011-01-01

Over the past 10 years, the field of health services and management research has seen renewed interest in the use of qualitative research methods. This article examines the volume and characteristics of qualitative research articles published in nine major health services and management journals between 1998 and 2008. Qualitative research articles comprise 9% of research articles published in these journals. Although the publication rate of qualitative research articles has not kept pace with that of quantitative research articles, citation analysis suggests that qualitative research articles contribute comparably to the field’s knowledge base. A wide range of policy and management topics has been examined using qualitative methods. Case study designs, interviews, and documentary sources were the most frequently used methods. Half of qualitative research articles provided little or no detail about key aspects the study’s methods. Implications are discussed and recommendations are offered for promoting the publication of qualitative research. PMID:20675353

"Having to Shift Everything We've Learned to the Side": Expanding Research Methods Taught in Psychology to Incorporate Qualitative Methods.

PubMed

Roberts, Lynne D; Castell, Emily

2016-01-01

In Australia the tradition of conducting quantitative psychological research within a positivist framework has been challenged, with calls made for the inclusion of the full range of qualitative and quantitative methodologies within the undergraduate psychology curriculum. Despite this, the undergraduate psychology curriculum in most Australian universities retains a strong focus on teaching quantitative research methods. Limited research has examined attitudes toward qualitative research held by undergraduate psychology students taught within a positivist framework, and whether these attitudes are malleable and can be changed through teaching qualitative methodologies. Previous research has suggested that students from strong quantitative backgrounds experience some cognitive dissonance and greater difficulties in learning qualitative methods. In this article we examine 3rd year undergraduate psychology students' attitudes to qualitative research prior to commencing and upon completion of a qualitative research unit. All students had previously completed two 13 weeks units of study in quantitative research methods. At Time 1, 63 students (84.1% female) completed online surveys comprising attitudinal measures. Key themes to emerge from student comments were that qualitative research was seen as an alternative approach, representing a paradigmatic shift that was construed by some students advantageous for meeting future professional and educative goals. Quantitative measures of attitudes to qualitative research were associated with general attitudes toward research, and psychology-specific epistemological beliefs. Changes in attitudes following completion of the qualitative research methods unit were in the hypothesized direction, but non-significant (small effect sizes). The findings increase our understanding of psychology students' attitudes toward qualitative research and inform our recommendations for teaching research methods within the undergraduate

A General Survey of Qualitative Research Methodology.

ERIC Educational Resources Information Center

Cary, Rick

Current definitions and philosophical foundations of qualitative research are presented; and designs, evaluation methods, and issues in application of qualitative research to education are discussed. The effects of positivism and the post-positivist era on qualitative research are outlined, and naturalist and positivist approaches are contrasted.…

Making Sense of Alternative Assessment in a Qualitative Evaluation System

ERIC Educational Resources Information Center

Rojas Serrano, Javier

2017-01-01

In a Colombian private English institution, a qualitative evaluation system has been incorporated. This type of evaluation poses challenges to students who have never been evaluated through a system that eliminates exams or quizzes and, as a consequence, these students have to start making sense of it. This study explores the way students face the…

Improving Evaluation of Dental Hygiene Students' Cultural Competence with a Mixed-Methods Approach.

PubMed

Flynn, Priscilla; Sarkarati, Nassim

2018-02-01

Most dental hygiene educational programs include cultural competence education, but may not evaluate student outcomes. The aim of this study was to design and implement a mixed-methods evaluation to measure dental hygiene students' progression toward cultural competence. Two cohorts consisting of consecutive classes in one U.S. dental hygiene program participated in the study. A total of 47 dental hygiene students (100% response rate) completed self-assessments to measure their attitudes and knowledge at three time points between 2014 and 2016. Mean scores were calculated for three domains: Physical Environment, Communication, and Values. Qualitative analysis of the students' cultural diversity papers was also conducted to further evaluate students' knowledge and skills. Bennett's five-level conceptual framework was used to code phrases or sentences to place students in the general categories of ethnocentric or ethno-relative. The quantitative and qualitative results yielded different outcomes for Cohort 1, but not for Cohort 2. The Cohort 1 students assessed themselves statistically significantly lower over time in one of the three measured domains. However, the Cohort 2 students assessed themselves as statistically significantly more culturally competent in all three domains. Qualitative results placed 72% of Cohort 1 students and 83% of Cohort 2 students in the more desirable ethno-relative category. Since quantitative methods consisting of student self-assessments may not adequately measure students' cultural competence, adding qualitative methods to measure skills specific to patient care in this study added a robust dimension to evaluating this complex dental hygiene student competence.

A 96-well-plate-based optical method for the quantitative and qualitative evaluation of Pseudomonas aeruginosa biofilm formation and its application to susceptibility testing.

PubMed

Müsken, Mathias; Di Fiore, Stefano; Römling, Ute; Häussler, Susanne

2010-08-01

A major reason for bacterial persistence during chronic infections is the survival of bacteria within biofilm structures, which protect cells from environmental stresses, host immune responses and antimicrobial therapy. Thus, there is concern that laboratory methods developed to measure the antibiotic susceptibility of planktonic bacteria may not be relevant to chronic biofilm infections, and it has been suggested that alternative methods should test antibiotic susceptibility within a biofilm. In this paper, we describe a fast and reliable protocol for using 96-well microtiter plates for the formation of Pseudomonas aeruginosa biofilms; the method is easily adaptable for antimicrobial susceptibility testing. This method is based on bacterial viability staining in combination with automated confocal laser scanning microscopy. The procedure simplifies qualitative and quantitative evaluation of biofilms and has proven to be effective for standardized determination of antibiotic efficiency on P. aeruginosa biofilms. The protocol can be performed within approximately 60 h.

Probability of Detection (POD) as a statistical model for the validation of qualitative methods.

PubMed

Wehling, Paul; LaBudde, Robert A; Brunelle, Sharon L; Nelson, Maria T

2011-01-01

A statistical model is presented for use in validation of qualitative methods. This model, termed Probability of Detection (POD), harmonizes the statistical concepts and parameters between quantitative and qualitative method validation. POD characterizes method response with respect to concentration as a continuous variable. The POD model provides a tool for graphical representation of response curves for qualitative methods. In addition, the model allows comparisons between candidate and reference methods, and provides calculations of repeatability, reproducibility, and laboratory effects from collaborative study data. Single laboratory study and collaborative study examples are given.

A novel approach to mixing qualitative and quantitative methods in HIV and STI prevention research.

PubMed

Penman-Aguilar, Ana; Macaluso, Maurizio; Peacock, Nadine; Snead, M Christine; Posner, Samuel F

2014-04-01

Mixed-method designs are increasingly used in sexually transmitted infection (STI) and HIV prevention research. The authors designed a mixedmethod approach and applied it to estimate and evaluate a predictor of continued female condom use (6+ uses, among those who used it at least once) in a 6-month prospective cohort study. The analysis included 402 women who received an intervention promoting use of female and male condoms for STI prevention and completed monthly quantitative surveys; 33 also completed a semistructured qualitative interview. The authors identified a qualitative theme (couples' female condom enjoyment [CFCE]), applied discriminant analysis techniques to estimate CFCE for all participants, and added CFCE to a multivariable logistic regression model of continued female condom use. CFCE related to comfort, naturalness, pleasure, feeling protected, playfulness, ease of use, intimacy, and feeling in control of protection. CFCE was associated with continued female condom use (adjusted odds ratio: 2.8, 95% confidence interval: 1.4-5.6) and significantly improved model fit (p < .001). CFCE predicted continued female condom use. Mixed-method approaches for "scaling up" qualitative findings from small samples to larger numbers of participants can benefit HIV and STI prevention research.

Teaching Qualitative Methods: A Face-to-Face Encounter.

ERIC Educational Resources Information Center

Keen, Mike F.

1996-01-01

Considers the complete ethnographic project as a strategy for teaching qualitative methods. Describes an undergraduate class where students chose an ethnographic setting, gathered and analyzed data, and wrote a final report. Settings included Laundromats, bingo halls, auctions, karaoke clubs, and bowling leagues. (MJP)

Examining Stress in Graduate Assistants: Combining Qualitative and Quantitative Survey Methods

ERIC Educational Resources Information Center

Mazzola, Joseph J.; Walker, Erin J.; Shockley, Kristen M.; Spector, Paul E.

2011-01-01

The aim of this study was to employ qualitative and quantitative survey methods in a concurrent mixed model design to assess stressors and strains in graduate assistants. The stressors most frequently reported qualitatively were work overload, interpersonal conflict, and organizational constraints; the most frequently reported psychological…

The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation.

PubMed

Stevens, Katherine; Palfreyman, Simon

2012-12-01

To describe how qualitative methods can be used in the development of descriptive systems of preference-based measures (PBMs) of health-related quality of life. The requirements of the National Institute for Health and Clinical Excellence and other agencies together with the increasing use of patient-reported outcome measures has led to an increase in the demand for PBMs. Recently, interest has grown in developing new PBMs and while previous research on PBMs has mainly focused on the methods of valuation, research into the methods of developing descriptive systems is an emerging field. Traditionally, descriptive systems of PBMs were developed by using top-down methods, where content was derived from existing measures, the literature, or health surveys. A contrasting approach is a bottom-up methodology, which takes the views of patients or laypeople on how their life is affected by their health. This approach generally requires the use of qualitative methods. Qualitative methods lend themselves well to the development of PBMs. They also ensure that the measure has appropriate language, content validity, and responsiveness to change. While the use of qualitative methods in the development of non-PBMs is fairly standard, their use in developing PBMs was until recently nonexistent. In this article, we illustrate the use of qualitative methods by presenting two case studies of recently developed PBMs, one generic and one condition specific. We outline the stages involved, discuss the strengths and weaknesses of the approach, and compare with the top-down approach used in the majority of PBMs to date. Copyright © 2012 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Theoretical Coalescence: A Method to Develop Qualitative Theory

PubMed Central

Morse, Janice M.

2018-01-01

Background Qualitative research is frequently context bound, lacks generalizability, and is limited in scope. Objectives The purpose of this article was to describe a method, theoretical coalescence, that provides a strategy for analyzing complex, high-level concepts and for developing generalizable theory. Theoretical coalescence is a method of theoretical expansion, inductive inquiry, of theory development, that uses data (rather than themes, categories, and published extracts of data) as the primary source for analysis. Here, using the development of the lay concept of enduring as an example, I explore the scientific development of the concept in multiple settings over many projects and link it within the Praxis Theory of Suffering. Methods As comprehension emerges when conducting theoretical coalescence, it is essential that raw data from various different situations be available for reinterpretation/reanalysis and comparison to identify the essential features of the concept. The concept is then reconstructed, with additional inquiry that builds description, and evidence is conducted and conceptualized to create a more expansive concept and theory. Results By utilizing apparently diverse data sets from different contexts that are linked by certain characteristics, the essential features of the concept emerge. Such inquiry is divergent and less bound by context yet purposeful, logical, and with significant pragmatic implications for practice in nursing and beyond our discipline. Conclusion Theoretical coalescence is a means by which qualitative inquiry is broadened to make an impact, to accommodate new theoretical shifts and concepts, and to make qualitative research applied and accessible in new ways. PMID:29360688

Clinical orientation program for new medical registrars--a qualitative evaluation.

PubMed

Rosemergy, Ian; Bell, Damon A; Jayathissa, Sisira K

2009-02-01

We present a qualitative evaluation of a clinical orientation program for medical registrars within the Wellington region in New Zealand, designed and implemented by current advanced registrars. This program was intended to improve the transition from house officer to medical registrar. The program was qualitatively evaluated using focus groups comprising participants, presenters and senior nursing staff. Purposive samples were drawn from each of these groups. The most significant finding was the perception of enhanced professional collegiality among medical staff. There were benefits to participants and presenters with improved communication between medical registrars. We believe there are individual, institutional and patient care benefits with a region-specific, clinical orientation for new medical registrars.

Dyadic Interviews as a Tool for Qualitative Evaluation

ERIC Educational Resources Information Center

Morgan, David L.; Eliot, Susan; Lowe, Robert A.; Gorman, Paul

2016-01-01

Although evaluation researchers frequently make use of focus groups and individual interviews as sources of qualitative data, there has been far less attention to dyadic interviews that create a conversation between two research participants. This article describes dyadic interviews as a format that shares many of the advantages of focus groups,…

A online credit evaluation method based on AHP and SPA

NASA Astrophysics Data System (ADS)

Xu, Yingtao; Zhang, Ying

2009-07-01

Online credit evaluation is the foundation for the establishment of trust and for the management of risk between buyers and sellers in e-commerce. In this paper, a new credit evaluation method based on the analytic hierarchy process (AHP) and the set pair analysis (SPA) is presented to determine the credibility of the electronic commerce participants. It solves some of the drawbacks found in classical credit evaluation methods and broadens the scope of current approaches. Both qualitative and quantitative indicators are considered in the proposed method, then a overall credit score is achieved from the optimal perspective. In the end, a case analysis of China Garment Network is provided for illustrative purposes.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

“Having to Shift Everything We’ve Learned to the Side”: Expanding Research Methods Taught in Psychology to Incorporate Qualitative Methods

PubMed Central

Roberts, Lynne D.; Castell, Emily

2016-01-01

In Australia the tradition of conducting quantitative psychological research within a positivist framework has been challenged, with calls made for the inclusion of the full range of qualitative and quantitative methodologies within the undergraduate psychology curriculum. Despite this, the undergraduate psychology curriculum in most Australian universities retains a strong focus on teaching quantitative research methods. Limited research has examined attitudes toward qualitative research held by undergraduate psychology students taught within a positivist framework, and whether these attitudes are malleable and can be changed through teaching qualitative methodologies. Previous research has suggested that students from strong quantitative backgrounds experience some cognitive dissonance and greater difficulties in learning qualitative methods. In this article we examine 3rd year undergraduate psychology students’ attitudes to qualitative research prior to commencing and upon completion of a qualitative research unit. All students had previously completed two 13 weeks units of study in quantitative research methods. At Time 1, 63 students (84.1% female) completed online surveys comprising attitudinal measures. Key themes to emerge from student comments were that qualitative research was seen as an alternative approach, representing a paradigmatic shift that was construed by some students advantageous for meeting future professional and educative goals. Quantitative measures of attitudes to qualitative research were associated with general attitudes toward research, and psychology-specific epistemological beliefs. Changes in attitudes following completion of the qualitative research methods unit were in the hypothesized direction, but non-significant (small effect sizes). The findings increase our understanding of psychology students’ attitudes toward qualitative research and inform our recommendations for teaching research methods within the undergraduate

Qualitative and mixed methods research in dissemination and implementation science: introduction to the special issue.

PubMed

Southam-Gerow, Michael A; Dorsey, Shannon

2014-01-01

This special issue provides examples of how qualitative and mixed methods research approaches can be used in dissemination and implementation science. In this introductory article, we provide a brief rationale for why and how qualitative and mixed methods approaches can be useful in moving the field forward. Specifically, we provide a brief primer on common qualitative methods, including a review of guidelines provided by the National Institutes of Health. Next, we introduce the six articles in the issue. The first of the articles by Palinkas represents a more thorough and authoritative discussion related to qualitative methods, using the other five articles in the issue (and other published works) as examples. The remaining five articles are empirical and/or descriptive articles of recently completed or ongoing qualitative or mixed methods studies related to dissemination and implementation of evidence-based practices for children and adolescents.

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will

QUALITATIVE AND QUANTITATIVE METHODS OF SUICIDE RESEARCH IN OLD AGE.

PubMed

Ojagbemi, A

2017-06-01

This paper examines the merits of the qualitative and quantitative methods of suicide research in the elderly using two studies identified through a free search of the Pubmed database for articles that might have direct bearing on suicidality in the elderly. The studies have been purposively selected for critical appraisal because they meaningfully reflect the quantitative and qualitative divide as well as the social, economic, and cultural boundaries between the elderly living in sub-Saharan Africa and Europe. The paper concludes that an integration of both the qualitative and quantitative research approaches may provide a better platform for unraveling the complex phenomenon of suicide in the elderly.

A qualitative method for analysing multivoicedness

PubMed Central

Aveling, Emma-Louise; Gillespie, Alex; Cornish, Flora

2015-01-01

‘Multivoicedness’ and the ‘multivoiced Self’ have become important theoretical concepts guiding research. Drawing on the tradition of dialogism, the Self is conceptualised as being constituted by a multiplicity of dynamic, interacting voices. Despite the growth in literature and empirical research, there remains a paucity of established methodological tools for analysing the multivoiced Self using qualitative data. In this article, we set out a systematic, practical ‘how-to’ guide for analysing multivoicedness. Using theoretically derived tools, our three-step method comprises: identifying the voices of I-positions within the Self’s talk (or text), identifying the voices of ‘inner-Others’, and examining the dialogue and relationships between the different voices. We elaborate each step and illustrate our method using examples from a published paper in which data were analysed using this method. We conclude by offering more general principles for the use of the method and discussing potential applications. PMID:26664292

Research Methods in Healthcare Epidemiology: Survey and Qualitative Research

PubMed Central

Safdar, Nasia; Abbo, Lilian M.; Knobloch, Mary Jo; Seo, Susan K.

2017-01-01

Surveys are one of the most frequently employed study designs in healthcare epidemiology research. Generally easier to undertake and less costly than many other study designs, surveys can be invaluable to gain insights into opinions and practices in large samples and may be descriptive and/or be used to test associations. In this context, qualitative research methods may complement this study design either at the survey development phase and/or at the interpretation/extension of results stage. This methods article focuses on key considerations for designing and deploying surveys in healthcare epidemiology and antibiotic stewardship, including identification of whether or not de novo survey development is necessary, ways to optimally lay out and display a survey, denominator measurement, discussion of biases to keep in mind particularly in research using surveys, and the role of qualitative research methods to complement surveys. We review examples of surveys in healthcare epidemiology and antimicrobial stewardship and review the pros and cons of methods used. A checklist is provided to help aid design and deployment of surveys in healthcare epidemiology and antimicrobial stewardship. PMID:27514583

The use of qualitative methods to inform Delphi surveys in core outcome set development.

PubMed

Keeley, T; Williamson, P; Callery, P; Jones, L L; Mathers, J; Jones, J; Young, B; Calvert, M

2016-05-04

Core outcome sets (COS) help to minimise bias in trials and facilitate evidence synthesis. Delphi surveys are increasingly being used as part of a wider process to reach consensus about what outcomes should be included in a COS. Qualitative research can be used to inform the development of Delphi surveys. This is an advance in the field of COS development and one which is potentially valuable; however, little guidance exists for COS developers on how best to use qualitative methods and what the challenges are. This paper aims to provide early guidance on the potential role and contribution of qualitative research in this area. We hope the ideas we present will be challenged, critiqued and built upon by others exploring the role of qualitative research in COS development. This paper draws upon the experiences of using qualitative methods in the pre-Delphi stage of the development of three different COS. Using these studies as examples, we identify some of the ways that qualitative research might contribute to COS development, the challenges in using such methods and areas where future research is required. Qualitative research can help to identify what outcomes are important to stakeholders; facilitate understanding of why some outcomes may be more important than others, determine the scope of outcomes; identify appropriate language for use in the Delphi survey and inform comparisons between stakeholder data and other sources, such as systematic reviews. Developers need to consider a number of methodological points when using qualitative research: specifically, which stakeholders to involve, how to sample participants, which data collection methods are most appropriate, how to consider outcomes with stakeholders and how to analyse these data. A number of areas for future research are identified. Qualitative research has the potential to increase the research community's confidence in COS, although this will be dependent upon using rigorous and appropriate

Collecting and analyzing qualitative data: Hermeneutic principles, methods and case examples

Treesearch

Michael E. Patterson; Daniel R. Williams

2002-01-01

Over the past three decades, the use of qualitative research methods has become commonplace in social science as a whole and increasingly represented in tourism and recrearion research. In tourism, for example, Markwell and Basche (1998) recently noted the emergence of a pluralistic perspective on science and the growth of research employing qualitative frameworks....

Qualitative Data Analysis: A Methods Sourcebook. Third Edition

ERIC Educational Resources Information Center

Miles, Matthew B.; Huberman, A. Michael; Saldana, Johnny

2014-01-01

The Third Edition of Miles & Huberman's classic research methods text is updated and streamlined by Johnny Saldaña, author of "The Coding Manual for Qualitative Researchers." Several of the data display strategies from previous editions are now presented in re-envisioned and reorganized formats to enhance reader accessibility and…

Enhancing the quality and credibility of qualitative analysis.

PubMed

Patton, M Q

1999-12-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems.

Enhancing the quality and credibility of qualitative analysis.

PubMed Central

Patton, M Q

1999-01-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems. PMID:10591279

Including mixed methods research in systematic reviews: Examples from qualitative syntheses in TB and malaria control

PubMed Central

2012-01-01

Background Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. Methods We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Results Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Conclusions Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research. PMID:22545681

The Evaluator's Perspective: Evaluating the State Capacity Building Program.

ERIC Educational Resources Information Center

Madey, Doren L.

A historical antagonism between the advocates of quantitative evaluation methods and the proponents of qualitative evaluation methods has stymied the recognition of the value to be gained by utilizing both methodologies in the same study. The integration of quantitative and qualitative methods within a single evaluation has synergistic effects in…

Opening up the black box: an introduction to qualitative research methods in anaesthesia.

PubMed

Shelton, C L; Smith, A F; Mort, M

2014-03-01

Qualitative research methods are a group of techniques designed to allow the researcher to understand phenomena in their natural setting. A wide range is used, including focus groups, interviews, observation, and discourse analysis techniques, which may be used within research approaches such as grounded theory or ethnography. Qualitative studies in the anaesthetic setting have been used to define excellence in anaesthesia, explore the reasons behind drug errors, investigate the acquisition of expertise and examine incentives for hand-hygiene in the operating theatre. Understanding how and why people act the way they do is essential for the advancement of anaesthetic practice, and rigorous, well-designed qualitative research can generate useful data and important insights. Meticulous social scientific methods, transparency, reproducibility and reflexivity are markers of quality in qualitative research. Tools such as the consolidated criteria for reporting qualitative research checklist and the critical appraisal skills programme are available to help authors, reviewers and readers unfamiliar with qualitative research assess its merits. © 2013 The Association of Anaesthetists of Great Britain and Ireland.

Including mixed methods research in systematic reviews: examples from qualitative syntheses in TB and malaria control.

PubMed

Atkins, Salla; Launiala, Annika; Kagaha, Alexander; Smith, Helen

2012-04-30

Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research.

Online versus Paper Evaluations: Differences in Both Quantitative and Qualitative Data

ERIC Educational Resources Information Center

Burton, William B.; Civitano, Adele; Steiner-Grossman, Penny

2012-01-01

This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The…

An Innovative Method to Involve Community Health Workers as Partners in Evaluation Research

PubMed Central

Issel, L. Michele; Townsell, Stephanie J.; Chapple-McGruder, Theresa; Handler, Arden

2011-01-01

Objectives. We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Methods. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Results. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Conclusions. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training. PMID:22021290

Using the framework method for the analysis of qualitative data in multi-disciplinary health research.

PubMed

Gale, Nicola K; Heath, Gemma; Cameron, Elaine; Rashid, Sabina; Redwood, Sabi

2013-09-18

The Framework Method is becoming an increasingly popular approach to the management and analysis of qualitative data in health research. However, there is confusion about its potential application and limitations. The article discusses when it is appropriate to adopt the Framework Method and explains the procedure for using it in multi-disciplinary health research teams, or those that involve clinicians, patients and lay people. The stages of the method are illustrated using examples from a published study. Used effectively, with the leadership of an experienced qualitative researcher, the Framework Method is a systematic and flexible approach to analysing qualitative data and is appropriate for use in research teams even where not all members have previous experience of conducting qualitative research.

Quality of life among dermatology patients: a systematic review of investigations using qualitative methods.

PubMed

Singh, Sanminder; Ehsani-Chimeh, Nazanin; Kornmehl, Heather; Armstrong, April W

2017-07-13

Quality of life may be assessed using quantitative or qualitative methods. Quantitative methods are commonly used in research settings; however, they may fail to capture the full range of patient experiences and impact on quality of life. Qualitative methods may be used to address this limitation. In this systematic review, we aim to synthesize data from articles utilizing qualitative methods to assess quality of life in dermatology patients. We performed a systematic review search using the MEDLINE, EMBASE, and SCOPUS databases. The search was conducted using the following search criteria: ("Dermatology" [MeSH]) AND ("Quality of Life" [MeSH]), AND ("Qualitative Research" [MeSH]), searching literature spanning from January 1, 1946- October 5, 2016. The systematic review of 15 articles included 533 dermatology patients. Patients expressed frustration over the unpredictability of disease symptoms and having to compensate for the subsequent limitations by altering their daily routines. Patients also reported profound helplessness due to chronic skin disease and social isolation in an effort to hide their disease. Patients noted the patient-provider relationship as a source of support and information exchange, with the goal to form easy to use treatment plans that met both physician and patient expectations. Qualitative assessment of patient quality of life can provide new insights into the patient experience and the impact of their skin disease. Qualitative methodology may capture meaningful information that may be overlooked by quantitative methods, and it should be included in quality of life research.

Research Methods in Healthcare Epidemiology: Survey and Qualitative Research.

PubMed

Safdar, Nasia; Abbo, Lilian M; Knobloch, Mary Jo; Seo, Susan K

2016-11-01

Surveys are one of the most frequently employed study designs in healthcare epidemiology research. Generally easier to undertake and less costly than many other study designs, surveys can be invaluable to gain insights into opinions and practices in large samples and may be descriptive and/or be used to test associations. In this context, qualitative research methods may complement this study design either at the survey development phase and/or at the interpretation/extension of results stage. This methods article focuses on key considerations for designing and deploying surveys in healthcare epidemiology and antibiotic stewardship, including identification of whether or not de novo survey development is necessary, ways to optimally lay out and display a survey, denominator measurement, discussion of biases to keep in mind particularly in research using surveys, and the role of qualitative research methods to complement surveys. We review examples of surveys in healthcare epidemiology and antimicrobial stewardship and review the pros and cons of methods used. A checklist is provided to help aid design and deployment of surveys in healthcare epidemiology and antimicrobial stewardship. Infect Control Hosp Epidemiol 2016;1-6.

A Systematic Quantitative-Qualitative Model: How To Evaluate Professional Services

ERIC Educational Resources Information Center

Yoda, Koji

1973-01-01

The proposed evaluation model provides for the assignment of relative weights to each criterion, and establishes a weighting system for calculating a quantitative-qualitative raw score for each service activity of a faculty member being reviewed. (Author)

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

Qualitative radiology assessment of tumor response: does it measure up?

PubMed

Gottlieb, Ronald H; Litwin, Alan; Gupta, Bhavna; Taylor, John; Raczyk, Cheryl; Mashtare, Terry; Wilding, Gregory; Fakih, Marwan

2008-01-01

Our purpose was to assess whether a simpler qualitative evaluation of tumor response by computed tomography is as reproducible and predictive of clinical outcome as the Response Evaluation Criteria in Solid Tumors (RECIST) and World Health Organization (WHO) methods. This study was a two-reader retrospective evaluation in which qualitative assessment resulted in agreement in 21 of 23 patients with metastatic colorectal carcinoma (91.3%, kappa=0.78; 95% CI, 0.51-1.00). Hepatic metastases were classified as increased, decreased, or unchanged, compared with agreement in 20 of 23 patients (87.0%) for RECIST (kappa=0.62; 95% CI, 0.23-1.00) and WHO (kappa=0.67; 95% CI, 0.34-1.00) methods. Patients were placed into partial response, stable disease, and disease progression categories. Time to progression of disease was better predicted qualitatively than by RECIST or WHO. Our pilot data suggest that our qualitative scoring system is more reproducible and predictive of patient clinical outcome than the RECIST and WHO methods.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This

A Qualitative Evaluation of Ethics Educational Program in Health Science.

PubMed

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-06-01

This paper originates from a panel discussion on the evaluation of "Ethics Educational Program in Health Sciences" held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs.

[Qualitative research in health services research - discussion paper, Part 2: Qualitative research in health services research in Germany - an overview].

PubMed

Karbach, U; Stamer, M; Holmberg, C; Güthlin, C; Patzelt, C; Meyer, T

2012-08-01

This is the second part of a 3-part discussion paper by the working group on "Qualitative Methods" in the German network of health services research (DNVF) that shall contribute to the development of a memorandum concerning qualitative health services research. It aims to depict the different types of qualitative research that are conducted in health services research in Germany. In addition, the authors present a specific set of qualitative data collection and analysis tools to demonstrate the potential of qualitative research for health services research. QUALITATIVE RESEARCH IN HEALTH SERVICES RESEARCH - AN OVERVIEW: To give an overview of the types of qualitative research conducted in German health services research, the abstracts of the 8th German Conference on Health Services Research were filtered to identify qualitative or mixed-methods studies. These were then analysed by looking at the context which was studied, who was studied, the aims of the studies, and what type of methods were used. Those methods that were mentioned most often for data collection and analysis are described in detail. QUALITATIVE RESEARCH AT THE CONFERENCE FOR HEALTH SERVICES RESEARCH 2009: Approximately a fifth of all abstracts (n=74) had a qualitative (n=47) or a mixed-methods approach combining quantitative and qualitative methods (n=27). Research aims included needs assessment (41%), survey development (36%), evaluation (22%), and theorizing (1%). Data collection mostly consisted of one-on-one interviews (n=45) and group discussions (n=29). Qualitative content analysis was named in 35 abstracts, 30 abstracts did not reference their method of analysis. In addition to a quantitative summary of the abstract findings, the diversity of fields addressed by qualitative methods is highlighted. Although drawing conclusions on the use of qualitative methods in German health services research from the analysis of conference abstracts is not possible, the overview we present demonstrates the

Qualitative Secondary Analysis: A Case Exemplar.

PubMed

Tate, Judith Ann; Happ, Mary Beth

Qualitative secondary analysis (QSA) is the use of qualitative data that was collected by someone else or was collected to answer a different research question. Secondary analysis of qualitative data provides an opportunity to maximize data utility, particularly with difficult-to-reach patient populations. However, qualitative secondary analysis methods require careful consideration and explicit description to best understand, contextualize, and evaluate the research results. In this article, we describe methodologic considerations using a case exemplar to illustrate challenges specific to qualitative secondary analysis and strategies to overcome them. Copyright © 2017 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Qualitative-Geospatial Methods of Exploring Person-Place Transactions in Aging Adults: A Scoping Review.

PubMed

Hand, Carri; Huot, Suzanne; Laliberte Rudman, Debbie; Wijekoon, Sachindri

2017-06-01

Research exploring how places shape and interact with the lives of aging adults must be grounded in the places where aging adults live and participate. Combined participatory geospatial and qualitative methods have the potential to illuminate the complex processes enacted between person and place to create much-needed knowledge in this area. The purpose of this scoping review was to identify methods that can be used to study person-place relationships among aging adults and their neighborhoods by determining the extent and nature of research with aging adults that combines qualitative methods with participatory geospatial methods. A systematic search of nine databases identified 1,965 articles published from 1995 to late 2015. We extracted data and assessed whether the geospatial and qualitative methods were supported by a specified methodology, the methods of data analysis, and the extent of integration of geospatial and qualitative methods. Fifteen studies were included and used the photovoice method, global positioning system tracking plus interview, or go-along interviews. Most included articles provided sufficient detail about data collection methods, yet limited detail about methodologies supporting the study designs and/or data analysis. Approaches that combine participatory geospatial and qualitative methods are beginning to emerge in the aging literature. By more explicitly grounding studies in a methodology, better integrating different types of data during analysis, and reflecting on methods as they are applied, these methods can be further developed and utilized to provide crucial place-based knowledge that can support aging adults' health, well-being, engagement, and participation. © The Author 2017. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Multiple and mixed methods in formative evaluation: Is more better? Reflections from a South African study.

PubMed

Odendaal, Willem; Atkins, Salla; Lewin, Simon

2016-12-15

Formative programme evaluations assess intervention implementation processes, and are seen widely as a way of unlocking the 'black box' of any programme in order to explore and understand why a programme functions as it does. However, few critical assessments of the methods used in such evaluations are available, and there are especially few that reflect on how well the evaluation achieved its objectives. This paper describes a formative evaluation of a community-based lay health worker programme for TB and HIV/AIDS clients across three low-income communities in South Africa. It assesses each of the methods used in relation to the evaluation objectives, and offers suggestions on ways of optimising the use of multiple, mixed-methods within formative evaluations of complex health system interventions. The evaluation's qualitative methods comprised interviews, focus groups, observations and diary keeping. Quantitative methods included a time-and-motion study of the lay health workers' scope of practice and a client survey. The authors conceptualised and conducted the evaluation, and through iterative discussions, assessed the methods used and their results. Overall, the evaluation highlighted programme issues and insights beyond the reach of traditional single methods evaluations. The strengths of the multiple, mixed-methods in this evaluation included a detailed description and nuanced understanding of the programme and its implementation, and triangulation of the perspectives and experiences of clients, lay health workers, and programme managers. However, the use of multiple methods needs to be carefully planned and implemented as this approach can overstretch the logistic and analytic resources of an evaluation. For complex interventions, formative evaluation designs including multiple qualitative and quantitative methods hold distinct advantages over single method evaluations. However, their value is not in the number of methods used, but in how each method

Risk Evaluation of Bogie System Based on Extension Theory and Entropy Weight Method

PubMed Central

Du, Yanping; Zhang, Yuan; Zhao, Xiaogang; Wang, Xiaohui

2014-01-01

A bogie system is the key equipment of railway vehicles. Rigorous practical evaluation of bogies is still a challenge. Presently, there is overreliance on part-specific experiments in practice. In the present work, a risk evaluation index system of a bogie system has been established based on the inspection data and experts' evaluation. Then, considering quantitative and qualitative aspects, the risk state of a bogie system has been evaluated using an extension theory and an entropy weight method. Finally, the method has been used to assess the bogie system of four different samples. Results show that this method can assess the risk state of a bogie system exactly. PMID:25574159

Risk evaluation of bogie system based on extension theory and entropy weight method.

PubMed

Du, Yanping; Zhang, Yuan; Zhao, Xiaogang; Wang, Xiaohui

2014-01-01

A bogie system is the key equipment of railway vehicles. Rigorous practical evaluation of bogies is still a challenge. Presently, there is overreliance on part-specific experiments in practice. In the present work, a risk evaluation index system of a bogie system has been established based on the inspection data and experts' evaluation. Then, considering quantitative and qualitative aspects, the risk state of a bogie system has been evaluated using an extension theory and an entropy weight method. Finally, the method has been used to assess the bogie system of four different samples. Results show that this method can assess the risk state of a bogie system exactly.

The application of qualitative research methods to the study of sexually transmitted infections

PubMed Central

Power, R

2002-01-01

Qualitative methods have gained support in health sciences research and have a role to play in STI studies. This article reviews the main techniques used by qualitative researchers, with illustrations taken from the field of STIs. PMID:12081190

Practicable group testing method to evaluate weight/weight GMO content in maize grains.

PubMed

Mano, Junichi; Yanaka, Yuka; Ikezu, Yoko; Onishi, Mari; Futo, Satoshi; Minegishi, Yasutaka; Ninomiya, Kenji; Yotsuyanagi, Yuichi; Spiegelhalter, Frank; Akiyama, Hiroshi; Teshima, Reiko; Hino, Akihiro; Naito, Shigehiro; Koiwa, Tomohiro; Takabatake, Reona; Furui, Satoshi; Kitta, Kazumi

2011-07-13

Because of the increasing use of maize hybrids with genetically modified (GM) stacked events, the established and commonly used bulk sample methods for PCR quantification of GM maize in non-GM maize are prone to overestimate the GM organism (GMO) content, compared to the actual weight/weight percentage of GM maize in the grain sample. As an alternative method, we designed and assessed a group testing strategy in which the GMO content is statistically evaluated based on qualitative analyses of multiple small pools, consisting of 20 maize kernels each. This approach enables the GMO content evaluation on a weight/weight basis, irrespective of the presence of stacked-event kernels. To enhance the method's user-friendliness in routine application, we devised an easy-to-use PCR-based qualitative analytical method comprising a sample preparation step in which 20 maize kernels are ground in a lysis buffer and a subsequent PCR assay in which the lysate is directly used as a DNA template. This method was validated in a multilaboratory collaborative trial.

A new qualitative pattern classification of shear wave elastograghy for solid breast mass evaluation.

PubMed

Cong, Rui; Li, Jing; Guo, Song

2017-02-01

To examine the efficacy of qualitative shear wave elastography (SWE) in the classification and evaluation of solid breast masses, and to compare this method with conventional ultrasonograghy (US), quantitative SWE parameters and qualitative SWE classification proposed before. From April 2015 to March 2016, 314 consecutive females with 325 breast masses who decided to undergo core needle biopsy and/or surgical biopsy were enrolled. Conventional US and SWE were previously performed in all enrolled subjects. Each mass was classified by two different qualitative classifications. One was established in our study, herein named the Qual1. Qual1 could classify the SWE images into five color patterns by the visual evaluations: Color pattern 1 (homogeneous pattern); Color pattern 2 (comparative homogeneous pattern); Color pattern 3 (irregularly heterogeneous pattern); Color pattern 4 (intralesional echo pattern); and Color pattern 5 (the stiff rim sign pattern). The second qualitative classification was named Qual2 here, and included a four-color overlay pattern classification (Tozaki and Fukuma, Acta Radiologica, 2011). The Breast Imaging Reporting and Data System (BI-RADS) assessment and quantitative SWE parameters were recorded. Diagnostic performances of conventional US, SWE parameters, and combinations of US and SWE parameters were compared. With pathological results as the gold standard, of the 325 examined breast masses, 139 (42.77%) samples were malignant and 186 (57.23%) were benign. The Qual1 showed a higher Az value than the Qual2 and quantitative SWE parameters (all P<0.05). When applying Qual1=Color pattern 1 for downgrading and Qual1=Color pattern 5 for upgrading the BI-RADS categories, we obtained the highest Az value (0.951), and achieved a significantly higher specificity (86.56%, P=0.002) than that of the US (81.18%) with the same sensitivity (94.96%). The qualitative classification proposed in this study may be representative of SWE parameters and has

AI/OR computational model for integrating qualitative and quantitative design methods

NASA Technical Reports Server (NTRS)

Agogino, Alice M.; Bradley, Stephen R.; Cagan, Jonathan; Jain, Pramod; Michelena, Nestor

1990-01-01

A theoretical framework for integrating qualitative and numerical computational methods for optimally-directed design is described. The theory is presented as a computational model and features of implementations are summarized where appropriate. To demonstrate the versatility of the methodology we focus on four seemingly disparate aspects of the design process and their interaction: (1) conceptual design, (2) qualitative optimal design, (3) design innovation, and (4) numerical global optimization.

Qualitative research methods: key features and insights gained from use in infection prevention research.

PubMed

Forman, Jane; Creswell, John W; Damschroder, Laura; Kowalski, Christine P; Krein, Sarah L

2008-12-01

Infection control professionals and hospital epidemiologists are accustomed to using quantitative research. Although quantitative studies are extremely important in the field of infection control and prevention, often they cannot help us explain why certain factors affect the use of infection control practices and identify the underlying mechanisms through which they do so. Qualitative research methods, which use open-ended techniques, such as interviews, to collect data and nonstatistical techniques to analyze it, provide detailed, diverse insights of individuals, useful quotes that bring a realism to applied research, and information about how different health care settings operate. Qualitative research can illuminate the processes underlying statistical correlations, inform the development of interventions, and show how interventions work to produce observed outcomes. This article describes the key features of qualitative research and the advantages that such features add to existing quantitative research approaches in the study of infection control. We address the goal of qualitative research, the nature of the research process, sampling, data collection and analysis, validity, generalizability of findings, and presentation of findings. Health services researchers are increasingly using qualitative methods to address practical problems by uncovering interacting influences in complex health care environments. Qualitative research methods, applied with expertise and rigor, can contribute important insights to infection prevention efforts.

Genetic toxicology at the crossroads-from qualitative hazard evaluation to quantitative risk assessment.

PubMed

White, Paul A; Johnson, George E

2016-05-01

Applied genetic toxicology is undergoing a transition from qualitative hazard identification to quantitative dose-response analysis and risk assessment. To facilitate this change, the Health and Environmental Sciences Institute (HESI) Genetic Toxicology Technical Committee (GTTC) sponsored a workshop held in Lancaster, UK on July 10-11, 2014. The event included invited speakers from several institutions and the contents was divided into three themes-1: Point-of-departure Metrics for Quantitative Dose-Response Analysis in Genetic Toxicology; 2: Measurement and Estimation of Exposures for Better Extrapolation to Humans and 3: The Use of Quantitative Approaches in Genetic Toxicology for human health risk assessment (HHRA). A host of pertinent issues were discussed relating to the use of in vitro and in vivo dose-response data, the development of methods for in vitro to in vivo extrapolation and approaches to use in vivo dose-response data to determine human exposure limits for regulatory evaluations and decision-making. This Special Issue, which was inspired by the workshop, contains a series of papers that collectively address topics related to the aforementioned themes. The Issue includes contributions that collectively evaluate, describe and discuss in silico, in vitro, in vivo and statistical approaches that are facilitating the shift from qualitative hazard evaluation to quantitative risk assessment. The use and application of the benchmark dose approach was a central theme in many of the workshop presentations and discussions, and the Special Issue includes several contributions that outline novel applications for the analysis and interpretation of genetic toxicity data. Although the contents of the Special Issue constitutes an important step towards the adoption of quantitative methods for regulatory assessment of genetic toxicity, formal acceptance of quantitative methods for HHRA and regulatory decision-making will require consensus regarding the

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Qualitative risk assessment during polymer mortar test specimens preparation - methods comparison

NASA Astrophysics Data System (ADS)

Silva, F.; Sousa, S. P. B.; Arezes, P.; Swuste, P.; Ribeiro, M. C. S.; Baptista, J. S.

2015-05-01

Polymer binder modification with inorganic nanomaterials (NM) could be a potential and efficient solution to control matrix flammability of polymer concrete (PC) materials without sacrificing other important properties. Occupational exposures can occur all along the life cycle of a NM and “nanoproducts” from research through scale-up, product development, manufacturing, and end of life. The main objective of the present study is to analyse and compare different qualitative risk assessment methods during the production of polymer mortars (PM) with NM. The laboratory scale production process was divided in 3 main phases (pre-production, production and post-production), which allow testing the assessment methods in different situations. The risk assessment involved in the manufacturing process of PM was made by using the qualitative analyses based on: French Agency for Food, Environmental and Occupational Health & Safety method (ANSES); Control Banding Nanotool (CB Nanotool); Ecole Polytechnique Fédérale de Lausanne method (EPFL); Guidance working safely with nanomaterials and nanoproducts (GWSNN); Istituto Superiore per la Prevenzione e la Sicurezza del Lavoro, Italy method (ISPESL); Precautionary Matrix for Synthetic Nanomaterials (PMSN); and Stoffenmanager Nano. It was verified that the different methods applied also produce different final results. In phases 1 and 3 the risk assessment tends to be classified as medium-high risk, while for phase 2 the more common result is medium level. It is necessary to improve the use of qualitative methods by defining narrow criteria for the methods selection for each assessed situation, bearing in mind that the uncertainties are also a relevant factor when dealing with the risk related to nanotechnologies field.

Toward an agenda for evaluation of qualitative research.

PubMed

Stige, Brynjulf; Malterud, Kirsti; Midtgarden, Torjus

2009-10-01

Evaluation is essential for research quality and development, but the diversity of traditions that characterize qualitative research suggests that general checklists or shared criteria for evaluation are problematic. We propose an approach to research evaluation that encourages reflexive dialogue through use of an evaluation agenda. In proposing an evaluation agenda we shift attention from rule-based judgment to reflexive dialogue. Unlike criteria, an agenda may embrace pluralism, and does not request consensus on ontological, epistemological, and methodological issues, only consensus on what themes warrant discussion. We suggest an evaluation agenda-EPICURE-with two dimensions communicated through use of two acronyms.The first, EPIC, refers to the challenge of producing rich and substantive accounts based on engagement, processing, interpretation, and (self-)critique. The second-CURE-refers to the challenge of dealing with preconditions and consequences of research, with a focus on (social) critique, usefulness, relevance, and ethics. The seven items of the composite agenda EPICURE are presented and exemplified. Features and implications of the agenda approach to research evaluation are then discussed.

[Analysis of qualitative data collection methods used in adolescent research].

PubMed

Ndengeyingoma, Assumpta; De Montigny, Francine; Miron, Jean-Marie

2013-03-01

There has been remarkable growth in research on adolescents in the last decade, particularly in nursing science. The goal of this article is to produce a synthesis of findings justifying the use of qualitative methods in collecting data from adolescents. A literature review identified relevant articles (N : 27) from digital databases. While the studies done on adolescents were on different topics, the data collection methods were often similar. Most of the studies used more than one technique to reconcile scientific rigour and the way the adolescents expressed themselves. In order to understand a phenomenon, its context and the meaning given to the experience proved essential. In qualitative research on adolescents, it is important to use data collection methods that make it possible to clearly target the experience explored and to orient and guide the individual in deepening that experience in order to favour the emergence of his or her point of view. Data collection methods based on written communication have to be complemented with other methods more focused on oral communication so as to draw out interpretations reflecting adolescents' points of view as accurately as possible.

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

Towards a Critical Health Equity Research Stance: Why Epistemology and Methodology Matter More than Qualitative Methods

ERIC Educational Resources Information Center

Bowleg, Lisa

2017-01-01

Qualitative methods are not intrinsically progressive. Methods are simply tools to conduct research. Epistemology, the justification of knowledge, shapes methodology and methods, and thus is a vital starting point for a critical health equity research stance, regardless of whether the methods are qualitative, quantitative, or mixed. In line with…

Mixing Qualitative and Quantitative Methods: Insights into Design and Analysis Issues

ERIC Educational Resources Information Center

Lieber, Eli

2009-01-01

This article describes and discusses issues related to research design and data analysis in the mixing of qualitative and quantitative methods. It is increasingly desirable to use multiple methods in research, but questions arise as to how best to design and analyze the data generated by mixed methods projects. I offer a conceptualization for such…

Qualitative Methods Can Enrich Quantitative Research on Occupational Stress: An Example from One Occupational Group

ERIC Educational Resources Information Center

Schonfeld, Irvin Sam; Farrell, Edwin

2010-01-01

The chapter examines the ways in which qualitative and quantitative methods support each other in research on occupational stress. Qualitative methods include eliciting from workers unconstrained descriptions of work experiences, careful first-hand observations of the workplace, and participant-observers describing "from the inside" a…

Assessment of acute myocarditis by cardiac magnetic resonance imaging: Comparison of qualitative and quantitative analysis methods.

PubMed

Imbriaco, Massimo; Nappi, Carmela; Puglia, Marta; De Giorgi, Marco; Dell'Aversana, Serena; Cuocolo, Renato; Ponsiglione, Andrea; De Giorgi, Igino; Polito, Maria Vincenza; Klain, Michele; Piscione, Federico; Pace, Leonardo; Cuocolo, Alberto

2017-10-26

To compare cardiac magnetic resonance (CMR) qualitative and quantitative analysis methods for the noninvasive assessment of myocardial inflammation in patients with suspected acute myocarditis (AM). A total of 61 patients with suspected AM underwent coronary angiography and CMR. Qualitative analysis was performed applying Lake-Louise Criteria (LLC), followed by quantitative analysis based on the evaluation of edema ratio (ER) and global relative enhancement (RE). Diagnostic performance was assessed for each method by measuring the area under the curves (AUC) of the receiver operating characteristic analyses. The final diagnosis of AM was based on symptoms and signs suggestive of cardiac disease, evidence of myocardial injury as defined by electrocardiogram changes, elevated troponin I, exclusion of coronary artery disease by coronary angiography, and clinical and echocardiographic follow-up at 3 months after admission to the chest pain unit. In all patients, coronary angiography did not show significant coronary artery stenosis. Troponin I levels and creatine kinase were higher in patients with AM compared to those without (both P < .001). There were no significant differences among LLC, T2-weighted short inversion time inversion recovery (STIR) sequences, early (EGE), and late (LGE) gadolinium-enhancement sequences for diagnosis of AM. The AUC for qualitative (T2-weighted STIR 0.92, EGE 0.87 and LGE 0.88) and quantitative (ER 0.89 and global RE 0.80) analyses were also similar. Qualitative and quantitative CMR analysis methods show similar diagnostic accuracy for the diagnosis of AM. These findings suggest that a simplified approach using a shortened CMR protocol including only T2-weighted STIR sequences might be useful to rule out AM in patients with acute coronary syndrome and normal coronary angiography.

Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology: The APA Publications and Communications Board task force report.

PubMed

Levitt, Heidi M; Bamberg, Michael; Creswell, John W; Frost, David M; Josselson, Ruthellen; Suárez-Orozco, Carola

2018-01-01

The American Psychological Association Publications and Communications Board Working Group on Journal Article Reporting Standards for Qualitative Research (JARS-Qual Working Group) was charged with examining the state of journal article reporting standards as they applied to qualitative research and with generating recommendations for standards that would be appropriate for a wide range of methods within the discipline of psychology. These standards describe what should be included in a research report to enable and facilitate the review process. This publication marks a historical moment-the first inclusion of qualitative research in APA Style, which is the basis of both the Publication Manual of the American Psychological Association (APA, 2010) and APA Style CENTRAL, an online program to support APA Style. In addition to the general JARS-Qual guidelines, the Working Group has developed standards for both qualitative meta-analysis and mixed methods research. The reporting standards were developed for psychological qualitative research but may hold utility for a broad range of social sciences. They honor a range of qualitative traditions, methods, and reporting styles. The Working Group was composed of a group of researchers with backgrounds in varying methods, research topics, and approaches to inquiry. In this article, they present these standards and their rationale, and they detail the ways that the standards differ from the quantitative research reporting standards. They describe how the standards can be used by authors in the process of writing qualitative research for submission as well as by reviewers and editors in the process of reviewing research. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions

PubMed Central

Abildgaard, Johan S.; Saksvik, Per Ø.; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire (N = 285) as well as an extensive interview study (N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies. PMID:27713707

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions.

PubMed

Abildgaard, Johan S; Saksvik, Per Ø; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire ( N = 285) as well as an extensive interview study ( N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies.

Qualitative Evaluation of the Five-Year 'Red Collar' Campaign to End Inhumane Culling of Dogs as a Method of Rabies Control.

PubMed

Hiby, Elly; Tasker, Lou

2018-02-06

Dog-mediated human rabies can be eliminated through mass dog vaccination. Despite leading authorities in human and animal health uniting to advance effective and humane rabies control, some governments resort to lethal methods, which are unethical, often inhumane and ineffective. To end the inhumane culling of dogs in response to rabies, World Animal Protection launched 'Red Collar'; a five-year campaign (2011-2016) that worked with governments to promote the implementation of mass dog vaccination for rabies control. We present the findings from a qualitative evaluation of 'Red Collar', conducted both regionally and with national focus on Bangladesh, China, Indonesia, the Philippines and Zanzibar, Tanzania. Through semi-structured interviews and written contributions from stakeholders ( n = 54), we compared perceptions of changes with stated campaign goals to capture recommendations for future work. The campaign successfully generated momentum for implementation of mass dog vaccination by targeted governments. Lessons learned were established: Value of a consistent animal welfare 'voice'; the need to explore the motivations behind culling; the need to capacity build; time required for the 'ripple effect' to inspire humane control in other countries; importance of monitoring and evaluation of indicators; time and effort required for exit strategies and prior preparation for a robust response to culling.

The Annemarie Roeper Method of Qualitative Assessment: My Journey

ERIC Educational Resources Information Center

Beneventi, Anne

2016-01-01

The Annemarie Roeper Method of Qualitative Assessment (QA) establishes an extremely rich set of procedures for revealing students' strengths as well as opportunities for the development of bright young people. This article explores the ways in which the QA process serves as a sterling example of a holistic, authentic system for recognizing…

An innovative method to involve community health workers as partners in evaluation research.

PubMed

Peacock, Nadine; Issel, L Michele; Townsell, Stephanie J; Chapple-McGruder, Theresa; Handler, Arden

2011-12-01

We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training.

Mixed methods in gerontological research: Do the qualitative and quantitative data “touch”?

PubMed Central

Happ, Mary Beth

2010-01-01

This paper distinguishes between parallel and integrated mixed methods research approaches. Barriers to integrated mixed methods approaches in gerontological research are discussed and critiqued. The author presents examples of mixed methods gerontological research to illustrate approaches to data integration at the levels of data analysis, interpretation, and research reporting. As a summary of the methodological literature, four basic levels of mixed methods data combination are proposed. Opportunities for mixing qualitative and quantitative data are explored using contemporary examples from published studies. Data transformation and visual display, judiciously applied, are proposed as pathways to fuller mixed methods data integration and analysis. Finally, practical strategies for mixing qualitative and quantitative data types are explicated as gerontological research moves beyond parallel mixed methods approaches to achieve data integration. PMID:20077973

Constituting the Field: An Essay on Harry Torrance's "Qualitative Research Methods in Education"

ERIC Educational Resources Information Center

Dimitriadis, Greg

2011-01-01

This article critically explores Harry Torrance's four-volume edited collection "Qualitative Research Methods in Education." The author argues that this text is an important intervention in the constitution of a meta-discourse on qualitative research today. Torrance pays particular attention to the field of education, providing much needed…

The Value of Qualitative Methods in Social Validity Research

ERIC Educational Resources Information Center

Leko, Melinda M.

2014-01-01

One quality indicator of intervention research is the extent to which the intervention has a high degree of social validity, or practicality. In this study, I drew on Wolf's framework for social validity and used qualitative methods to ascertain five middle schoolteachers' perceptions of the social validity of System 44®--a phonics-based reading…

Wellbeing Research in Developing Countries: Reviewing the Role of Qualitative Methods

ERIC Educational Resources Information Center

Camfield, Laura; Crivello, Gina; Woodhead, Martin

2009-01-01

The authors review the contribution of qualitative methods to exploring concepts and experiences of wellbeing among children and adults living in developing countries. They provide examples illustrating the potential of these methods for gaining a holistic and contextual understanding of people's perceptions and experiences. Some of these come…

A Qualitative Evaluation of Ethics Educational Program in Health Science1

PubMed Central

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-01-01

This paper originates from a panel discussion on the evaluation of “Ethics Educational Program in Health Sciences” held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs. PMID:26664129

Using qualitative methods to understand factors contributing to patient satisfaction among dermatology patients: a systematic review.

PubMed

Gibbons, Caitlin; Singh, Sanminder; Gibbons, Brittany; Clark, Caitlin; Torres, Josefina; Cheng, Michelle Y; Wang, Elizabeth A; Armstrong, April W

2018-05-01

In this systematic review, we aimed to synthesize data that identify factors contributing to patient satisfaction in dermatology care using qualitative methods. We performed a comprehensive search of the literature using the PubMed database for articles published between January 1, 2000 and February 9, 2015. The initial search yielded 186 articles, of which 13 were included after applying inclusion and exclusion criteria. The systematic review of 13 articles included a total of 330 patients. Using in-field observations and semistructured interviews, studies found that qualitative methods and analysis increased the provider's sensitivity to patient needs and enhanced patient care. Analyses using qualitative methods found increased patient satisfaction in their healthcare provider is associated with (1) confidence in the provider's diagnosis, (2) perception of patient-centered, individualized recommendations and (3) quality of patient education and provider explanation during a visit. Patient satisfaction is measured using either quantitative or qualitative methods. Quantitative methods result in standardized data that often does not capture the nuances of patient experience. In contrast, qualitative methodology is integral to gathering patient perspectives on patient care and satisfaction and should be included in future research models.

Methods for the thematic synthesis of qualitative research in systematic reviews

PubMed Central

Thomas, James; Harden, Angela

2008-01-01

Background There is a growing recognition of the value of synthesising qualitative research in the evidence base in order to facilitate effective and appropriate health care. In response to this, methods for undertaking these syntheses are currently being developed. Thematic analysis is a method that is often used to analyse data in primary qualitative research. This paper reports on the use of this type of analysis in systematic reviews to bring together and integrate the findings of multiple qualitative studies. Methods We describe thematic synthesis, outline several steps for its conduct and illustrate the process and outcome of this approach using a completed review of health promotion research. Thematic synthesis has three stages: the coding of text 'line-by-line'; the development of 'descriptive themes'; and the generation of 'analytical themes'. While the development of descriptive themes remains 'close' to the primary studies, the analytical themes represent a stage of interpretation whereby the reviewers 'go beyond' the primary studies and generate new interpretive constructs, explanations or hypotheses. The use of computer software can facilitate this method of synthesis; detailed guidance is given on how this can be achieved. Results We used thematic synthesis to combine the studies of children's views and identified key themes to explore in the intervention studies. Most interventions were based in school and often combined learning about health benefits with 'hands-on' experience. The studies of children's views suggested that fruit and vegetables should be treated in different ways, and that messages should not focus on health warnings. Interventions that were in line with these suggestions tended to be more effective. Thematic synthesis enabled us to stay 'close' to the results of the primary studies, synthesising them in a transparent way, and facilitating the explicit production of new concepts and hypotheses. Conclusion We compare thematic

Paradigms Lost and Pragmatism Regained: Methodological Implications of Combining Qualitative and Quantitative Methods

ERIC Educational Resources Information Center

Morgan, David L.

2007-01-01

This article examines several methodological issues associated with combining qualitative and quantitative methods by comparing the increasing interest in this topic with the earlier renewal of interest in qualitative research during the 1980s. The first section argues for the value of Kuhn's concept of paradigm shifts as a tool for examining…

Bayesian data augmentation methods for the synthesis of qualitative and quantitative research findings

PubMed Central

Crandell, Jamie L.; Voils, Corrine I.; Chang, YunKyung; Sandelowski, Margarete

2010-01-01

The possible utility of Bayesian methods for the synthesis of qualitative and quantitative research has been repeatedly suggested but insufficiently investigated. In this project, we developed and used a Bayesian method for synthesis, with the goal of identifying factors that influence adherence to HIV medication regimens. We investigated the effect of 10 factors on adherence. Recognizing that not all factors were examined in all studies, we considered standard methods for dealing with missing data and chose a Bayesian data augmentation method. We were able to summarize, rank, and compare the effects of each of the 10 factors on medication adherence. This is a promising methodological development in the synthesis of qualitative and quantitative research. PMID:21572970

On Bayesian methods of exploring qualitative interactions for targeted treatment.

PubMed

Chen, Wei; Ghosh, Debashis; Raghunathan, Trivellore E; Norkin, Maxim; Sargent, Daniel J; Bepler, Gerold

2012-12-10

Providing personalized treatments designed to maximize benefits and minimizing harms is of tremendous current medical interest. One problem in this area is the evaluation of the interaction between the treatment and other predictor variables. Treatment effects in subgroups having the same direction but different magnitudes are called quantitative interactions, whereas those having opposite directions in subgroups are called qualitative interactions (QIs). Identifying QIs is challenging because they are rare and usually unknown among many potential biomarkers. Meanwhile, subgroup analysis reduces the power of hypothesis testing and multiple subgroup analyses inflate the type I error rate. We propose a new Bayesian approach to search for QI in a multiple regression setting with adaptive decision rules. We consider various regression models for the outcome. We illustrate this method in two examples of phase III clinical trials. The algorithm is straightforward and easy to implement using existing software packages. We provide a sample code in Appendix A. Copyright © 2012 John Wiley & Sons, Ltd.

Dynamic reflexivity in action: an armchair walkthrough of a qualitatively driven mixed-method and multiple methods study of mindfulness training in schoolchildren.

PubMed

Cheek, Julianne; Lipschitz, David L; Abrams, Elizabeth M; Vago, David R; Nakamura, Yoshio

2015-06-01

Dynamic reflexivity is central to enabling flexible and emergent qualitatively driven inductive mixed-method and multiple methods research designs. Yet too often, such reflexivity, and how it is used at various points of a study, is absent when we write our research reports. Instead, reports of mixed-method and multiple methods research focus on what was done rather than how it came to be done. This article seeks to redress this absence of emphasis on the reflexive thinking underpinning the way that mixed- and multiple methods, qualitatively driven research approaches are thought about and subsequently used throughout a project. Using Morse's notion of an armchair walkthrough, we excavate and explore the layers of decisions we made about how, and why, to use qualitatively driven mixed-method and multiple methods research in a study of mindfulness training (MT) in schoolchildren. © The Author(s) 2015.

Defining Leadership: Collegiate Women's Learning Circles: A Qualitative Approach

ERIC Educational Resources Information Center

Preston-Cunningham, Tammie; Elbert, Chanda D.; Dooley, Kim E.

2017-01-01

The researchers employed qualitative methods to evaluate first-year female students' definition of "leadership" through involvement in the Women's Learning Circle. The findings revealed that students defined leadership in two dimensions: traits and behaviors. The qualitative findings explore a multidimensional approach to the voices of…

Probability of identification: a statistical model for the validation of qualitative botanical identification methods.

PubMed

LaBudde, Robert A; Harnly, James M

2012-01-01

A qualitative botanical identification method (BIM) is an analytical procedure that returns a binary result (1 = Identified, 0 = Not Identified). A BIM may be used by a buyer, manufacturer, or regulator to determine whether a botanical material being tested is the same as the target (desired) material, or whether it contains excessive nontarget (undesirable) material. The report describes the development and validation of studies for a BIM based on the proportion of replicates identified, or probability of identification (POI), as the basic observed statistic. The statistical procedures proposed for data analysis follow closely those of the probability of detection, and harmonize the statistical concepts and parameters between quantitative and qualitative method validation. Use of POI statistics also harmonizes statistical concepts for botanical, microbiological, toxin, and other analyte identification methods that produce binary results. The POI statistical model provides a tool for graphical representation of response curves for qualitative methods, reporting of descriptive statistics, and application of performance requirements. Single collaborator and multicollaborative study examples are given.

Qualitative Methods to Advance Care, Diagnosis, and Therapy in Rheumatic Diseases.

PubMed

Saketkoo, Lesley Ann; Pauling, John D

2018-05-01

This article provides an overview of the basis, usefulness, and validity of qualitative methods in research. It is aimed to enhance the understanding of a broad spectrum of readers, ranging from those mystified by such approaches, to those wanting a better critical knowledge to apply to literature review, and for health care providers considering developing an interest in the field. Qualitative research is crucial in augmentation of disease knowledge as well as the development of incremental care strategies and operational aspects of care that improves health outcomes. Copyright © 2018 Elsevier Inc. All rights reserved.

Case management of individuals with long-term conditions by community matrons: report of qualitative findings of a mixed method evaluation.

PubMed

Randall, Sue; Daly, Guy; Thunhurst, Colin; Mills, Natalie; Guest, David A; Barker, Annette

2014-01-01

To consider findings from a study that evaluated case management of individuals with long-term conditions (LTCs) by a community matron (CM) service. The paper highlights issues related to the implementation of a new role and the impact this had on the experience of care across hospital and community settings for patients and their carers. The introduction of the role of CM was intended to increase effective management of patients with complex comorbid LTCs through the introduction of case management, thereby reducing unplanned hospital admissions. The overall methodological approach was one of mixed methods. This paper reports the qualitative findings from CMs (n = 15); patients (n = 13); family carers (n = 8); and secondary care staff who interface with the CM service (n = 7). Data were collected between October 2009 and May 2010. A thematic analysis resulted in the identification of four themes: (1) visibility; (2) interpersonal relationships; (3) leadership; and (4) systems/professional boundaries. Patients enjoyed being seen as a whole and family carers appreciated the coordination aspect of the role. Difficulties arose from the limited understanding of the CM role and from a lack of a shared vision across healthcare professionals concerning the role and its goals.

Using quantitative and qualitative data in health services research - what happens when mixed method findings conflict? [ISRCTN61522618].

PubMed

Moffatt, Suzanne; White, Martin; Mackintosh, Joan; Howel, Denise

2006-03-08

In this methodological paper we document the interpretation of a mixed methods study and outline an approach to dealing with apparent discrepancies between qualitative and quantitative research data in a pilot study evaluating whether welfare rights advice has an impact on health and social outcomes among a population aged 60 and over. Quantitative and qualitative data were collected contemporaneously. Quantitative data were collected from 126 men and women aged over 60 within a randomised controlled trial. Participants received a full welfare benefits assessment which successfully identified additional financial and non-financial resources for 60% of them. A range of demographic, health and social outcome measures were assessed at baseline, 6, 12 and 24 month follow up. Qualitative data were collected from a sub-sample of 25 participants purposively selected to take part in individual interviews to examine the perceived impact of welfare rights advice. Separate analysis of the quantitative and qualitative data revealed discrepant findings. The quantitative data showed little evidence of significant differences of a size that would be of practical or clinical interest, suggesting that the intervention had no impact on these outcome measures. The qualitative data suggested wide-ranging impacts, indicating that the intervention had a positive effect. Six ways of further exploring these data were considered: (i) treating the methods as fundamentally different; (ii) exploring the methodological rigour of each component; (iii) exploring dataset comparability; (iv) collecting further data and making further comparisons; (v) exploring the process of the intervention; and (vi) exploring whether the outcomes of the two components match. The study demonstrates how using mixed methods can lead to different and sometimes conflicting accounts and, using this six step approach, how such discrepancies can be harnessed to interrogate each dataset more fully. Not only does this

Qualitative to quantitative: linked trajectory of method triangulation in a study on HIV/AIDS in Goa, India.

PubMed

Bailey, Ajay; Hutter, Inge

2008-10-01

With 3.1 million people estimated to be living with HIV/AIDS in India and 39.5 million people globally, the epidemic has posed academics the challenge of identifying behaviours and their underlying beliefs in the effort to reduce the risk of HIV transmission. The Health Belief Model (HBM) is frequently used to identify risk behaviours and adherence behaviour in the field of HIV/AIDS. Risk behaviour studies that apply HBM have been largely quantitative and use of qualitative methodology is rare. The marriage of qualitative and quantitative methods has never been easy. The challenge is in triangulating the methods. Method triangulation has been largely used to combine insights from the qualitative and quantitative methods but not to link both the methods. In this paper we suggest a linked trajectory of method triangulation (LTMT). The linked trajectory aims to first gather individual level information through in-depth interviews and then to present the information as vignettes in focus group discussions. We thus validate information obtained from in-depth interviews and gather emic concepts that arise from the interaction. We thus capture both the interpretation and the interaction angles of the qualitative method. Further, using the qualitative information gained, a survey is designed. In doing so, the survey questions are grounded and contextualized. We employed this linked trajectory of method triangulation in a study on the risk assessment of HIV/AIDS among migrant and mobile men. Fieldwork was carried out in Goa, India. Data come from two waves of studies, first an explorative qualitative study (2003), second a larger study (2004-2005), including in-depth interviews (25), focus group discussions (21) and a survey (n=1259). By employing the qualitative to quantitative LTMT we can not only contextualize the existing concepts of the HBM, but also validate new concepts and identify new risk groups.

Extending Beyond Qualitative Interviewing to Illuminate the Tacit Nature of Everyday Occupation: Occupational Mapping and Participatory Occupation Methods.

PubMed

Huot, Suzanne; Rudman, Debbie Laliberte

2015-07-01

The study of human occupation requires a variety of methods to fully elucidate its complex, multifaceted nature. Although qualitative approaches have commonly been used within occupational therapy and occupational science, we contend that such qualitative research must extend beyond the sole use of interviews. Drawing on qualitative methodological literature, we discuss the limits of interview methods and outline other methods, particularly visual methods, as productive means to enhance qualitative research. We then provide an overview of our critical ethnographic study that used narrative, visual, and observational methods to explore the occupational transitions experienced by immigrants to Canada. We describe our use of occupational mapping and participatory occupation methods and the contributions of these combined methods. We conclude that adopting a variety of methods can enable a deeper understanding of the tacit nature of everyday occupation, and is key to advancing knowledge regarding occupation and to informing occupational therapy practice.

A qualitative evaluation of strategies to increase colorectal cancer screening uptake

PubMed Central

Tinmouth, Jill; Ritvo, Paul; McGregor, S. Elizabeth; Claus, Danielle; Pasut, George; Myers, Ronald E.; Guglietti, Crissa; Paszat, Lawrence F.; Hilsden, Robert J.; Rabeneck, Linda

2011-01-01

Abstract Objective To obtain data that could be used to optimize the content and design of the targeted, mailed invitations that Ontario’s provincewide colorectal cancer (CRC) screening program plans to use to increase screening uptake; to identify other strategies to increase CRC screening uptake; and to describe the effects of this qualitative work on a subsequent quantitative pilot study. Design Qualitative study using semistructured focus groups. Setting Four different Ontario communities. Participants Six focus groups comprising a total of 62 participants. Methods Six focus groups were conducted in 4 different Ontario communities. For 3 of the communities, participants were recruited from the general population by a private marketing firm, using random-digit dialing, and received a small honorarium for participating. In Sault Ste Marie, participants were convenience samples recruited from a large primary care practice and were not offered compensation. Responses were elicited regarding various strategies for promoting CRC screening. Findings represent all responses observed as well as recommendations to program planners based on focus groups observations. Main findings Key themes identified included the importance of receiving a CRC screening invitation from one’s family physician; a desire for personalized, brief communications; and a preference for succinct information in mailed materials. Strong support was indicated for direct mailing of the CRC screening kit (fecal occult blood test). Our findings substantially influenced the final design and content of the envelope and letter to be mailed in the subsequent quantitative pilot study. Conclusion We report strong support from our focus groups for a succinct, personalized invitation for CRC screening from one’s own family physician. We have also shown that qualitative evaluation can be used to provide decision makers with pertinent and timely knowledge. Our study is highly relevant to other public

Using quantitative and qualitative data in health services research – what happens when mixed method findings conflict? [ISRCTN61522618

PubMed Central

Moffatt, Suzanne; White, Martin; Mackintosh, Joan; Howel, Denise

2006-01-01

Background In this methodological paper we document the interpretation of a mixed methods study and outline an approach to dealing with apparent discrepancies between qualitative and quantitative research data in a pilot study evaluating whether welfare rights advice has an impact on health and social outcomes among a population aged 60 and over. Methods Quantitative and qualitative data were collected contemporaneously. Quantitative data were collected from 126 men and women aged over 60 within a randomised controlled trial. Participants received a full welfare benefits assessment which successfully identified additional financial and non-financial resources for 60% of them. A range of demographic, health and social outcome measures were assessed at baseline, 6, 12 and 24 month follow up. Qualitative data were collected from a sub-sample of 25 participants purposively selected to take part in individual interviews to examine the perceived impact of welfare rights advice. Results Separate analysis of the quantitative and qualitative data revealed discrepant findings. The quantitative data showed little evidence of significant differences of a size that would be of practical or clinical interest, suggesting that the intervention had no impact on these outcome measures. The qualitative data suggested wide-ranging impacts, indicating that the intervention had a positive effect. Six ways of further exploring these data were considered: (i) treating the methods as fundamentally different; (ii) exploring the methodological rigour of each component; (iii) exploring dataset comparability; (iv) collecting further data and making further comparisons; (v) exploring the process of the intervention; and (vi) exploring whether the outcomes of the two components match. Conclusion The study demonstrates how using mixed methods can lead to different and sometimes conflicting accounts and, using this six step approach, how such discrepancies can be harnessed to interrogate each

Development of the pediatric quality of life inventory neurofibromatosis type 1 module items for children, adolescents and young adults: qualitative methods.

PubMed

Nutakki, Kavitha; Varni, James W; Steinbrenner, Sheila; Draucker, Claire B; Swigonski, Nancy L

2017-03-01

Health-related quality of life (HRQOL) is arguably one of the most important measures in evaluating effectiveness of clinical treatments. At present, there is no disease-specific outcome measure to assess the HRQOL of children, adolescents and young adults with Neurofibromatosis Type 1 (NF1). This study aimed to develop the items and support the content validity for the Pediatric Quality of Life Inventory™ (PedsQL™) NF1 Module for children, adolescents and young adults. The iterative process included multiphase qualitative methods including a literature review, survey of expert opinions, semi-structured interviews, cognitive interviews and pilot testing. Fifteen domains were derived from the qualitative methods, with content saturation achieved, resulting in 115 items. The domains include skin, pain, pain impact, pain management, cognitive functioning, speech, fine motor, balance, vision, perceived physical appearance, communication, worry, treatment, medicines and gastrointestinal symptoms. This study is limited because all participants are recruited from a single-site. Qualitative methods support the content validity for the PedsQL™ NF1 Module for children, adolescents and young adults. The PedsQL™ NF1 Module is now undergoing national multisite field testing for the psychometric validation of the instrument development.

Interpretive focus groups: a participatory method for interpreting and extending secondary analysis of qualitative data.

PubMed

Redman-MacLaren, Michelle; Mills, Jane; Tommbe, Rachael

2014-01-01

Participatory approaches to qualitative research practice constantly change in response to evolving research environments. Researchers are increasingly encouraged to undertake secondary analysis of qualitative data, despite epistemological and ethical challenges. Interpretive focus groups can be described as a more participative method for groups to analyse qualitative data. To facilitate interpretive focus groups with women in Papua New Guinea to extend analysis of existing qualitative data and co-create new primary data. The purpose of this was to inform a transformational grounded theory and subsequent health promoting action. A two-step approach was used in a grounded theory study about how women experience male circumcision in Papua New Guinea. Participants analysed portions or 'chunks' of existing qualitative data in story circles and built upon this analysis by using the visual research method of storyboarding. New understandings of the data were evoked when women in interpretive focus groups analysed the data 'chunks'. Interpretive focus groups encouraged women to share their personal experiences about male circumcision. The visual method of storyboarding enabled women to draw pictures to represent their experiences. This provided an additional focus for whole-of-group discussions about the research topic. Interpretive focus groups offer opportunity to enhance trustworthiness of findings when researchers undertake secondary analysis of qualitative data. The co-analysis of existing data and co-generation of new data between research participants and researchers informed an emergent transformational grounded theory and subsequent health promoting action.

Interpretive focus groups: a participatory method for interpreting and extending secondary analysis of qualitative data

PubMed Central

Redman-MacLaren, Michelle; Mills, Jane; Tommbe, Rachael

2014-01-01

Background Participatory approaches to qualitative research practice constantly change in response to evolving research environments. Researchers are increasingly encouraged to undertake secondary analysis of qualitative data, despite epistemological and ethical challenges. Interpretive focus groups can be described as a more participative method for groups to analyse qualitative data. Objective To facilitate interpretive focus groups with women in Papua New Guinea to extend analysis of existing qualitative data and co-create new primary data. The purpose of this was to inform a transformational grounded theory and subsequent health promoting action. Design A two-step approach was used in a grounded theory study about how women experience male circumcision in Papua New Guinea. Participants analysed portions or ‘chunks’ of existing qualitative data in story circles and built upon this analysis by using the visual research method of storyboarding. Results New understandings of the data were evoked when women in interpretive focus groups analysed the data ‘chunks’. Interpretive focus groups encouraged women to share their personal experiences about male circumcision. The visual method of storyboarding enabled women to draw pictures to represent their experiences. This provided an additional focus for whole-of-group discussions about the research topic. Conclusions Interpretive focus groups offer opportunity to enhance trustworthiness of findings when researchers undertake secondary analysis of qualitative data. The co-analysis of existing data and co-generation of new data between research participants and researchers informed an emergent transformational grounded theory and subsequent health promoting action. PMID:25138532

A new method to evaluate human-robot system performance

NASA Technical Reports Server (NTRS)

Rodriguez, G.; Weisbin, C. R.

2003-01-01

One of the key issues in space exploration is that of deciding what space tasks are best done with humans, with robots, or a suitable combination of each. In general, human and robot skills are complementary. Humans provide as yet unmatched capabilities to perceive, think, and act when faced with anomalies and unforeseen events, but there can be huge potential risks to human safety in getting these benefits. Robots provide complementary skills in being able to work in extremely risky environments, but their ability to perceive, think, and act by themselves is currently not error-free, although these capabilities are continually improving with the emergence of new technologies. Substantial past experience validates these generally qualitative notions. However, there is a need for more rigorously systematic evaluation of human and robot roles, in order to optimize the design and performance of human-robot system architectures using well-defined performance evaluation metrics. This article summarizes a new analytical method to conduct such quantitative evaluations. While the article focuses on evaluating human-robot systems, the method is generally applicable to a much broader class of systems whose performance needs to be evaluated.

Shared Journaling as Peer Support in Teaching Qualitative Research Methods

ERIC Educational Resources Information Center

Humble, Aine M.; Sharp, Elizabeth

2012-01-01

Teaching qualitative research methods (QRM), particularly early on in one's academic career, can be challenging. This paper describes shared peer journaling as one way in which to cope with challenges such as complex debates in the field and student resistance to interpretive paradigms. Literature on teaching QRM and the pedagogical value of…

'Questerviews': using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research.

PubMed

Adamson, Joy; Gooberman-Hill, Rachael; Woolhead, Gillian; Donovan, Jenny

2004-07-01

Multi-method approaches are increasingly advocated in health services research (HSR). This paper examines the use of standardised self-completion questionnaires and questions, during in-depth interviews, a technique termed 'questerviews'. 'Questerview' techniques were used in four empirical studies of health perceptions conducted by the authors. The studies included both standardised self-completion questions or questionnaires and in-depth interviews. Respondents were tape-recorded while they completed the standardised questionnaires and were encouraged to discuss their definitions of terms and responses to items in-depth. In all studies, 'questerviews' were fully transcribed and data analysis involved the scrutinising of transcripts to identify emergent themes. Responses to the standardised items led to rich sources of qualitative data. They proved to be useful triggers as respondents discussed their understanding and definitions of terms, often explaining their responses with stories from their own experiences. The items triggered detailed exploration of the complex factors that comprise health, illness and healthcare seeking, and gave considerable insight into the ways in which people respond to standardised questions. Apparently simple questions and response categories conceal considerable complexity. Inclusion of standardised survey questions in qualitative interviews can provide an easy and fruitful method to explore research issues and provide triggers to difficult or contested topics. Well designed and validated questionnaires produce data of immense value to HSR, and this value could be further enhanced by their use within a qualitative interview. We suggest that the technique of 'questerviews' is a tangible and pragmatic way of doing this.

Teacher Evaluation: A Qualitative Study on Growth-Producing Practices in K-8 Schools

ERIC Educational Resources Information Center

Manso, Phoebe Hechanova

2017-01-01

Literature on teacher evaluation describes a flawed system that evokes wide-ranging attempts to "get it right." This qualitative study is another effort that seeks to understand its legal and traditional constructs. The goal of this research is to identify growth-producing practices that will transform teacher evaluation into an organic…

Combining qualitative and quantitative research within mixed method research designs: a methodological review.

PubMed

Östlund, Ulrika; Kidd, Lisa; Wengström, Yvonne; Rowa-Dewar, Neneh

2011-03-01

It has been argued that mixed methods research can be useful in nursing and health science because of the complexity of the phenomena studied. However, the integration of qualitative and quantitative approaches continues to be one of much debate and there is a need for a rigorous framework for designing and interpreting mixed methods research. This paper explores the analytical approaches (i.e. parallel, concurrent or sequential) used in mixed methods studies within healthcare and exemplifies the use of triangulation as a methodological metaphor for drawing inferences from qualitative and quantitative findings originating from such analyses. This review of the literature used systematic principles in searching CINAHL, Medline and PsycINFO for healthcare research studies which employed a mixed methods approach and were published in the English language between January 1999 and September 2009. In total, 168 studies were included in the results. Most studies originated in the United States of America (USA), the United Kingdom (UK) and Canada. The analytic approach most widely used was parallel data analysis. A number of studies used sequential data analysis; far fewer studies employed concurrent data analysis. Very few of these studies clearly articulated the purpose for using a mixed methods design. The use of the methodological metaphor of triangulation on convergent, complementary, and divergent results from mixed methods studies is exemplified and an example of developing theory from such data is provided. A trend for conducting parallel data analysis on quantitative and qualitative data in mixed methods healthcare research has been identified in the studies included in this review. Using triangulation as a methodological metaphor can facilitate the integration of qualitative and quantitative findings, help researchers to clarify their theoretical propositions and the basis of their results. This can offer a better understanding of the links between theory and

[Reconsidering evaluation criteria regarding health care research: toward an integrative framework of quantitative and qualitative criteria].

PubMed

Miyata, Hiroaki; Kai, Ichiro

2006-05-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confused and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. It is therefore very important to reconsider evaluation criteria regarding rigor in social science. As Lincoln & Guba have already compared quantitative paradigms (validity, reliability, neutrality, generalizability) with qualitative paradigms (credibility, dependability, confirmability, transferability), we have discuss use of evaluation criteria based on pragmatic perspective. Validity/Credibility is the paradigm concerned to observational framework, while Reliability/Dependability refer to the range of stability in observations, Neutrality/Confirmability reflect influences between observers and subjects, Generalizability/Transferability have epistemological difference in the way findings are applied. Qualitative studies, however, does not always chose the qualitative paradigms. If we assume the stability to some extent, it is better to use the quantitative paradigm (reliability). Moreover as a quantitative study can not always guarantee a perfect observational framework, with stability in all phases of observations, it is useful to use qualitative paradigms to enhance the rigor in the study.

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research.

PubMed

Gentles, Stephen J; Charles, Cathy; Nicholas, David B; Ploeg, Jenny; McKibbon, K Ann

2016-10-11

Overviews of methods are potentially useful means to increase clarity and enhance collective understanding of specific methods topics that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness. This type of review represents a distinct literature synthesis method, although to date, its methodology remains relatively undeveloped despite several aspects that demand unique review procedures. The purpose of this paper is to initiate discussion about what a rigorous systematic approach to reviews of methods, referred to here as systematic methods overviews, might look like by providing tentative suggestions for approaching specific challenges likely to be encountered. The guidance offered here was derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research. The guidance is organized into several principles that highlight specific objectives for this type of review given the common challenges that must be overcome to achieve them. Optional strategies for achieving each principle are also proposed, along with discussion of how they were successfully implemented in the overview on sampling. We describe seven paired principles and strategies that address the following aspects: delimiting the initial set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology used to describe specific methods topics, and generating rigorous verifiable analytic interpretations. Since a broad aim in systematic methods overviews is to describe and interpret the relevant literature in qualitative terms, we suggest that iterative decision making at various stages of the review process, and a rigorous qualitative approach to analysis are necessary features of this review type

The qualitative research proposal.

PubMed

Klopper, H

2008-12-01

Qualitative research in the health sciences has had to overcome many prejudices and a number of misunderstandings, but today qualitative research is as acceptable as quantitative research designs and is widely funded and published. Writing the proposal of a qualitative study, however, can be a challenging feat, due to the emergent nature of the qualitative research design and the description of the methodology as a process. Even today, many sub-standard proposals at post-graduate evaluation committees and application proposals to be considered for funding are still seen. This problem has led the researcher to develop a framework to guide the qualitative researcher in writing the proposal of a qualitative study based on the following research questions: (i) What is the process of writing a qualitative research proposal? and (ii) What does the structure and layout of a qualitative proposal look like? The purpose of this article is to discuss the process of writing the qualitative research proposal, as well as describe the structure and layout of a qualitative research proposal. The process of writing a qualitative research proposal is discussed with regards to the most important questions that need to be answered in your research proposal with consideration of the guidelines of being practical, being persuasive, making broader links, aiming for crystal clarity and planning before you write. While the structure of the qualitative research proposal is discussed with regards to the key sections of the proposal, namely the cover page, abstract, introduction, review of the literature, research problem and research questions, research purpose and objectives, research paradigm, research design, research method, ethical considerations, dissemination plan, budget and appendices.

Using Computational Text Classification for Qualitative Research and Evaluation in Extension

ERIC Educational Resources Information Center

Smith, Justin G.; Tissing, Reid

2018-01-01

This article introduces a process for computational text classification that can be used in a variety of qualitative research and evaluation settings. The process leverages supervised machine learning based on an implementation of a multinomial Bayesian classifier. Applied to a community of inquiry framework, the algorithm was used to identify…

Recommendations for a mixed methods approach to evaluating the patient-centered medical home.

PubMed

Goldman, Roberta E; Parker, Donna R; Brown, Joanna; Walker, Judith; Eaton, Charles B; Borkan, Jeffrey M

2015-03-01

There is a strong push in the United States to evaluate whether the patient-centered medical home (PCMH) model produces desired results. The explanatory and contextually based questions of how and why PCMH succeeds in different practice settings are often neglected. We report the development of a comprehensive, mixed qualitative-quantitative evaluation set for researchers, policy makers, and clinician groups. To develop an evaluation set, the Brown Primary Care Transformation Initiative convened a multidisciplinary group of PCMH experts, reviewed the PCMH literature and evaluation strategies, developed key domains for evaluation, and selected or created methods and measures for inclusion. The measures and methods in the evaluation set (survey instruments, PCMH meta-measures, patient outcomes, quality measures, qualitative interviews, participant observation, and process evaluation) are meant to be used together. PCMH evaluation must be sufficiently comprehensive to assess and explain both the context of transformation in different primary care practices and the experiences of diverse stakeholders. In addition to commonly assessed patient outcomes, quality, and cost, it is critical to include PCMH components integral to practice culture transformation: patient and family centeredness, authentic patient activation, mutual trust among practice employees and patients, and transparency, joy, and collaboration in delivering and receiving care in a changing environment. This evaluation set offers a comprehensive methodology to enable understanding of how PCMH transformation occurs in different practice settings. This approach can foster insights about how transformation affects critical outcomes to achieve meaningful, patient-centered, high-quality, and cost-effective sustainable change among diverse primary care practices. © 2015 Annals of Family Medicine, Inc.

The Contribution of Qualitative Methods for Identifying the Educational Needs of Adults

ERIC Educational Resources Information Center

Boz, Hayat; Dagli, Yakup

2017-01-01

This study addresses the contribution of applying qualitative research methods for identifying the educational activities planned for adults. The paper is based on the experience gained during in-depth interviews with 39 elderly and 33 middle-aged participants, by purposive sampling method and maximum variation technique, within a needs analysis…

Troubling objectivity: the promises and pitfalls of training Haitian clinicians in qualitative research methods.H.

PubMed

Minn, Pierre

2015-01-01

Building research capacity is a central component of many contemporary global health programs and partnerships. While medical anthropologists have been conducting qualitative research in resource-poor settings for decades, they are increasingly called on to train "local" clinicians, researchers, and students in qualitative research methods. In this article, I describe the process of teaching introductory courses in qualitative research methods to Haitian clinicians, hospital staff, and medical students, who rarely encounter qualitative research in their training or practice. These trainings allow participants to identify and begin to address challenges related to health services delivery, quality of care, and provider-patient relations. However, they also run the risk of perpetuating colonial legacies of objectification and reinforcing hierarchies of knowledge and knowledge production. As these trainings increase in number and scope, they offer the opportunity to reflect critically on new forms of transnational interventions that aim to reduce health disparities.

Integrating qualitative research into evidence based practice.

PubMed

Greenhalgh, Trisha

2002-09-01

This article attempts to provide an overview of qualitative tools and methods using mainly examples from diabetes research. The other articles in this issue of the Endocrinology and Metabolism Clinics of North America have demonstrated the enormous contribution made in the past 15 years or so by rigorous quantitative studies of prevalence, diagnosis, prognosis, and therapy to clinical decision-making in endocrinology. In the early 21st century, the state of qualitative research into such topics as the illness experience of diabetes; the barriers to effective self care and positive health choices; the design of complex educational interventions; the design of appropriate, acceptable and responsive health services; and the decision-making behavior of health professionals, is such that there remain many more questions than answers. But qualitative research is increasingly recognized as an important, legitimate and expanding dimension of evidence-based health care (18;19). It is highly likely that the major landmark studies in diabetes care over the next decade will build on an exploratory qualitative study or incorporate an explanatory or evaluative dimension based on qualitative methods.

Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ

PubMed Central

2012-01-01

Background The syntheses of multiple qualitative studies can pull together data across different contexts, generate new theoretical or conceptual models, identify research gaps, and provide evidence for the development, implementation and evaluation of health interventions. This study aims to develop a framework for reporting the synthesis of qualitative health research. Methods We conducted a comprehensive search for guidance and reviews relevant to the synthesis of qualitative research, methodology papers, and published syntheses of qualitative health research in MEDLINE, Embase, CINAHL and relevant organisational websites to May 2011. Initial items were generated inductively from guides to synthesizing qualitative health research. The preliminary checklist was piloted against forty published syntheses of qualitative research, purposively selected to capture a range of year of publication, methods and methodologies, and health topics. We removed items that were duplicated, impractical to assess, and rephrased items for clarity. Results The Enhancing transparency in reporting the synthesis of qualitative research (ENTREQ) statement consists of 21 items grouped into five main domains: introduction, methods and methodology, literature search and selection, appraisal, and synthesis of findings. Conclusions The ENTREQ statement can help researchers to report the stages most commonly associated with the synthesis of qualitative health research: searching and selecting qualitative research, quality appraisal, and methods for synthesising qualitative findings. The synthesis of qualitative research is an expanding and evolving methodological area and we would value feedback from all stakeholders for the continued development and extension of the ENTREQ statement. PMID:23185978

Methodological challenges in cross-language qualitative research: a research review.

PubMed

Squires, Allison

2009-02-01

Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this analysis of cross-language qualitative research was threefold: (1) review the methods literature addressing cross-language research; (2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; (3) test these criteria on published cross-language qualitative studies. A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant's language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other

A Proposed Model of Retransformed Qualitative Data within a Mixed Methods Research Design

ERIC Educational Resources Information Center

Palladino, John M.

2009-01-01

Most models of mixed methods research design provide equal emphasis of qualitative and quantitative data analyses and interpretation. Other models stress one method more than the other. The present article is a discourse about the investigator's decision to employ a mixed method design to examine special education teachers' advocacy and…

Methodological Challenges in Cross-Language Qualitative Research: A Research Review

PubMed Central

Squires, Allison

2009-01-01

Objectives Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this critical review of cross-language qualitative research was three fold: 1) review the methods literature addressing cross language research; 2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; and 3) test these criteria on published cross-language qualitative studies. Data sources A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. Review methods The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. Results The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant’s language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. Conclusions The finding about researchers making the role of the translator or interpreter

Qualitative research in rehabilitation science: opportunities, challenges, and future directions.

PubMed

VanderKaay, Sandra; Moll, Sandra E; Gewurtz, Rebecca E; Jindal, Pranay; Loyola-Sanchez, Adalberto; Packham, Tara L; Lim, Chun Y

2018-03-01

Qualitative research has had a significant impact within rehabilitation science over time. During the past 20 years the number of qualitative studies published per year in Disability and Rehabilitation has markedly increased (from 1 to 54). In addition, during this period there have been significant changes in how qualitative research is conceptualized, conducted, and utilized to advance the field of rehabilitation. The purpose of this article is to reflect upon the progress of qualitative research within rehabilitation to date, to explicate current opportunities and challenges, and to suggest future directions to continue to strengthen the contribution of qualitative research in this field. Relevant literature searches were conducted in electronic data bases and reference lists. Pertinent literature was examined to identify current opportunities and challenges for qualitative research use in rehabilitation and to identify future directions. Six key areas of opportunity and challenge were identified: (a) paradigm shifts, (b) advancements in methodology, (c) emerging technology, (d) advances in quality evaluation, (e) increasing popularity of mixed methods approaches, and (f) evolving approaches to knowledge translation. Two important future directions for rehabilitation are posited: (1) advanced training in qualitative methods and (2) engaging qualitative communities of research. Qualitative research is well established in rehabilitation and has an important place in the continued growth of this field. Ongoing development of qualitative researchers and methods are essential. Implications for Rehabilitation Qualitative research has the potential to improve rehabilitation practice by addressing some of the most pervasive concerns in the field such as practitioner-client interaction, the subjective and lived experience of disability, and clinical reasoning and decision making. This will serve to better inform those providing rehabilitation services thereby benefiting

Rapid qualitative research methods during complex health emergencies: A systematic review of the literature.

PubMed

Johnson, Ginger A; Vindrola-Padros, Cecilia

2017-09-01

The 2013-2016 Ebola outbreak in West Africa highlighted both the successes and limitations of social science contributions to emergency response operations. An important limitation was the rapid and effective communication of study findings. A systematic review was carried out to explore how rapid qualitative methods have been used during global heath emergencies to understand which methods are commonly used, how they are applied, and the difficulties faced by social science researchers in the field. We also asses their value and benefit for health emergencies. The review findings are used to propose recommendations for qualitative research in this context. Peer-reviewed articles and grey literature were identified through six online databases. An initial search was carried out in July 2016 and updated in February 2017. The PRISMA checklist was used to guide the reporting of methods and findings. The articles were assessed for quality using the MMAT and AACODS checklist. From an initial search yielding 1444 articles, 22 articles met the criteria for inclusion. Thirteen of the articles were qualitative studies and nine used a mixed-methods design. The purpose of the rapid studies included: the identification of causes of the outbreak, and assessment of infrastructure, control strategies, health needs and health facility use. The studies varied in duration (from 4 days to 1 month). The main limitations identified by the authors were: the low quality of the collected data, small sample sizes, and little time for cross-checking facts with other data sources to reduce bias. Rapid qualitative methods were seen as beneficial in highlighting context-specific issues that need to be addressed locally, population-level behaviors influencing health service use, and organizational challenges in response planning and implementation. Recommendations for carrying out rapid qualitative research in this context included the early designation of community leaders as a point of

A Hospice Rotation for Military Medical Residents: A Mixed Methods, Multi-Perspective Program Evaluation

PubMed Central

Boyden, Jackelyn Y.; Kalish, Virginia B.; Muir, J. Cameron; Richardson, Suzanne; Connor, Stephen R.

2016-01-01

Abstract Background: An estimated 6,000 to 18,000 additional hospice and palliative medicine (HPM) physicians are needed in the United States. A source could be the military graduate medical education system where 15% of U.S. medical residents are trained. A community-based hospice and palliative care organization created a one-week rotation for military residents including participation in interdisciplinary group visits at patients' homes, facilities, and an inpatient hospice unit. Objective: Our goal was to evaluate the effectiveness of a one-week community HPM rotation for military medical residents. Methods: A mixed-methods, multi-stakeholder perspective program evaluation model was used for program years 2011 to 2013. Data were managed and analyzed using Microsoft Excel and Atlas.ti. Participants in the rotation were residents training at two local military hospitals. Program evaluation data were collected from residents, military program liaisons, and hospice clinical preceptors. Quantitative data included pre- and post-tests based on Accreditation Council for Graduate Medical Education competencies completed by residents. Qualitative data included resident essays and semi-structured interviews with hospice preceptors and military program liaisons. Results: Quantitative and qualitative data suggested that the rotation increased military residents' knowledge, attitudes, and comfort level with HPM. Quantitative analysis of test scores indicated improvements from pre- to post-tests in each of five areas of learning. Qualitative data indicated the rotation created a greater appreciation for the overall importance of HPM and increased understanding of eligibility and methods for pain and symptom management. Conclusions: A one-week community hospice rotation for medical military residents impacts participant's knowledge of and attitudes toward HPM. PMID:27139524

Co-interviewing across gender and culture: expanding qualitative research methods in Melanesia.

PubMed

Redman-MacLaren, Michelle L; Api, Unia K; Darius, Matupit; Tommbe, Rachael; Mafile'o, Tracie A; MacLaren, David J

2014-09-06

The social and cultural positions of both researchers and research participants influence qualitative methods and study findings. In Papua New Guinea (PNG), as in other contexts, gender is a key organising characteristic and needs to be central to the design and conduct of research. The colonial history between researcher and participant is also critical to understanding potential power differences. This is particularly relevant to public health research, much of which has emerged from a positivist paradigm. This paper describes our critical reflection of flexible researcher responses enacted during qualitative research in PNG. Led by a senior male HIV researcher from PNG, a male from a PNG university and a female from an Australian university conducted qualitative interviews about faith-based responses to HIV in PNG. The two researchers planned to conduct one-on-one interviews matching gender of participants and interviewer. However, while conducting the study, four participants explicitly requested to be interviewed by both researchers. This experience led us to critically consider socially and culturally situated ways of understanding semi-structured interviewing for public health research in Melanesia. New understandings about public health research include: (i) a challenge to the convention that the researcher holds more power than the research participant, (ii) the importance of audience in Melanesia, (iii) cultural safety can be provided when two people co-interview and (iv) the effect an esteemed leader heading the research may have on people's willingness to participate. Researchers who occupy insider-outsider roles in PNG may provide participants new possibilities to communicate key ideas. Our recent experience has taught us public health research methods that are gender sensitive and culturally situated are pivotal to successful research in Melanesia. Qualitative research requires adaptability and reflexivity. Public health research methods must continue

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Integrating the Complete Research Project into a Large Qualitative Methods Course

ERIC Educational Resources Information Center

Raddon, Mary-Beth; Nault, Caleb; Scott, Alexis

2008-01-01

Participatory exercises are standard practice in qualitative methods courses; less common are projects that engage students in the entire research process, from research design to write-up. Although the teaching literature provides several models of complete research projects, their feasibility, and appropriateness for large, compulsory,…

Research design: qualitative, quantitative and mixed methods approaches Research design: qualitative, quantitative and mixed methods approaches Creswell John W Sage 320 £29 0761924426 0761924426 [Formula: see text].

PubMed

2004-09-01

The second edition of Creswell's book has been significantly revised and updated. The author clearly sets out three approaches to research: quantitative, qualitative and mixed methods. As someone who has used mixed methods in my research, it is refreshing to read a textbook that addresses this. The differences between the approaches are clearly identified and a rationale for using each methodological stance provided.

Moving beyond qualitative evaluations of Bayesian models of cognition.

PubMed

Hemmer, Pernille; Tauber, Sean; Steyvers, Mark

2015-06-01

Bayesian models of cognition provide a powerful way to understand the behavior and goals of individuals from a computational point of view. Much of the focus in the Bayesian cognitive modeling approach has been on qualitative model evaluations, where predictions from the models are compared to data that is often averaged over individuals. In many cognitive tasks, however, there are pervasive individual differences. We introduce an approach to directly infer individual differences related to subjective mental representations within the framework of Bayesian models of cognition. In this approach, Bayesian data analysis methods are used to estimate cognitive parameters and motivate the inference process within a Bayesian cognitive model. We illustrate this integrative Bayesian approach on a model of memory. We apply the model to behavioral data from a memory experiment involving the recall of heights of people. A cross-validation analysis shows that the Bayesian memory model with inferred subjective priors predicts withheld data better than a Bayesian model where the priors are based on environmental statistics. In addition, the model with inferred priors at the individual subject level led to the best overall generalization performance, suggesting that individual differences are important to consider in Bayesian models of cognition.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed

Devers, K J

1999-12-01

To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. Existing literature in the social sciences and health services research, particularly in primary care and medicine. Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results.

Originality Detection Software in a Graduate Policy Course: A Mixed-Methods Evaluation of Plagiarism

ERIC Educational Resources Information Center

Dreuth Zeman, Laura; Steen, Julie A.; Metz Zeman, Natalie

2011-01-01

The authors used a mixed-methods approach to evaluate the use of Turnitin originality detection software in a graduate social work course. Qualitative analysis of student responses revealed positive and negative spent completing assignments, and the tone of the class. Quantitative analysis of students' originality scores indicated a short-term…

Evaluating the Usability and Usefulness of a Mobile App for Atrial Fibrillation Using Qualitative Methods: Exploratory Pilot Study

PubMed Central

Mansour, Moussa; Sperber, Jodi; Agboola, Stephen; Kvedar, Joseph; Jethwani, Kamal

2018-01-01

the design and targeting of the intervention. Pilot studies that qualitatively examine patient perceptions of usability and usefulness are a valuable and often underutilized method for assessing the real-world acceptability of an intervention. Additional research evaluating the AFib Connect mobile app over a longer period, and including a larger, more diverse sample of AFib patients, will be helpful for understanding whether the app is perceived more broadly to be useful and effective in supporting patient self-care and medication adherence. PMID:29549073

Inter-observer agreement improves with PERCIST 1.0 as opposed to qualitative evaluation in non-small cell lung cancer patients evaluated with F-18-FDG PET/CT early in the course of chemo-radiotherapy.

PubMed

Fledelius, Joan; Khalil, Azza; Hjorthaug, Karin; Frøkiær, Jørgen

2016-12-01

The purpose of this study is to determine whether a qualitative approach or a semi-quantitative approach provides the most robust method for early response evaluation with 2'-deoxy-2'-[(18)F]fluoro-D-glucose (F-18-FDG) positron emission tomography combined with whole body computed tomography (PET/CT) in non-small cell lung cancer (NSCLC). In this study eight Nuclear Medicine consultants analyzed F-18-FDG PET/CT scans from 35 patients with locally advanced NSCLC. Scans were performed at baseline and after 2 cycles of chemotherapy. Each observer used two different methods for evaluation: (1) PET response criteria in solid tumors (PERCIST) 1.0 and (2) a qualitative approach. Both methods allocate patients into one of four response categories (complete and partial metabolic response (CMR and PMR) and stable and progressive metabolic disease (SMD and PMD)). The inter-observer agreement was evaluated using Fleiss' kappa for multiple raters, Cohens kappa for comparison of the two methods, and intraclass correlation coefficients (ICC) for comparison of lean body mass corrected standardized uptake value (SUL) peak measurements. The agreement between observers when determining the percentage change in SULpeak was "almost perfect", with ICC = 0.959. There was a strong agreement among observers allocating patients to the different response categories with a Fleiss kappa of 0.76 (0.71-0.81). In 22 of the 35 patients, complete agreement was observed with PERCIST 1.0. The agreement was lower when using the qualitative method, moderate, having a Fleiss kappa of 0.60 (0.55-0.64). Complete agreement was achieved in only 10 of the 35 patients. The difference between the two methods was statistically significant (p < 0.005) (chi-squared). Comparing the two methods for each individual observer showed Cohen's kappa values ranging from 0.64 to 0.79, translating into a strong agreement between the two methods. PERCIST 1.0 provides a higher overall agreement between observers

Qualitative study about the ways teachers react to feedback from resident evaluations

PubMed Central

2013-01-01

Background Currently, one of the main interventions that are widely expected to contribute to teachers’ professional development is confronting teachers with feedback from resident evaluations of their teaching performance. Receiving feedback, however, is a double edged sword. Teachers see themselves confronted with information about themselves and are, at the same time, expected to be role models in the way they respond to feedback. Knowledge about the teachers’ responses could be not only of benefit for their professional development, but also for supporting their role modeling. Therefore, research about professional development should include the way teachers respond to feedback. Method We designed a qualitative study with semi-structured individual conversations about feedback reports, gained from resident evaluations. Two researchers carried out a systematic analysis using qualitative research software. The analysis focused on what happened in the conversations and structured the data in three main themes: conversation process, acceptance and coping strategies. Results The result section describes the conversation patterns and atmosphere. Teachers accepted their results calmly, stating that, although they recognised some points of interest, they could not meet with every standard. Most used coping strategies were explaining the results from their personal beliefs about good teaching and attributing poor results to external factors and good results to themselves. However, some teachers admitted that they had poor results because of the fact that they were not “sharp enough” in their resident group, implying that they did not do their best. Conclusions Our study not only confirms that the effects of feedback depend first and foremost on the recipient but also enlightens the meaning and role of acceptance and being a role model. We think that the results justify the conclusion that teachers who are responsible for the day release programmes in the three

Developing medical educators – a mixed method evaluation of a teaching education program

PubMed Central

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) ‘Reaction’ on a professional and emotional level using standardized questionnaires; 2) ‘Learning’ applying a multiple choice test; 3) ‘Behavior’ by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) ‘Results’ from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (P<0.001) as deduced from a pre-post multiple-choice questionnaire, which was retained at 6 months (P<0.001). 3) Behavior: Peer-, self-, and expert-assessment indicated a transfer of learning into teaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students’ evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings. PMID:24679671

How to conduct a qualitative meta-analysis: Tailoring methods to enhance methodological integrity.

PubMed

Levitt, Heidi M

2018-05-01

Although qualitative research has long been of interest in the field of psychology, meta-analyses of qualitative literatures (sometimes called meta-syntheses) are still quite rare. Like quantitative meta-analyses, these methods function to aggregate findings and identify patterns across primary studies, but their aims, procedures, and methodological considerations may vary. This paper explains the function of qualitative meta-analyses and their methodological development. Recommendations have broad relevance but are framed with an eye toward their use in psychotherapy research. Rather than arguing for the adoption of any single meta-method, this paper advocates for considering how procedures can best be selected and adapted to enhance a meta-study's methodological integrity. Through the paper, recommendations are provided to help researchers identify procedures that can best serve their studies' specific goals. Meta-analysts are encouraged to consider the methodological integrity of their studies in relation to central research processes, including identifying a set of primary research studies, transforming primary findings into initial units of data for a meta-analysis, developing categories or themes, and communicating findings. The paper provides guidance for researchers who desire to tailor meta-analytic methods to meet their particular goals while enhancing the rigor of their research.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Compatibility of Qualitative and Quantitative Methods: Studying Child Sexual Abuse in America.

ERIC Educational Resources Information Center

Phelan, Patricia

1987-01-01

Illustrates how the combined use of qualitative and quantitative methods were necessary in obtaining a clearer understanding of the process of incest in American society. Argues that the exclusive use of one methodology would have obscured important information. (FMW)

A quantitative evaluation of a qualitative risk assessment framework: Examining the assumptions and predictions of the Productivity Susceptibility Analysis (PSA)

PubMed Central

2018-01-01

Qualitative risk assessment frameworks, such as the Productivity Susceptibility Analysis (PSA), have been developed to rapidly evaluate the risks of fishing to marine populations and prioritize management and research among species. Despite being applied to over 1,000 fish populations, and an ongoing debate about the most appropriate method to convert biological and fishery characteristics into an overall measure of risk, the assumptions and predictive capacity of these approaches have not been evaluated. Several interpretations of the PSA were mapped to a conventional age-structured fisheries dynamics model to evaluate the performance of the approach under a range of assumptions regarding exploitation rates and measures of biological risk. The results demonstrate that the underlying assumptions of these qualitative risk-based approaches are inappropriate, and the expected performance is poor for a wide range of conditions. The information required to score a fishery using a PSA-type approach is comparable to that required to populate an operating model and evaluating the population dynamics within a simulation framework. In addition to providing a more credible characterization of complex system dynamics, the operating model approach is transparent, reproducible and can evaluate alternative management strategies over a range of plausible hypotheses for the system. PMID:29856869

Evaluating Research Administration: Methods and Utility

ERIC Educational Resources Information Center

Marina, Sarah; Davis-Hamilton, Zoya; Charmanski, Kara E.

2015-01-01

Three studies were jointly conducted by the Office of Research Administration and Office of Proposal Development at Tufts University to evaluate the services within each respective office. The studies featured assessments that used, respectively, (1) quantitative metrics; (2) a quantitative satisfaction survey with limited qualitative questions;…

Utility of qualitative methods in a clinical setting: perinatal care in the Western Province.

PubMed

Jayasuriya, V

2012-03-01

A peculiar paradox that has been observed in previous studies of antenatal care is where patients are satisfied with the services despite obvious lack of basic facilities. Qualitative methods were used to describe the experience of perinatal care in the Western province with the objective of demonstrating application of this method in a clinical setting. This paper used a 'naturalistic' approach of qualitative methods. In-depth interviews conducted with 20 postnatal mothers delivering in tertiary care institutions in the Western province was tape recorded, transcribed and content analysed. To ensure objectivity and validity of results, the principle investigator received only the anonymised data to prevent any prejudices or pre-conceptions affecting the results. The main themes emerging from the text demonstrated 'naïve trust' in the carer and a state of 'hero worship' where patients were distanced and therefore unable and unwilling to query the decisions made by the carers. This is similar to a state of patient-carer relationship described in a published model known as guarded alliance, where the relationship develops though four phases based on the level of trust and confidence in the relationship. This state explains not only why patients fail to recognise and report any deficiencies in the services but also the need for them to justify the behaviour of caregivers even when it amounts to incompetence and negligence. Qualitative methods allow the researcher to capture experiences in its 'natural' form rather than based on pre-determined protocols or plans, which may be limited to our own understanding and expectations and therefore unable to explain many idiosyncrasies of the programmes. This paper argues favourably for the use of qualitative methods in other clinical settings.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed Central

Devers, K J

1999-01-01

OBJECTIVE: To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. DATA SOURCES: Existing literature in the social sciences and health services research, particularly in primary care and medicine. PRINCIPAL FINDING: Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. CONCLUSION: The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results. Images Figure 1 PMID:10591278

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation

PubMed Central

Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-01-01

Background This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. Objective The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of “How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?” Methods The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. Results The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1

Applying Qualitative Methods in Organizations: A Note for Industrial/Organizational Psychologists

ERIC Educational Resources Information Center

Ehigie, Benjamin Osayawe; Ehigie, Rebecca Ibhaguelo

2005-01-01

Early approach to research in industrial and organizational (I/O) psychology was oriented towards quantitative techniques as a result of influences from the social sciences. As the focus of I/O psychology expands from psychological test development to other personnel functions, there has been an inclusion of qualitative methods in I/O psychology…

Using Qualitative Methods with Poor Children in Urban Ethiopia: Opportunities & Challenges

ERIC Educational Resources Information Center

Tekola, Bethlehem; Griffin, Christine; Camfield, Laura

2009-01-01

This paper discusses the advantages and challenges of using qualitative methods to elicit poor children's perspectives about threats and positive influences on their wellbeing. It draws on research carried out by the author on the subjective experiences of poor children in Addis Ababa, the capital of Ethiopia in terms of their understandings of…

Maximising the value of combining qualitative research and randomised controlled trials in health research: the QUAlitative Research in Trials (QUART) study--a mixed methods study.

PubMed

O'Cathain, Alicia; Thomas, Kate J; Drabble, Sarah J; Rudolph, Anne; Goode, Jackie; Hewison, Jenny

2014-06-01

Researchers sometimes undertake qualitative research with randomised controlled trials (RCTs) of health interventions. To systematically explore how qualitative research is being used with trials and identify ways of maximising its value to the trial aim of providing evidence of effectiveness of health interventions. A sequential mixed methods study with four components. (1) Database search of peer-reviewed journals between January 2008 and September 2010 for articles reporting the qualitative research undertaken with specific trials, (2) systematic search of database of registered trials to identify studies combining qualitative research and trials, (3) survey of 200 lead investigators of trials with no apparent qualitative research and (4) semistructured telephone interviews with 18 researchers purposively sampled from the first three methods. Qualitative research was undertaken with at least 12% of trials. A large number of articles reporting qualitative research undertaken with trials (n=296) were published between 2008 and 2010. A total of 28% (82/296) of articles reported qualitative research undertaken at the pre-trial stage and around one-quarter concerned drugs or devices. The articles focused on 22 aspects of the trial within five broad categories. Some focused on more than one aspect of the trial, totalling 356 examples. The qualitative research focused on the intervention being trialled (71%, 254/356), the design and conduct of the trial (15%, 54/356), the outcomes of the trial (1%, 5/356), the measures used in the trial (3%, 10/356), and the health condition in the trial (9%, 33/356). The potential value of the qualitative research to the trial endeavour included improving the external validity of trials and facilitating interpretation of trial findings. This value could be maximised by using qualitative research more at the pre-trial stage and reporting findings with explicit attention to the implications for the trial endeavour. During interviews

Towards a Critical Health Equity Research Stance: Why Epistemology and Methodology Matter More Than Qualitative Methods.

PubMed

Bowleg, Lisa

2017-10-01

Qualitative methods are not intrinsically progressive. Methods are simply tools to conduct research. Epistemology, the justification of knowledge, shapes methodology and methods, and thus is a vital starting point for a critical health equity research stance, regardless of whether the methods are qualitative, quantitative, or mixed. In line with this premise, I address four themes in this commentary. First, I criticize the ubiquitous and uncritical use of the term health disparities in U.S. public health. Next, I advocate for the increased use of qualitative methodologies-namely, photovoice and critical ethnography-that, pursuant to critical approaches, prioritize dismantling social-structural inequities as a prerequisite to health equity. Thereafter, I discuss epistemological stance and its influence on all aspects of the research process. Finally, I highlight my critical discourse analysis HIV prevention research based on individual interviews and focus groups with Black men, as an example of a critical health equity research approach.

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Qualitative Comparative Analysis: A Hybrid Method for Identifying Factors Associated with Program Effectiveness.

PubMed

Cragun, Deborah; Pal, Tuya; Vadaparampil, Susan T; Baldwin, Julie; Hampel, Heather; DeBate, Rita D

2016-07-01

Qualitative comparative analysis (QCA) was developed over 25 years ago to bridge the qualitative and quantitative research gap. Upon searching PubMed and the Journal of Mixed Methods Research , this review identified 30 original research studies that utilized QCA. Perceptions that QCA is complex and provides few relative advantages over other methods may be limiting QCA adoption. Thus, to overcome these perceptions, this article demonstrates how to perform QCA using data from fifteen institutions that implemented universal tumor screening (UTS) programs to identify patients at high risk for hereditary colorectal cancer. In this example, QCA revealed a combination of conditions unique to effective UTS programs. Results informed additional research and provided a model for improving patient follow-through after a positive screen.

Qualitative Comparative Analysis: A Hybrid Method for Identifying Factors Associated with Program Effectiveness

PubMed Central

Cragun, Deborah; Pal, Tuya; Vadaparampil, Susan T.; Baldwin, Julie; Hampel, Heather; DeBate, Rita D.

2015-01-01

Qualitative comparative analysis (QCA) was developed over 25 years ago to bridge the qualitative and quantitative research gap. Upon searching PubMed and the Journal of Mixed Methods Research, this review identified 30 original research studies that utilized QCA. Perceptions that QCA is complex and provides few relative advantages over other methods may be limiting QCA adoption. Thus, to overcome these perceptions, this article demonstrates how to perform QCA using data from fifteen institutions that implemented universal tumor screening (UTS) programs to identify patients at high risk for hereditary colorectal cancer. In this example, QCA revealed a combination of conditions unique to effective UTS programs. Results informed additional research and provided a model for improving patient follow-through after a positive screen. PMID:27429602

Qualitative methods to ensure acceptability of behavioral and social interventions to the target population

PubMed Central

Ayala, Guadalupe X.; Elder, John P.

2013-01-01

This paper introduces qualitative methods for assessing the acceptability of an intervention. Acceptability refers to determining how well an intervention will be received by the target population and the extent to which the new intervention or its components might meet the needs of the target population and organizational setting. In this paper, we focus on two common qualitative methods for conducting acceptability research and their advantages and disadvantages: focus groups and interviews. We provide examples from our own research and other studies to demonstrate the use of these methods for conducting acceptability research and how one might adapt this approach for oral health research. Finally, we present emerging methods for conducting acceptability research, including the use of community-based participatory research, as well as the utility of conducting acceptability research for assessing the appropriateness of measures in intervention research. PMID:21656958

Innovative Methods for Collecting and Analyzing Qualitative Data: Vignettes and Pre-Structured Cases.

ERIC Educational Resources Information Center

Miles, Matthew B.

Two innovative methods for collecting and analyzing qualitative data are vignettes and pre-structured cases. Vignettes are descriptions of situations or problems written by a professional, with a suggested outline and comments provided by a researcher. Advantages of this method are strength of impact of the written descriptions and efficiency of…

A Call for Qualitative Methods in Action: Enlisting Positionality as an Equity Tool

ERIC Educational Resources Information Center

Relles, Stefani R.

2016-01-01

This article describes how the qualitative research tradition known as "positionality" can be used as a method to support classroom equity. The text describes three ways teachers can use a spoken approach to positionality in their day-to-day practice. Classroom vignettes illuminate how these spoken methods of positionality can address…

Qualitative computer aided evaluation of dental impressions in vivo.

PubMed

Luthardt, Ralph G; Koch, Rainer; Rudolph, Heike; Walter, Michael H

2006-01-01

Clinical investigations dealing with the precision of different impression techniques are rare. Objective of the present study was to develop and evaluate a procedure for the qualitative analysis of the three-dimensional impression precision based on an established in-vitro procedure. The zero hypothesis to be tested was that the precision of impressions does not differ depending on the impression technique used (single-step, monophase and two-step-techniques) and on clinical variables. Digital surface data of patient's teeth prepared for crowns were gathered from standardized manufactured master casts after impressions with three different techniques were taken in a randomized order. Data-sets were analyzed for each patient in comparison with the one-step impression chosen as the reference. The qualitative analysis was limited to data-points within the 99.5%-range. Based on the color-coded representation areas with maximum deviations were determined (preparation margin and the mantle and occlusal surface). To qualitatively analyze the precision of the impression techniques, the hypothesis was tested in linear models for repeated measures factors (p < 0.05). For the positive 99.5% deviations no variables with significant influence were determined in the statistical analysis. In contrast, the impression technique and the position of the preparation margin significantly influenced the negative 99.5% deviations. The influence of clinical parameter on the deviations between impression techniques can be determined reliably using the 99.5 percentile of the deviations. An analysis regarding the areas with maximum deviations showed high clinical relevance. The preparation margin was pointed out as the weak spot of impression taking.

Non cardiopatic and cardiopatic beta thalassemic patients: quantitative and qualitative cardiac iron deposition evaluation with MRI.

PubMed

Macarini, L; Marini, S; Pietrapertosa, A; Scardapane, A; Ettorre, G C

2005-01-01

Cardiomyopathy is one of the major complications of b thalassaemia major as a result of transfusional iron overload. The aim of our study is to evaluate with MR if there is any difference of iron deposition signal intensity (SI) or distribution between non-cardiopathic and cardiopathic thalassaemic patients in order to establish if there is a relationship between cardiopathy and iron deposition. We studied 20 patients affected by b thalassaemia major, of whom 10 cardiopathic and 10 non-cardiopathic, and 10 healthy volunteers as control group. Serum ferritin and left ventricular ejection fraction were calculated in thalassaemic patients. All patients were examined using a 1.5 MR unit with ECG-gated GE cine-MR T2*-weighted, SE T1-weighted and GE T2*-weighted sequences. In all cases, using an adequate ROI, the myocardial and skeletal muscle signal intensity (SI), the myocardial/skeletal muscle signal intensity ratio (SIR) and the SI average of the myocardium and skeletal muscle were calculated for every study group. The qualitative evaluation of iron deposition distribution was independently performed by three radiologists who analyzed the extension, the site and the morphology of iron deposition on the MR images and reported their observations on the basis of a four-level rating scale: 0 (absent), 1 (limited), 2 (partial), 3 (widespread deposition). The result of quantitative and qualitative evaluations were analysed with statistical tests. Cardiac iron deposition was found in 8/10 non-cardiopathic thalassaemic patients and in all cardiopathic thalassaemic patients. We noticed a significant SI difference (p>0.05) between the healthy volunteer control group and the thalassaemic patients with iron deposition, but no significant SI difference in iron deposition between non-cardiopathic and cardiopathic thalassaemic patients in the areas evaluated. The qualitative evaluation revealed a different distribution of iron deposition between the two thalassaemic groups, with

Qualitative research: a review of methods with use of examples from the total knee replacement literature.

PubMed

Beaton, Dorcas E; Clark, Jocalyn P

2009-05-01

Qualitative research is a useful approach to explore perplexing or complicated clinical situations. Since 1996, at least fifteen qualitative studies in the area of total knee replacement alone were found. Qualitative studies overcome the limits of quantitative work because they can explicate deeper meaning and complexity associated with questions such as why patients decline joint replacement surgery, why they do not adhere to pain medication and exercise regimens, how they manage in the postoperative period, and why providers do not always provide evidence-based care. In this paper, we review the role of qualitative methods in orthopaedic research, using knee osteoarthritis as an illustrative example. Qualitative research questions tend to be inductive, and the stance of the investigator is relevant and explicitly acknowledged. Qualitative methodologies include grounded theory, phenomenology, and ethnography and involve gathering opinions and text from individuals or focus groups. The methods are rigorous and take training and time to apply. Analysis of the textual data typically proceeds with the identification, coding, and categorization of patterns in the data for the purpose of generating concepts from within the data. With use of analytic techniques, researchers strive to explain the findings; questions are asked to tease out different levels of meaning, identify new concepts and themes, and permit a deeper interpretation and understanding. Orthopaedic practitioners should consider the use of qualitative research as a tool for exploring the meaning and complexities behind some of the perplexing phenomena that they observe in research findings and clinical practice.

Plethora or paucity: a systematic search and bibliometric study of the application and design of qualitative methods in nursing research 2008-2010.

PubMed

Ball, Elaine; McLoughlin, Moira; Darvill, Angela

2011-04-01

Qualitative methodology has increased in application and acceptability in all research disciplines. In nursing, it is appropriate that a plethora of qualitative methods can be found as nurses pose real-world questions to clinical, cultural and ethical issues of patient care (Johnson, 2007; Long and Johnson, 2007), yet the methods nurses readily use in pursuit of answers remains under intense scrutiny. One of the problems with qualitative methodology for nursing research is its place in the hierarchy of evidence (HOE); another is its comparison to the positivist constructs of what constitutes good research and the measurement of qualitative research against this. In order to position and strengthen its evidence base, nursing may well seek to distance itself from a qualitative perspective and utilise methods at the top of the HOE; yet given the relation of qualitative methods to nursing this would constrain rather than broaden the profession in search of answers and an evidence base. The comparison between qualitative and quantitative can be both mutually exclusive and rhetorical, by shifting the comparison this study takes a more reflexive position and critically appraises qualitative methods against the standards set by qualitative researchers. By comparing the design and application of qualitative methods in nursing over a two year period, the study examined how qualitative stands up to independent rather than comparative scrutiny. For the methods, a four-step mixed methods approach newly constructed by the first author was used to define the scope of the research question and develop inclusion criteria. 2. Synthesis tables were constructed to organise data, 3. Bibliometrics configured data. 4. Studies selected for inclusion in the review were critically appraised using a critical interpretive synthesis (Dixon-Woods et al., 2006). The paper outlines the research process as well as findings. Results showed of the 240 papers analysed, 27% used ad hoc or no

Cochrane Qualitative and Implementation Methods Group guidance series-paper 2: methods for question formulation, searching, and protocol development for qualitative evidence synthesis.

PubMed

Harris, Janet L; Booth, Andrew; Cargo, Margaret; Hannes, Karin; Harden, Angela; Flemming, Kate; Garside, Ruth; Pantoja, Tomas; Thomas, James; Noyes, Jane

2018-05-01

This paper updates previous Cochrane guidance on question formulation, searching, and protocol development, reflecting recent developments in methods for conducting qualitative evidence syntheses to inform Cochrane intervention reviews. Examples are used to illustrate how decisions about boundaries for a review are formed via an iterative process of constructing lines of inquiry and mapping the available information to ascertain whether evidence exists to answer questions related to effectiveness, implementation, feasibility, appropriateness, economic evidence, and equity. The process of question formulation allows reviewers to situate the topic in relation to how it informs and explains effectiveness, using the criterion of meaningfulness, appropriateness, feasibility, and implementation. Questions related to complex questions and interventions can be structured by drawing on an increasingly wide range of question frameworks. Logic models and theoretical frameworks are useful tools for conceptually mapping the literature to illustrate the complexity of the phenomenon of interest. Furthermore, protocol development may require iterative question formulation and searching. Consequently, the final protocol may function as a guide rather than a prescriptive route map, particularly in qualitative reviews that ask more exploratory and open-ended questions. Copyright © 2017 Elsevier Inc. All rights reserved.

Integrating qualitative research methods into care improvement efforts within a learning health system: addressing antibiotic overuse.

PubMed

Munoz-Plaza, Corrine E; Parry, Carla; Hahn, Erin E; Tang, Tania; Nguyen, Huong Q; Gould, Michael K; Kanter, Michael H; Sharp, Adam L

2016-08-15

Despite reports advocating for integration of research into healthcare delivery, scant literature exists describing how this can be accomplished. Examples highlighting application of qualitative research methods embedded into a healthcare system are particularly needed. This article describes the process and value of embedding qualitative research as the second phase of an explanatory, sequential, mixed methods study to improve antibiotic stewardship for acute sinusitis. Purposive sampling of providers for in-depth interviews improved understanding of unwarranted antibiotic prescribing and elicited stakeholder recommendations for improvement. Qualitative data collection, transcription and constant comparative analyses occurred iteratively. Emerging themes and sub-themes identified primary drivers of unwarranted antibiotic prescribing patterns and recommendations for improving practice. These findings informed the design of a health system intervention to improve antibiotic stewardship for acute sinusitis. Core components of the intervention are also described. Qualitative research can be effectively applied in learning healthcare systems to elucidate quantitative results and inform improvement efforts.

A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model

DOE PAGES

Gan, Yanjun; Duan, Qingyun; Gong, Wei; ...

2014-01-01

Sensitivity analysis (SA) is a commonly used approach for identifying important parameters that dominate model behaviors. We use a newly developed software package, a Problem Solving environment for Uncertainty Analysis and Design Exploration (PSUADE), to evaluate the effectiveness and efficiency of ten widely used SA methods, including seven qualitative and three quantitative ones. All SA methods are tested using a variety of sampling techniques to screen out the most sensitive (i.e., important) parameters from the insensitive ones. The Sacramento Soil Moisture Accounting (SAC-SMA) model, which has thirteen tunable parameters, is used for illustration. The South Branch Potomac River basin nearmore » Springfield, West Virginia in the U.S. is chosen as the study area. The key findings from this study are: (1) For qualitative SA methods, Correlation Analysis (CA), Regression Analysis (RA), and Gaussian Process (GP) screening methods are shown to be not effective in this example. Morris One-At-a-Time (MOAT) screening is the most efficient, needing only 280 samples to identify the most important parameters, but it is the least robust method. Multivariate Adaptive Regression Splines (MARS), Delta Test (DT) and Sum-Of-Trees (SOT) screening methods need about 400–600 samples for the same purpose. Monte Carlo (MC), Orthogonal Array (OA) and Orthogonal Array based Latin Hypercube (OALH) are appropriate sampling techniques for them; (2) For quantitative SA methods, at least 2777 samples are needed for Fourier Amplitude Sensitivity Test (FAST) to identity parameter main effect. McKay method needs about 360 samples to evaluate the main effect, more than 1000 samples to assess the two-way interaction effect. OALH and LPτ (LPTAU) sampling techniques are more appropriate for McKay method. For the Sobol' method, the minimum samples needed are 1050 to compute the first-order and total sensitivity indices correctly. These comparisons show that qualitative SA methods are more

Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

Are Female Applicants Disadvantaged in National Institutes of Health Peer Review? Combining Algorithmic Text Mining and Qualitative Methods to Detect Evaluative Differences in R01 Reviewers' Critiques

PubMed Central

Magua, Wairimu; Zhu, Xiaojin; Bhattacharya, Anupama; Filut, Amarette; Potvien, Aaron; Leatherberry, Renee; Lee, You-Geon; Jens, Madeline; Malikireddy, Dastagiri; Carnes, Molly

2017-01-01

Abstract Background: Women are less successful than men in renewing R01 grants from the National Institutes of Health. Continuing to probe text mining as a tool to identify gender bias in peer review, we used algorithmic text mining and qualitative analysis to examine a sample of critiques from men's and women's R01 renewal applications previously analyzed by counting and comparing word categories. Methods: We analyzed 241 critiques from 79 Summary Statements for 51 R01 renewals awarded to 45 investigators (64% male, 89% white, 80% PhD) at the University of Wisconsin-Madison between 2010 and 2014. We used latent Dirichlet allocation to discover evaluative “topics” (i.e., words that co-occur with high probability). We then qualitatively examined the context in which evaluative words occurred for male and female investigators. We also examined sex differences in assigned scores controlling for investigator productivity. Results: Text analysis results showed that male investigators were described as “leaders” and “pioneers” in their “fields,” with “highly innovative” and “highly significant research.” By comparison, female investigators were characterized as having “expertise” and working in “excellent” environments. Applications from men received significantly better priority, approach, and significance scores, which could not be accounted for by differences in productivity. Conclusions: Results confirm our previous analyses suggesting that gender stereotypes operate in R01 grant peer review. Reviewers may more easily view male than female investigators as scientific leaders with significant and innovative research, and score their applications more competitively. Such implicit bias may contribute to sex differences in award rates for R01 renewals. PMID:28281870

[Qualitative evaluation of blood products records in a hospital].

PubMed

Lartigue, B; Catillon, E

2012-02-01

This study aimed at evaluating the qualitative performance of blood products traceability from paper and electronic medical records in a hospital. Quality of date/time documentation was assessed by detection, for 20minutes or more, of chronological errors and inter-source inconsistencies, in a random sample of 168 blood products transfused during 2009. A receipt date/time was confirmed in 52% of paper records; a data entry error was attested in 25% of paper records, and 21% of electronic records. A transfusion date/time was notified in 93% of paper records, with a data entry error in 26% of paper records and 25% of electronic records. The patient medical record held at least one date/time error in 18% and 17%, for receipt and transfusion respectively. Environmental factors (clinical setting, urgency, blood product category) did not contributed to data error rates. Although blood products traceability has good quantitative results, the recorded documentation is not qualitative. In our study, data entry errors are similar in electronic or paper records, but the global failure rate is lesser in electronic records because omissions are controlled. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

Travel into a fairy land: a critique of modern qualitative and mixed methods psychologies.

PubMed

Toomela, Aaro

2011-03-01

In this article modern qualitative and mixed methods approaches are criticized from the standpoint of structural-systemic epistemology. It is suggested that modern qualitative methodologies suffer from several fallacies: some of them are grounded on inherently contradictory epistemology, the others ask scientific questions after the methods have been chosen, conduct studies inductively so that not only answers but even questions are often supposed to be discovered, do not create artificial situations and constraints on study-situations, are adevelopmental by nature, study not the external things and phenomena but symbols and representations--often the object of studies turns out to be the researcher rather than researched, rely on ambiguous data interpretation methods based to a large degree on feelings and opinions, aim to understand unique which is theoretically impossible, or have theoretical problems with sampling. Any one of these fallacies would be sufficient to exclude any possibility to achieve structural-systemic understanding of the studied things and phenomena. It also turns out that modern qualitative methodologies share several fallacies with the quantitative methodology. Therefore mixed methods approaches are not able to overcome the fundamental difficulties that characterize mixed methods taken separately. It is proposed that structural-systemic methodology that dominated psychological thought in the pre-WWII continental Europe is philosophically and theoretically better grounded than the other methodologies that can be distinguished in psychology today. Future psychology should be based on structural-systemic methodology.

Perceptions of the Principal Evaluation Process and Performance Criteria: A Qualitative Study of the Challenge of Principal Evaluation

ERIC Educational Resources Information Center

Faginski-Stark, Erica; Casavant, Christopher; Collins, William; McCandless, Jason; Tencza, Marilyn

2012-01-01

Recent federal and state mandates have tasked school systems to move beyond principal evaluation as a bureaucratic function and to re-imagine it as a critical component to improve principal performance and compel school renewal. This qualitative study investigated the district leaders' and principals' perceptions of the performance evaluation…

Quantitative and Qualitative Evaluation of Iranian Researchers’ Scientific Production in Dentistry Subfields

PubMed Central

Yaminfirooz, Mousa; Motallebnejad, Mina; Gholinia, Hemmat; Esbakian, Somayeh

2015-01-01

Background: As in other fields of medicine, scientific production in the field of dentistry has significant placement. This study aimed at quantitatively and qualitatively evaluating Iranian researchers’ scientific output in the field of dentistry and determining their contribution in each of dentistry subfields and branches. Methods: This research was a scientometric study that applied quantitative and qualitative indices of Web of Science (WoS). Research population consisted of927indexed documents published under the name of Iran in the time span of 1993-2012 which were extracted from WoS on 10 March 2013. The Mann-Whitney test and Pearson correlation coefficient were used to data analyses in SPSS 19. Results: 777 (83. 73%) of indexed items of all scientific output in WoS were scientific articles. The highest growth rate of scientific productionwith90% belonged to endodontic sub field. The correlation coefficient test showed that there was a significant positive relationship between the number of documents and their publication age (P < 0. 0001). There was a significant difference between the mean number of published articles in the first ten- year (1993-2003) and that of the second one (2004-2013), in favor of the latter (P = 0. 001). Conclusions: The distribution frequencies of scientific production in various subfields of dentistry were very different. It needs to reinforce the infrastructure for more balanced scientific production in the field and its related subfields. PMID:26635439

[Adequate application of quantitative and qualitative statistic analytic methods in acupuncture clinical trials].

PubMed

Tan, Ming T; Liu, Jian-ping; Lao, Lixing

2012-08-01

Recently, proper use of the statistical methods in traditional Chinese medicine (TCM) randomized controlled trials (RCTs) has received increased attention. Statistical inference based on hypothesis testing is the foundation of clinical trials and evidence-based medicine. In this article, the authors described the methodological differences between literature published in Chinese and Western journals in the design and analysis of acupuncture RCTs and the application of basic statistical principles. In China, qualitative analysis method has been widely used in acupuncture and TCM clinical trials, while the between-group quantitative analysis methods on clinical symptom scores are commonly used in the West. The evidence for and against these analytical differences were discussed based on the data of RCTs assessing acupuncture for pain relief. The authors concluded that although both methods have their unique advantages, quantitative analysis should be used as the primary analysis while qualitative analysis can be a secondary criterion for analysis. The purpose of this paper is to inspire further discussion of such special issues in clinical research design and thus contribute to the increased scientific rigor of TCM research.

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Structural issues affecting mixed methods studies in health research: a qualitative study

PubMed Central

2009-01-01

Background Health researchers undertake studies which combine qualitative and quantitative methods. Little attention has been paid to the structural issues affecting this mixed methods approach. We explored the facilitators and barriers to undertaking mixed methods studies in health research. Methods Face-to-face semi-structured interviews with 20 researchers experienced in mixed methods research in health in the United Kingdom. Results Structural facilitators for undertaking mixed methods studies included a perception that funding bodies promoted this approach, and the multidisciplinary constituency of some university departments. Structural barriers to exploiting the potential of these studies included a lack of education and training in mixed methods research, and a lack of templates for reporting mixed methods articles in peer-reviewed journals. The 'hierarchy of evidence' relating to effectiveness studies in health care research, with the randomised controlled trial as the gold standard, appeared to pervade the health research infrastructure. Thus integration of data and findings from qualitative and quantitative components of mixed methods studies, and dissemination of integrated outputs, tended to occur through serendipity and effort, further highlighting the presence of structural constraints. Researchers are agents who may also support current structures - journal reviewers and editors, and directors of postgraduate training courses - and thus have the ability to improve the structural support for exploiting the potential of mixed methods research. Conclusion The environment for health research in the UK appears to be conducive to mixed methods research but not to exploiting the potential of this approach. Structural change, as well as change in researcher behaviour, will be necessary if researchers are to fully exploit the potential of using mixed methods research. PMID:20003210

The Use of Qualitative Case Studies as an Experiential Teaching Method in the Training of Pre-Service Teachers

ERIC Educational Resources Information Center

Arseven, Ilhami

2018-01-01

This study presents the suitability of case studies, which is a qualitative research method and can be used as a teaching method in the training of pre-service teachers, for experiential learning theory. The basic view of experiential learning theory on learning and the qualitative case study paradigm are consistent with each other within the…

A Method for Qualitative Mapping of Thick Oil Spills Using Imaging Spectroscopy

USGS Publications Warehouse

Clark, Roger N.; Swayze, Gregg A.; Leifer, Ira; Livo, K. Eric; Lundeen, Sarah; Eastwood, Michael; Green, Robert O.; Kokaly, Raymond F.; Hoefen, Todd; Sarture, Charles; McCubbin, Ian; Roberts, Dar; Steele, Denis; Ryan, Thomas; Dominguez, Roseanne; Pearson, Neil; ,

2010-01-01

A method is described to create qualitative images of thick oil in oil spills on water using near-infrared imaging spectroscopy data. The method uses simple 'three-point-band depths' computed for each pixel in an imaging spectrometer image cube using the organic absorption features due to chemical bonds in aliphatic hydrocarbons at 1.2, 1.7, and 2.3 microns. The method is not quantitative because sub-pixel mixing and layering effects are not considered, which are necessary to make a quantitative volume estimate of oil.

Structural issues affecting mixed methods studies in health research: a qualitative study.

PubMed

O'Cathain, Alicia; Nicholl, Jon; Murphy, Elizabeth

2009-12-09

Health researchers undertake studies which combine qualitative and quantitative methods. Little attention has been paid to the structural issues affecting this mixed methods approach. We explored the facilitators and barriers to undertaking mixed methods studies in health research. Face-to-face semi-structured interviews with 20 researchers experienced in mixed methods research in health in the United Kingdom. Structural facilitators for undertaking mixed methods studies included a perception that funding bodies promoted this approach, and the multidisciplinary constituency of some university departments. Structural barriers to exploiting the potential of these studies included a lack of education and training in mixed methods research, and a lack of templates for reporting mixed methods articles in peer-reviewed journals. The 'hierarchy of evidence' relating to effectiveness studies in health care research, with the randomised controlled trial as the gold standard, appeared to pervade the health research infrastructure. Thus integration of data and findings from qualitative and quantitative components of mixed methods studies, and dissemination of integrated outputs, tended to occur through serendipity and effort, further highlighting the presence of structural constraints. Researchers are agents who may also support current structures - journal reviewers and editors, and directors of postgraduate training courses - and thus have the ability to improve the structural support for exploiting the potential of mixed methods research. The environment for health research in the UK appears to be conducive to mixed methods research but not to exploiting the potential of this approach. Structural change, as well as change in researcher behaviour, will be necessary if researchers are to fully exploit the potential of using mixed methods research.

Qualitative research within trials: developing a standard operating procedure for a clinical trials unit

PubMed Central

2013-01-01

Background Qualitative research methods are increasingly used within clinical trials to address broader research questions than can be addressed by quantitative methods alone. These methods enable health professionals, service users, and other stakeholders to contribute their views and experiences to evaluation of healthcare treatments, interventions, or policies, and influence the design of trials. Qualitative data often contribute information that is better able to reform policy or influence design. Methods Health services researchers, including trialists, clinicians, and qualitative researchers, worked collaboratively to develop a comprehensive portfolio of standard operating procedures (SOPs) for the West Wales Organisation for Rigorous Trials in Health (WWORTH), a clinical trials unit (CTU) at Swansea University, which has recently achieved registration with the UK Clinical Research Collaboration (UKCRC). Although the UKCRC requires a total of 25 SOPs from registered CTUs, WWORTH chose to add an additional qualitative-methods SOP (QM-SOP). Results The qualitative methods SOP (QM-SOP) defines good practice in designing and implementing qualitative components of trials, while allowing flexibility of approach and method. Its basic principles are that: qualitative researchers should be contributors from the start of trials with qualitative potential; the qualitative component should have clear aims; and the main study publication should report on the qualitative component. Conclusions We recommend that CTUs consider developing a QM-SOP to enhance the conduct of quantitative trials by adding qualitative data and analysis. We judge that this improves the value of quantitative trials, and contributes to the future development of multi-method trials. PMID:23433341

Multi-Method Evaluation of College Teaching

ERIC Educational Resources Information Center

Algozzine, Bob; Beattie, John; Bray, Marty; Flowers, Claudia; Gretes, John; Mohanty, Ganesh; Spooner, Fred

2010-01-01

Student evaluation of instruction in college and university courses has been a routine and mandatory part of undergraduate and graduate education for some time. A major shortcoming of the process is that it relies exclusively on the opinions or qualitative judgments of students rather than on assessing the learning or transfer of knowledge that…

Searching for qualitative research for inclusion in systematic reviews: a structured methodological review.

PubMed

Booth, Andrew

2016-05-04

Qualitative systematic reviews or qualitative evidence syntheses (QES) are increasingly recognised as a way to enhance the value of systematic reviews (SRs) of clinical trials. They can explain the mechanisms by which interventions, evaluated within trials, might achieve their effect. They can investigate differences in effects between different population groups. They can identify which outcomes are most important to patients, carers, health professionals and other stakeholders. QES can explore the impact of acceptance, feasibility, meaningfulness and implementation-related factors within a real world setting and thus contribute to the design and further refinement of future interventions. To produce valid, reliable and meaningful QES requires systematic identification of relevant qualitative evidence. Although the methodologies of QES, including methods for information retrieval, are well-documented, little empirical evidence exists to inform their conduct and reporting. This structured methodological overview examines papers on searching for qualitative research identified from the Cochrane Qualitative and Implementation Methods Group Methodology Register and from citation searches of 15 key papers. A single reviewer reviewed 1299 references. Papers reporting methodological guidance, use of innovative methodologies or empirical studies of retrieval methods were categorised under eight topical headings: overviews and methodological guidance, sampling, sources, structured questions, search procedures, search strategies and filters, supplementary strategies and standards. This structured overview presents a contemporaneous view of information retrieval for qualitative research and identifies a future research agenda. This review concludes that poor empirical evidence underpins current information practice in information retrieval of qualitative research. A trend towards improved transparency of search methods and further evaluation of key search procedures offers

Qualitative studies. Their role in medical research.

PubMed Central

Huston, P.; Rowan, M.

1998-01-01

OBJECTIVE: To define qualitative research in terms of its philosophical roots, the questions it addresses, its methods and analyses, and the type of results it can offer. DATA SOURCES: MEDLINE and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases were searched for the years January 1985 to April 1998. The search strategy consisted of "textword" terms that searched in the "title" field of both databases. Qualitative research and evaluation textbooks in health and the social sciences were also used. QUALITY OF EVIDENCE: The information on qualitative research is based on the most recent and valid evidence from the health and social science fields. MAIN MESSAGE: Qualitative research seeks to understand and interpret personal experience to explain social phenomena, including those related to health. It can address questions that quantitative research cannot, such as why people do not adhere to a treatment regimen or why a certain health care intervention is successful. It uses many methods of data collection, including participant observation, case studies, and interviews, and numerous approaches to data analysis that range from the quasistatistical to the intuitive and inductive. CONCLUSIONS: Qualitative research, a form of research completely different from quantitative research, can provide important insights into health-related phenomena and can enrich further research inquiries. PMID:9839063

A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year

PubMed Central

McKibbon, Kathleen Ann; Gadd, Cynthia S

2004-01-01

Background Quantitative studies are becoming more recognized as important to understanding health care with all of its richness and complexities. The purpose of this descriptive survey was to provide a quantitative evaluation of the qualitative studies published in 170 core clinical journals for 2000. Methods All identified studies that used qualitative methods were reviewed to ascertain which clinical journals publish qualitative studies and to extract research methods, content (persons and health care issues studied), and whether mixed methods (quantitative and qualitative methods) were used. Results 60 330 articles were reviewed. 355 reports of original qualitative studies and 12 systematic review articles were identified in 48 journals. Most of the journals were in the discipline of nursing. Only 4 of the most highly cited health care journals, based on ISI Science Citation Index (SCI) Impact Factors, published qualitative studies. 37 of the 355 original reports used both qualitative and quantitative (mixed) methods. Patients and non-health care settings were the most common groups of people studied. Diseases and conditions were cancer, mental health, pregnancy and childbirth, and cerebrovascular disease with many other diseases and conditions represented. Phenomenology and grounded theory were commonly used; substantial ethnography was also present. No substantial differences were noted for content or methods when articles published in all disciplines were compared with articles published in nursing titles or when studies with mixed methods were compared with studies that included only qualitative methods. Conclusions The clinical literature includes many qualitative studies although they are often published in nursing journals or journals with low SCI Impact Factor journals. Many qualitative studies incorporate both qualitative and quantitative methods. PMID:15271221

Using Mixed Methods to Evaluate a Community Intervention for Sexual Assault Survivors: A Methodological Tale.

PubMed

Campbell, Rebecca; Patterson, Debra; Bybee, Deborah

2011-03-01

This article reviews current epistemological and design issues in the mixed methods literature and then examines the application of one specific design, a sequential explanatory mixed methods design, in an evaluation of a community-based intervention to improve postassault care for sexual assault survivors. Guided by a pragmatist epistemological framework, this study collected quantitative and qualitative data to understand how the implementation of a Sexual Assault Nurse Examiner (SANE) program affected prosecution rates of adult sexual assault cases in a large midwestern community. Quantitative results indicated that the program was successful in affecting legal systems change and the qualitative data revealed the mediating mechanisms of the intervention's effectiveness. Challenges of implementing this design are discussed, including epistemological and practical difficulties that developed from blending methodologies into a single project. © The Author(s) 2011.

Exploring Operational Test and Evaluation of Unmanned Aircraft Systems: A Qualitative Case Study

NASA Astrophysics Data System (ADS)

Saliceti, Jose A.

The purpose of this qualitative case study was to explore and identify strategies that may potentially remedy operational test and evaluation procedures used to evaluate Unmanned Aircraft Systems (UAS) technology. The sample for analysis consisted of organizations testing and evaluating UASs (e.g., U.S. Air Force, U.S. Navy, U.S. Army, U.S. Marine Corps, U.S. Coast Guard, and Customs Border Protection). A purposeful sampling technique was used to select 15 subject matter experts in the field of operational test and evaluation of UASs. A questionnaire was provided to participants to construct a descriptive and robust research. Analysis of responses revealed themes related to each research question. Findings revealed operational testers utilized requirements documents to extrapolate measures for testing UAS technology and develop critical operational issues. The requirements documents were (a) developed without the contribution of stakeholders and operational testers, (b) developed with vague or unrealistic measures, and (c) developed without a systematic method to derive requirements from mission tasks. Four approaches are recommended to develop testable operational requirements and assist operational testers: (a) use a mission task analysis tool to derive requirements for mission essential tasks for the system, (b) exercise collaboration among stakeholders and testers to ensure testable operational requirements based on mission tasks, (c) ensure testable measures are used in requirements documents, and (d) create a repository list of critical operational issues by mission areas. The preparation of operational test and evaluation processes for UAS technology is not uniform across testers. The processes in place are not standardized, thus test plan preparation and reporting are different among participants. A standard method to prepare and report UAS technology should be used when preparing and reporting on UAS technology. Using a systematic process, such as mission

Evaluation method on steering for the shape-shifting robot in different configurations

NASA Astrophysics Data System (ADS)

Chang, Jian; Li, Bin; Wang, Chong; Zheng, Huaibing; Li, Zhiqiang

2016-01-01

The evaluation method on steering is based on qualitative manner in existence, which causes the result inaccurate and fuzziness. It reduces the efficiency of process execution. So the method by quantitative manner for the shape-shifting robot in different configurations is proposed. Comparing to traditional evaluation method, the most important aspects which can influence the steering abilities of the robot in different configurations are researched in detail, including the energy, angular velocity, time and space. In order to improve the robustness of system, the ideal and slippage conditions are all considered by mathematical model. Comparing to the traditional weighting confirming method, the extent of robot steering method is proposed by the combination of subjective and objective weighting method. The subjective weighting method can show more preferences of the experts and is based on five-grade scale. The objective weighting method is based on information entropy to determine the factors. By the sensors fixed on the robot, the contract force between track grouser and ground, the intrinsic motion characteristics of robot are obtained and the experiment is done to prove the algorithm which is proposed as the robot in different common configurations. Through the method proposed in the article, fuzziness and inaccurate of the evaluation method has been solved, so the operators can choose the most suitable configuration of the robot to fulfil the different tasks more quickly and simply.

Comparison between qualitative and real-time polymerase chain reaction to evaluate minimal residual disease in children with acute lymphoblastic leukemia.

PubMed

Paula, Francisco Danilo Ferreira; Elói-Santos, Silvana Maria; Xavier, Sandra Guerra; Ganazza, Mônica Aparecida; Jotta, Patricia Yoshioka; Yunes, José Andrés; Viana, Marcos Borato; Assumpção, Juliana Godoy

2015-01-01

Minimal residual disease is an important independent prognostic factor that can identify poor responders among patients with acute lymphoblastic leukemia. The aim of this study was to analyze minimal residual disease using immunoglobulin (Ig) and T-cell receptor (TCR) gene rearrangements by conventional polymerase chain reaction followed by homo-heteroduplex analysis and to compare this with real-time polymerase chain reaction at the end of the induction period in children with acute lymphoblastic leukemia. Seventy-four patients diagnosed with acute lymphoblastic leukemia were enrolled. Minimal residual disease was evaluated by qualitative polymerase chain reaction in 57 and by both tests in 44. The Kaplan-Meier and multivariate Cox methods and the log-rank test were used for statistical analysis. Nine patients (15.8%) were positive for minimal residual disease by qualitative polymerase chain reaction and 11 (25%) by real-time polymerase chain reaction considering a cut-off point of 1×10(-3) for precursor B-cell acute lymphoblastic leukemia and 1×10(-2) for T-cell acute lymphoblastic leukemia. Using the qualitative method, the 3.5-year leukemia-free survival was significantly higher in children negative for minimal residual disease compared to those with positive results (84.1%±5.6% versus 41.7%±17.3%, respectively; p-value=0.004). There was no significant association between leukemia-free survival and minimal residual disease by real-time polymerase chain reaction. Minimal residual disease by qualitative polymerase chain reaction was the only variable significantly correlated to leukemia-free survival. Given the difficulties in the implementation of minimal residual disease monitoring by real-time polymerase chain reaction in most treatment centers in Brazil, the qualitative polymerase chain reaction strategy may be a cost-effective alternative. Copyright © 2015 Associação Brasileira de Hematologia, Hemoterapia e Terapia Celular. Published by Elsevier

Cognitive Relativism in Evaluation.

ERIC Educational Resources Information Center

Alexander, H. A.

1986-01-01

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

Quantification of the Barkhausen noise method for the evaluation of time-dependent degradation

NASA Astrophysics Data System (ADS)

Kim, Dong-Won; Kwon, Dongil

2003-02-01

The Barkhausen noise (BN) method has long been applied to measure the bulk magnetic properties of magnetic materials. Recently, this important nondestructive testing (NDT) method has been applied to evaluate microstructure, stress distribution analysis, fatigue, creep and fracture characteristics. Until now the BN method has been used only qualitatively in evaluating the variation of BN with variations in material properties. For this reason, few NDT methods have been applied in industrial plants and laboratories. The present investigation studied the coercive force and BN while varying the microstructure of ultrafine-grained steels and SA508 cl.3 steels. This variation was carried out according to the second heat-treatment condition with rolling of ultrafine-grained steels and the simulated time-dependent degradation of SA 508 cl.3 steels. An attempt was also made to quantify BN from the relationship between the velocity of magnetic domain walls and the retarding force, using the coercive force of the domain wall movement. The microstructure variation was analyzed according to time-dependent degradation. Fracture toughness was evaluated quantitatively by measuring the BN from two intermediary parameters; grain size and distribution of nonmagnetic particles. From these measurements, the variation of microstructure and fracture toughness can be directly evaluated by the BN method as an accurate in situ NDT method.

Theoretical Coalescence: A Method to Develop Qualitative Theory: The Example of Enduring.

PubMed

Morse, Janice M

Qualitative research is frequently context bound, lacks generalizability, and is limited in scope. The purpose of this article was to describe a method, theoretical coalescence, that provides a strategy for analyzing complex, high-level concepts and for developing generalizable theory. Theoretical coalescence is a method of theoretical expansion, inductive inquiry, of theory development, that uses data (rather than themes, categories, and published extracts of data) as the primary source for analysis. Here, using the development of the lay concept of enduring as an example, I explore the scientific development of the concept in multiple settings over many projects and link it within the Praxis Theory of Suffering. As comprehension emerges when conducting theoretical coalescence, it is essential that raw data from various different situations be available for reinterpretation/reanalysis and comparison to identify the essential features of the concept. The concept is then reconstructed, with additional inquiry that builds description, and evidence is conducted and conceptualized to create a more expansive concept and theory. By utilizing apparently diverse data sets from different contexts that are linked by certain characteristics, the essential features of the concept emerge. Such inquiry is divergent and less bound by context yet purposeful, logical, and with significant pragmatic implications for practice in nursing and beyond our discipline. Theoretical coalescence is a means by which qualitative inquiry is broadened to make an impact, to accommodate new theoretical shifts and concepts, and to make qualitative research applied and accessible in new ways.

Shifting Practices in Teacher Performance Evaluation: A Qualitative Examination of Administrator Change Readiness

ERIC Educational Resources Information Center

Spina, Nancy; Buckley, Phillip; Puchner, Laurel

2014-01-01

This study examines the perceptions, attitudes and beliefs of administrators and teachers in a Southwestern Illinois School District regarding the recent reforms in teacher performance evaluation. This study uses a qualitative approach and provides data from individual and focus group interviews to determine the extent to which the district is…

Evaluation of interventions on road traffic injuries in Peru: a qualitative approach

PubMed Central

2012-01-01

Background Evaluation of interventions on road traffic injuries (RTI) going beyond the assessment of impact to include factors underlying success or failure is an important complement to standard impact evaluations. We report here how we used a qualitative approach to assess current interventions implemented to reduce RTIs in Peru. Methods We performed in-depth interviews with policymakers and technical officers involved in the implementation of RTI interventions to get their insight on design, implementation and evaluation aspects. We then conducted a workshop with key stakeholders to analyze the results of in-depth interviews, and to further discuss and identify key programmatic considerations when designing and implementing RTI interventions. We finally performed brainstorming sessions to assess potential system-wide effects of a selected intervention (Zero Tolerance), and to identify adaptation and redesign needs for this intervention. Results Key programmatic components were consistently identified that should be considered when designing and implementing RTI interventions. They include effective and sustained political commitment and planning; sufficient and sustained budget allocation; training, supervision, monitoring and evaluation of implemented policies; multisectoral participation; and strong governance and accountability. Brainstorming sessions revealed major negative effects of the selected intervention on various system building blocks. Conclusions Our approach revealed substantial caveats in current RTI interventions in Peru, and fundamental negative effects on several components of the sectors and systems involved. It also highlighted programmatic issues that should be applied to guarantee an effective implementation and evaluation of these policies. The findings from this study were discussed with key stakeholders for consideration in further designing and planning RTI control interventions in Peru. PMID:22269578

Qualitative evaluation of maternal milk and commercial infant formulas via LIBS.

PubMed

Abdel-Salam, Z; Al Sharnoubi, J; Harith, M A

2013-10-15

This study focuses on the use of laser-induced breakdown spectroscopy (LIBS) for the evaluation of the nutrients in maternal milk and some commercially available infant formulas. The results of such evaluation are vital for adequate and healthy feeding for babies during lactation period. Laser-induced breakdown spectroscopy offers special advantages in comparison to the other conventional analytical techniques. Specifically, LIBS is a straightforward technique that can be used in situ to provide qualitative analytical information in few minutes for the samples under investigation without preparation processes. The samples studied in the current work were maternal milk samples collected during the first 3 months of lactation (not colostrum milk) and samples from six different types of commercially available infant formulas. The samples' elemental composition has been compared with respect to the relative abundance of the elements of nutrition importance, namely Mg, Ca, Na, and Fe using their spectral emission lines in the relevant LIBS spectra. In addition, CN and C2 molecular emission bands in the same spectra have been studied as indicators of proteins content in the samples. The obtained analytical results demonstrate the higher elemental contents of the maternal milk compared with the commercial formulas samples. Similar results have been obtained as for the proteins content. It has been also shown that calcium and proteins have similar relative concentration trends in the studied samples. This work demonstrates the feasibility of adopting LIBS as a fast, safe, less costly technique evaluating qualitatively the nutrients content of both maternal and commercial milk samples. Copyright © 2013 Elsevier B.V. All rights reserved.

Positive Effects of a Stress Reduction Program Based on Mindfulness Meditation in Brazilian Nursing Professionals: Qualitative and Quantitative Evaluation.

PubMed

dos Santos, Teresa Maria; Kozasa, Elisa Harumi; Carmagnani, Isabel Sampaio; Tanaka, Luiza Hiromi; Lacerda, Shirley Silva; Nogueira-Martins, Luiz Antonio

2016-01-01

Mindfulness meditation has been shown to effectively mitigate the negative effects of stress among nursing professionals, but in countries like Brazil, these practices are relatively unexplored. To evaluate the effects of a Stress Reduction Program (SRP) including mindfulness and loving kindness meditation among nursing professionals working in a Brazilian hospital setting. Pilot study with a mixed model using quantitative and qualitative methods was used to evaluate a group of participants. The quantitative data were analyzed at three different time points: pre-intervention, post-intervention, and follow-up. The qualitative data were analyzed at post-intervention. Hospital São Paulo (Brazil). Sample 13 nursing professionals, including nurses, technicians, and nursing assistants working in a hospital. Participants underwent mindfulness and loving kindness meditation during a period of six weeks. Perceived Stress Scale (PSS), Maslach Burnout Inventory (MBI), Beck Depression Inventory (BDI), State-Trait Anxiety Inventory (STAI), Satisfaction With Life Scale (SWLS), Self-Compassion Scale (SCS), WHOQOL-BREF quality of life assessment, and Work Stress Scale (WSS). Qualitative data were collected via a group interview following six weeks participation in the SRP. The quantitative analyses revealed a significant reduction (P < .05) between pre-intervention and post-intervention scores for perceived stress, burnout, depression, and anxiety (trait). These variables showed no significant differences between post-intervention and follow-up scores. The WHOQOL-BREF revealed significant increase (P < .05) just in the physical and psychological domains at post-intervention scores, which remained at the follow-up. Qualitative results showed improvement in the reactivity to inner experience; a more attentive perception of internal and external experiences; greater attention and awareness of actions and attitudes at every moment; and a positive influence of the SRP in nursing

Levels of reconstruction as complementarity in mixed methods research: a social theory-based conceptual framework for integrating qualitative and quantitative research.

PubMed

Carroll, Linda J; Rothe, J Peter

2010-09-01

Like other areas of health research, there has been increasing use of qualitative methods to study public health problems such as injuries and injury prevention. Likewise, the integration of qualitative and quantitative research (mixed-methods) is beginning to assume a more prominent role in public health studies. Likewise, using mixed-methods has great potential for gaining a broad and comprehensive understanding of injuries and their prevention. However, qualitative and quantitative research methods are based on two inherently different paradigms, and their integration requires a conceptual framework that permits the unity of these two methods. We present a theory-driven framework for viewing qualitative and quantitative research, which enables us to integrate them in a conceptually sound and useful manner. This framework has its foundation within the philosophical concept of complementarity, as espoused in the physical and social sciences, and draws on Bergson's metaphysical work on the 'ways of knowing'. Through understanding how data are constructed and reconstructed, and the different levels of meaning that can be ascribed to qualitative and quantitative findings, we can use a mixed-methods approach to gain a conceptually sound, holistic knowledge about injury phenomena that will enhance our development of relevant and successful interventions.

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study

PubMed Central

2014-01-01

Background Qualitative research is undertaken with randomized controlled trials of health interventions. Our aim was to explore the perceptions of researchers with experience of this endeavour to understand the added value of qualitative research to the trial in practice. Methods A telephone semi-structured interview study with 18 researchers with experience of undertaking the trial and/or the qualitative research. Results Interviewees described the added value of qualitative research for the trial, explaining how it solved problems at the pretrial stage, explained findings, and helped to increase the utility of the evidence generated by the trial. From the interviews, we identified three models of relationship of the qualitative research to the trial. In ‘the peripheral’ model, the trial was an opportunity to undertake qualitative research, with no intention that it would add value to the trial. In ‘the add-on’ model, the qualitative researcher understood the potential value of the qualitative research but it was viewed as a separate and complementary endeavour by the trial lead investigator and wider team. Interviewees described how this could limit the value of the qualitative research to the trial. Finally ‘the integral’ model played out in two ways. In ‘integral-in-theory’ studies, the lead investigator viewed the qualitative research as essential to the trial. However, in practice the qualitative research was under-resourced relative to the trial, potentially limiting its ability to add value to the trial. In ‘integral-in-practice’ studies, interviewees described how the qualitative research was planned from the beginning of the study, senior qualitative expertise was on the team from beginning to end, and staff and time were dedicated to the qualitative research. In these studies interviewees described the qualitative research adding value to the trial although this value was not necessarily visible beyond the original research team due

Integrating Quantitative and Qualitative Data in Mixed Methods Research--Challenges and Benefits

ERIC Educational Resources Information Center

Almalki, Sami

2016-01-01

This paper is concerned with investigating the integration of quantitative and qualitative data in mixed methods research and whether, in spite of its challenges, it can be of positive benefit to many investigative studies. The paper introduces the topic, defines the terms with which this subject deals and undertakes a literature review to outline…

Smoking Cessation and the Internet: A Qualitative Method Examining Online Consumer Behavior

PubMed Central

Frisby, Genevieve; Borland, Ron; Anderson, Jeremy N

2002-01-01

Background Smoking is a major preventable cause of disease and disability around the world. Smoking cessation support — including information, discussion groups, cognitive behavioral treatment, and self-help materials — can be delivered via the Internet. There is limited information about the reasons and methods consumers access smoking cessation information on the Internet. Objectives This study aims to determine the feasibility of a method to examine the online behavior of consumers seeking smoking cessation resources. In particular, we sought to identify the reasons and methods consumers use to access and assess the quality of these resources. Methods Thirteen participants were recruited via the state-based Quit® smoking cessation campaign, operated by the Victorian Cancer Council, in December 2001. Online behavior was evaluated using semi-structured interviews and Internet simulations where participants sought smoking cessation information and addressed set-case scenarios. Online interaction was tracked through pervasive logging with specialist software. Results Thirteen semi-structured interviews and 4 Internet simulations were conducted in January 2002. Participants sought online smoking cessation resources for reasons of convenience, timeliness, and anonymity — and because their current information needs were unmet. They employed simple search strategies and could not always find information in an efficient manner. Participants employed several different strategies to assess the quality of online health resources. Conclusions Consumer online behavior can be studied using a combination of survey, observation, and online surveillance. However, further qualitative and observational research is required to harness the full potential of the Internet to deliver public health resources. PMID:12554555

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis

PubMed Central

2014-01-01

Background Caring for a young person experiencing first-episode psychosis is challenging and can affect carers’ well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers’ beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. Methods A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Results Three themes were abstracted from the data, reflecting carers’ beliefs about the usefulness of the manual: promoting carers’ well-being, increasing carers’ understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. Conclusion This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. Trial registration ACTRN12609000064202 PMID:24906392

Smoking cessation and the Internet: a qualitative method examining online consumer behavior.

PubMed

Frisby, Genevieve; Bessell, Tracey L; Borland, Ron; Anderson, Jeremy N

2002-01-01

Smoking is a major preventable cause of disease and disability around the world. Smoking cessation support-including information, discussion groups, cognitive behavioral treatment, and self-help materials-can be delivered via the Internet. There is limited information about the reasons and methods consumers access smoking cessation information on the Internet. This study aims to determine the feasibility of a method to examine the online behavior of consumers seeking smoking cessation resources. In particular, we sought to identify the reasons and methods consumers use to access and assess the quality of these resources. Thirteen participants were recruited via the state-based Quit smoking cessation campaign, operated by the Victorian Cancer Council, in December 2001. Online behavior was evaluated using semi-structured interviews and Internet simulations where participants sought smoking cessation information and addressed set-case scenarios. Online interaction was tracked through pervasive logging with specialist software. Thirteen semi-structured interviews and 4 Internet simulations were conducted in January 2002. Participants sought online smoking cessation resources for reasons of convenience, timeliness, and anonymity-and because their current information needs were unmet. They employed simple search strategies and could not always find information in an efficient manner. Participants employed several different strategies to assess the quality of online health resources. Consumer online behavior can be studied using a combination of survey, observation, and online surveillance. However, further qualitative and observational research is required to harness the full potential of the Internet to deliver public health resources.

Qualitative-Based Methodology to Teaching Qualitative Methodology in Higher Education

ERIC Educational Resources Information Center

Katz, Sara

2015-01-01

There is no defined theory for teaching Qualitative Inquiry, and very few studies have focused on the topic. This study is a qualitative case study focused on the Qualitative Methods course that I teach at a college of education in Israel. The aim of the study is to explore and describe the course, to provide a true picture of my pedagogy, and to…

Using mixed methods to develop and evaluate complex interventions in palliative care research.

PubMed

Farquhar, Morag C; Ewing, Gail; Booth, Sara

2011-12-01

there is increasing interest in combining qualitative and quantitative research methods to provide comprehensiveness and greater knowledge yield. Mixed methods are valuable in the development and evaluation of complex interventions. They are therefore particularly valuable in palliative care research where the majority of interventions are complex, and the identification of outcomes particularly challenging. this paper aims to introduce the role of mixed methods in the development and evaluation of complex interventions in palliative care, and how they may be used in palliative care research. the paper defines mixed methods and outlines why and how mixed methods are used to develop and evaluate complex interventions, with a pragmatic focus on design and data collection issues and data analysis. Useful texts are signposted and illustrative examples provided of mixed method studies in palliative care, including a detailed worked example of the development and evaluation of a complex intervention in palliative care for breathlessness. Key challenges to conducting mixed methods in palliative care research are identified in relation to data collection, data integration in analysis, costs and dissemination and how these might be addressed. the development and evaluation of complex interventions in palliative care benefit from the application of mixed methods. Mixed methods enable better understanding of whether and how an intervention works (or does not work) and inform the design of subsequent studies. However, they can be challenging: mixed method studies in palliative care will benefit from working with agreed protocols, multidisciplinary teams and engaging staff with appropriate skill sets.

Overcoming Methods Anxiety: Qualitative First, Quantitative Next, Frequent Feedback along the Way

ERIC Educational Resources Information Center

Bernstein, Jeffrey L.; Allen, Brooke Thomas

2013-01-01

Political Science research methods courses face two problems. First is what to cover, as there are too many techniques to explore in any one course. Second is dealing with student anxiety around quantitative material. We explore a novel way to approach these issues. Our students began by writing a qualitative paper. They followed with a term…

Validation of quantitative and qualitative methods for detecting allergenic ingredients in processed foods in Japan.

PubMed

Sakai, Shinobu; Adachi, Reiko; Akiyama, Hiroshi; Teshima, Reiko

2013-06-19

A labeling system for food allergenic ingredients was established in Japan in April 2002. To monitor the labeling, the Japanese government announced official methods for detecting allergens in processed foods in November 2002. The official methods consist of quantitative screening tests using enzyme-linked immunosorbent assays (ELISAs) and qualitative confirmation tests using Western blotting or polymerase chain reactions (PCR). In addition, the Japanese government designated 10 μg protein/g food (the corresponding allergenic ingredient soluble protein weight/food weight), determined by ELISA, as the labeling threshold. To standardize the official methods, the criteria for the validation protocol were described in the official guidelines. This paper, which was presented at the Advances in Food Allergen Detection Symposium, ACS National Meeting and Expo, San Diego, CA, Spring 2012, describes the validation protocol outlined in the official Japanese guidelines, the results of interlaboratory studies for the quantitative detection method (ELISA for crustacean proteins) and the qualitative detection method (PCR for shrimp and crab DNAs), and the reliability of the detection methods.

Qualitative and quantitative evaluation of human dental enamel after bracket debonding: a noncontact three-dimensional optical profilometry analysis.

PubMed

Ferreira, Fabiano G; Nouer, Darcy F; Silva, Nelson P; Garbui, Ivana U; Correr-Sobrinho, Lourenço; Nouer, Paulo R A

2014-09-01

The aim of this study was to undertake a qualitative and quantitative evaluation of changes on enamel surfaces after debonding of brackets followed by finishing procedures, using a high-resolution three-dimensional optical profiler and to investigate the accuracy of the technique. The labial surfaces of 36 extracted upper central incisors were examined. Before bonding, the enamel surfaces were subjected to profilometry, recording four amplitude parameters. Brackets were then bonded using two types of light-cured orthodontic adhesive: composite resin and resin-modified glass ionomer cement. Finishing was performed by three different methods: pumice on a rubber cup, fine and ultrafine aluminum oxide discs, and microfine diamond cups followed by silicon carbide brushes. The samples were subsequently re-analyzed by profilometry. Wilcoxon signed-rank test, Kruskal-Wallis test (p < 0.05) and a posteriori Mann-Whitney U test with Bonferroni correction (p < 0.0167) revealed a significant reduction of enamel roughness when diamond cups followed by silicon carbide brushes were used to finish surfaces that had remnants of resin-modified glass ionomer adhesive and when pumice was used to finish surfaces that had traces of composite resin. Enamel loss was minimal. The 3D optical profilometry technique was able to provide accurate qualitative and quantitative assessment of changes on the enamel surface after debonding. Morphological changes in the topography of dental surfaces, especially if related to enamel loss and roughness, are of considerable clinical importance. The quantitative evaluation method used herein enables a more comprehensive understanding of the effects of orthodontic bonding on teeth.

Development and Validation of a Novel LC-MS/MS Opioid Confirmation Assay: Evaluation of β-glucuronidase Enzymes and Sample Cleanup Methods.

PubMed

Yang, He S; Wu, Alan H B; Lynch, Kara L

2016-06-01

With the rise in the use and misuse of prescription opioids, there is an increasing need for the confirmed identification of opioid analgesics in toxicology laboratories. The goals of this study were to (i) systematically evaluate the hydrolysis efficiency of four β-glucuronidase enzymes under optimized condition; (ii) evaluate compound recovery, matrix effects and precision of three protein precipitation plates and (iii) develop and validate a qualitative liquid-chromatography mass spectrometry (LC-MS/MS) assay to identify 13 opioids in urine. A recombinant β-glucuronidase exhibited the best overall hydrolysis efficiency for seven opioid glucuronide conjugates compared with β-glucuronidase from red abalone, Escherichia coli and Patella vulgata One of the protein precipitation plates tested exhibited overall better recovery of the opioids and lower ion suppression compared with the other two plates. An ESI positive mode LC-MS/MS assay for qualitative opioid analysis was developed and validated. Linearity, LOD, precision, matrix effect, recovery, carryover and interference of the method were evaluated. Sixty-two patient samples were analyzed by both a legacy GC-MS opioid method and the LC-MS/MS method, and 22 samples were analyzed by the LC-MS/MS and an LC-MS/MS reference method. The results of the comparisons showed good concordance. Overall, we described an efficient sample preparation procedure for a sensitive qualitative opioid confirmation assay in urine. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors

ERIC Educational Resources Information Center

Plough, India C.; Briggs, Sarah L.; Van Bonn, Sarah

2010-01-01

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Qualitative tools and experimental philosophy

PubMed Central

Andow, James

2016-01-01

Abstract Experimental philosophy brings empirical methods to philosophy. These methods are used to probe how people think about philosophically interesting things such as knowledge, morality, and freedom. This paper explores the contribution that qualitative methods have to make in this enterprise. I argue that qualitative methods have the potential to make a much greater contribution than they have so far. Along the way, I acknowledge a few types of resistance that proponents of qualitative methods in experimental philosophy might encounter, and provide reasons to think they are ill-founded. PMID:28392629

Qualitative tools and experimental philosophy.

PubMed

Andow, James

2016-11-16

Experimental philosophy brings empirical methods to philosophy. These methods are used to probe how people think about philosophically interesting things such as knowledge, morality, and freedom. This paper explores the contribution that qualitative methods have to make in this enterprise. I argue that qualitative methods have the potential to make a much greater contribution than they have so far. Along the way, I acknowledge a few types of resistance that proponents of qualitative methods in experimental philosophy might encounter, and provide reasons to think they are ill-founded.

Evaluating the appropriateness of antimicrobial treatment in hospitalized patients: a comparison of three methods.

PubMed

Reisfeld, S; Assaly, M; Tannous, E; Amarney, K; Stein, M

2018-06-01

Approximately 20-50% of antimicrobial therapy in hospitalized patients is considered inappropriate, which may be associated with increased morbidity and mortality. The best method for evaluation of appropriateness is not well defined. To evaluate the rate of appropriate antimicrobial therapy in a secondary hospital using three different methods, and determine the rate of agreement between the different methods. A point prevalence study included all adult hospitalized patients receiving systemic antimicrobial therapy during 2016, screened on a single day. Clinical, laboratory and therapeutic data were collected from patient files, and appropriateness was rated with a qualitative evaluation by expert opinion. In addition, a quantitative evaluation was performed according to 11 quality indicators (QIs) rated for each patient. A strict definition of appropriateness was fulfilled if six essential QIs were met, and a lenient definition was fulfilled if at least five QIs were met. Agreement between methods was analysed using kappa statistic. Among 106 patients included, rates of appropriateness of antimicrobial therapy ranged from 20% to 75%, depending on the method of evaluation. Very low agreement was found between the strict definition and expert opinion (kappa=0.068), and medium agreement was found between the lenient definition and expert opinion (kappa=0.45). Rates of appropriateness of antimicrobial therapy varied between evaluation methods, with low to moderate agreement between the different methods. Copyright © 2017 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

Evaluating the Usability and Usefulness of a Mobile App for Atrial Fibrillation Using Qualitative Methods: Exploratory Pilot Study.

PubMed

Hirschey, Jaclyn; Bane, Sunetra; Mansour, Moussa; Sperber, Jodi; Agboola, Stephen; Kvedar, Joseph; Jethwani, Kamal

2018-03-15

studies that qualitatively examine patient perceptions of usability and usefulness are a valuable and often underutilized method for assessing the real-world acceptability of an intervention. Additional research evaluating the AFib Connect mobile app over a longer period, and including a larger, more diverse sample of AFib patients, will be helpful for understanding whether the app is perceived more broadly to be useful and effective in supporting patient self-care and medication adherence. ©Jaclyn Hirschey, Sunetra Bane, Moussa Mansour, Jodi Sperber, Stephen Agboola, Joseph Kvedar, Kamal Jethwani. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 15.03.2018.

A qualitative and quantitative laser-based computer-aided flow visualization method. M.S. Thesis, 1992 Final Report

NASA Technical Reports Server (NTRS)

Canacci, Victor A.; Braun, M. Jack

1994-01-01

The experimental approach presented here offers a nonintrusive, qualitative and quantitative evaluation of full field flow patterns applicable in various geometries in a variety of fluids. This Full Flow Field Tracking (FFFT) Particle Image Velocimetry (PIV) technique, by means of particle tracers illuminated by a laser light sheet, offers an alternative to Laser Doppler Velocimetry (LDV), and intrusive systems such as Hot Wire/Film Anemometry. The method makes obtainable the flow patterns, and allows quantitative determination of the velocities, accelerations, and mass flows of an entire flow field. The method uses a computer based digitizing system attached through an imaging board to a low luminosity camera. A customized optical train allows the system to become a long distance microscope (LDM), allowing magnifications of areas of interest ranging up to 100 times. Presented in addition to the method itself, are studies in which the flow patterns and velocities were observed and evaluated in three distinct geometries, with three different working fluids. The first study involved pressure and flow analysis of a brush seal in oil. The next application involved studying the velocity and flow patterns in a cowl lip cooling passage of an air breathing aircraft engine using water as the working fluid. Finally, the method was extended to a study in air to examine the flows in a staggered pin arrangement located on one side of a branched duct.

Overview of Student Affairs Research Methods: Qualitative and Quantitative.

ERIC Educational Resources Information Center

Perl, Emily J.; Noldon, Denise F.

2000-01-01

Reviews the strengths and weaknesses of quantitative and qualitative research in student affairs research, noting that many student affairs professionals question the value of more traditional quantitative approaches to research, though they typically have very good people skills that they have applied to being good qualitative researchers.…

Using Qualitative Methods to Improve Questionnaires for Spanish Speakers: Assessing Face Validity of a Food Behavior Checklist

PubMed Central

BANNA, JINAN C.; VERA BECERRA, LUZ E.; KAISER, LUCIA L.; TOWNSEND, MARILYN S.

2015-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture’s food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. PMID:20102831

Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist.

PubMed

Banna, Jinan C; Vera Becerra, Luz E; Kaiser, Lucia L; Townsend, Marilyn S

2010-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture's food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

A Computational Approach to Qualitative Analysis in Large Textual Datasets

PubMed Central

Evans, Michael S.

2014-01-01

In this paper I introduce computational techniques to extend qualitative analysis into the study of large textual datasets. I demonstrate these techniques by using probabilistic topic modeling to analyze a broad sample of 14,952 documents published in major American newspapers from 1980 through 2012. I show how computational data mining techniques can identify and evaluate the significance of qualitatively distinct subjects of discussion across a wide range of public discourse. I also show how examining large textual datasets with computational methods can overcome methodological limitations of conventional qualitative methods, such as how to measure the impact of particular cases on broader discourse, how to validate substantive inferences from small samples of textual data, and how to determine if identified cases are part of a consistent temporal pattern. PMID:24498398

Using qualitative research methods in biomedical innovation: the case of cultured red blood cells for transfusion.

PubMed

Lyall, Catherine; King, Emma

2016-05-11

Qualitative research has a key role to play in biomedical innovation projects. This article focuses on the appropriate use of robust social science methodologies (primarily focus group studies) for identifying the public's willingness and preference for emerging medical technologies. Our study was part of the BloodPharma project (now known as the Novosang project) to deliver industrially generated red blood cells for transfusion. Previous work on blood substitutes shows that the public prefers donated human blood. However, no research has been conducted concerning attitudes to stem cell derived red blood cells. Qualitative research methods including interviews and focus groups provide the methodological context for this paper. Focus groups were used to elicit views from sub-sections of the UK population about the potential use of such cultured red blood cells. We reflect on the appropriateness of that methodology in the context of the BloodPharma project. Findings are in the form of lessons transferable to other interdisciplinary, science-led teams about what a social science dimension can bring; why qualitative research should be included; and how it can be used effectively. Qualitative data collection offers the strength of exploring ambivalence and investigating the reasons for views, but not necessarily their prevalence in wider society. The inherent value of a qualitative method, such as focus groups, therefore lies in its ability to uncover new information. This contrasts with a quantitative approach to simply 'measuring' public opinion on a topic about which participants may have little prior knowledge. We discuss a number of challenges including: appropriate roles for embedded social scientists and the intricacies of doing upstream engagement as well as some of the design issues and limitations associated with the focus group method.

A Qualitative Evaluation of Instructors' Exam Questions at a Primary Education Department in Terms of Certain Variables

ERIC Educational Resources Information Center

Demir, Mehmet Kaan; Eryaman, Mustafa Yunus

2012-01-01

The purpose of this qualitative research study is to analyze instructors' exam questions at a Primary Education Department in terms of the exam's period, the comprehensibility of the instructions, cognitive level, and the appropriateness to the critical thinking. This qualitative study is based on document analysis method. 100 randomly selected…

Methodology Series Module 10: Qualitative Health Research

PubMed Central

Setia, Maninder Singh

2017-01-01

Although quantitative designs are commonly used in clinical research, some studies require qualitative methods. These designs are different from quantitative methods; thus, researchers should be aware of data collection methods and analyses for qualitative research. Qualitative methods are particularly useful to understand patient experiences with the treatment or new methods of management or to explore issues in detail. These methods are useful in social and behavioral research. In qualitative research, often, the main focus is to understand the issue in detail rather than generalizability; thus, the sampling methods commonly used are purposive sampling; quota sampling; and snowball sampling (for hard to reach groups). Data can be collected using in-depth interviews (IDIs) or focus group discussions (FGDs). IDI is a one-to-one interview with the participant. FGD is a method of group interview or discussion, in which more than one participant is interviewed at the same time and is usually led by a facilitator. The commonly used methods for data analysis are: thematic analysis; grounded theory analysis; and framework analysis. Qualitative data collection and analysis require special expertise. Hence, if the reader plans to conduct qualitative research, they should team up with a qualitative researcher. PMID:28794545

Methodology Series Module 10: Qualitative Health Research.

PubMed

Setia, Maninder Singh

2017-01-01

Although quantitative designs are commonly used in clinical research, some studies require qualitative methods. These designs are different from quantitative methods; thus, researchers should be aware of data collection methods and analyses for qualitative research. Qualitative methods are particularly useful to understand patient experiences with the treatment or new methods of management or to explore issues in detail. These methods are useful in social and behavioral research. In qualitative research, often, the main focus is to understand the issue in detail rather than generalizability; thus, the sampling methods commonly used are purposive sampling; quota sampling; and snowball sampling (for hard to reach groups). Data can be collected using in-depth interviews (IDIs) or focus group discussions (FGDs). IDI is a one-to-one interview with the participant. FGD is a method of group interview or discussion, in which more than one participant is interviewed at the same time and is usually led by a facilitator. The commonly used methods for data analysis are: thematic analysis; grounded theory analysis; and framework analysis. Qualitative data collection and analysis require special expertise. Hence, if the reader plans to conduct qualitative research, they should team up with a qualitative researcher.

A qualitative and quantitative HPTLC densitometry method for the analysis of cannabinoids in Cannabis sativa L.

PubMed

Fischedick, Justin T; Glas, Ronald; Hazekamp, Arno; Verpoorte, Rob

2009-01-01

Cannabis and cannabinoid based medicines are currently under serious investigation for legitimate development as medicinal agents, necessitating new low-cost, high-throughput analytical methods for quality control. The goal of this study was to develop and validate, according to ICH guidelines, a simple rapid HPTLC method for the quantification of Delta(9)-tetrahydrocannabinol (Delta(9)-THC) and qualitative analysis of other main neutral cannabinoids found in cannabis. The method was developed and validated with the use of pure cannabinoid reference standards and two medicinal cannabis cultivars. Accuracy was determined by comparing results obtained from the HTPLC method with those obtained from a validated HPLC method. Delta(9)-THC gives linear calibration curves in the range of 50-500 ng at 206 nm with a linear regression of y = 11.858x + 125.99 and r(2) = 0.9968. Results have shown that the HPTLC method is reproducible and accurate for the quantification of Delta(9)-THC in cannabis. The method is also useful for the qualitative screening of the main neutral cannabinoids found in cannabis cultivars.

The acoustical design of vehicles-a challenge for qualitative evaluation

NASA Astrophysics Data System (ADS)

Schulte-Fortkamp, Brigitte; Genuit, Klaus; Fiebig, Andre

2005-09-01

Whenever the acoustical design of vehicles is explored, the crucial question about the appropriate method of evaluation arises. Research shows that not only acoustic but also non-acoustic parameters have a major influence on the way sounds are evaluated. Therefore, new methods of evaluation have to be implemented. Methods are needed which give the opportunity to test the quality of the given ambience and to register the effects and evaluations in their functional interdependence as well as the influence of personal and contextual factors. Moreover, new methods have to give insight into processes of evaluation and their contextual parameters. In other words, the task of evaluating acoustical ambiences consists of designating a set of social, psychological, and cultural conditions which are important to determine particular individual and collective behavior, attitudes, and also emotions relative to the given ambience. However, no specific recommendations exist yet which comprise particular descriptions of how to assess those specific sound effects. That is why there is a need to develop alternative methods of evaluation with whose help effects of acoustical ambiences can be better predicted. A method of evaluation will be presented which incorporates a new sensitive approach for the evaluation of vehicle sounds.

Flipping the Graduate Qualitative Research Methods Classroom: Did It Lead to Flipped Learning?

ERIC Educational Resources Information Center

Earley, Mark

2016-01-01

The flipped, or inverted, classroom has gained popularity in a variety of fields and at a variety of educational levels, from K-12 through higher education. This paper describes the author's positive experience flipping a graduate qualitative research methods classroom. After a review of the current literature on flipped classrooms in higher…

[Qualitative evaluation of the alcoholism integral approach with the GIA model (alcoholism institutional groups)].

PubMed

Villafañe, Claudia I

2009-01-01

This paper presents the evaluation, over a period of 6 years, on the effectiveness of the Alcoholism Institutional Group (GIA), in the Puerto San Julián Hospital, Santa Cruz, Argentina. The theoretical framework refers to three aspects: subject, social and institutional order. The qualitative logic and the process of analytic induction were used. information was gathered through semi-structured interviews to selected cases (intentional sampling). The constant comparative method for the analysis was used. the GIA method is effective from the aspects of the subject and the social order; the subject included in the treatment was able to: a) deconstruct the socially assumed role as an alcoholic, b) reconstruct their identity, c) restore the fabric of family, labour and social links, d) identify the healthy aspects of their personality to recover the capacities obstructed by the illness, e) learn to solve conflicts collectively thanks to group functioning, f) report to destigmatize the illness, and g) develop a healthy life project. The GIA method proved partially effective from the institutional angle; the task succeeded in uncovering, affirming and working on alcoholism as an illness within the hospital setting, but with less involvement than other local institutions, which motivated projects and strategies started from the results of this research.

"I Have a Love-Hate Relationship with ATLAS.ti"™: Integrating Qualitative Data Analysis Software into a Graduate Research Methods Course

ERIC Educational Resources Information Center

Paulus, Trena M.; Bennett, Ann M.

2017-01-01

While research on teaching qualitative methods in education has increased, few studies explore teaching qualitative data analysis software within graduate-level methods courses. During 2013, we required students in several such courses to use ATLAS.ti™ as a project management tool for their assignments. By supporting students' early experiences…

Co-Designing and Co-Teaching Graduate Qualitative Methods: An Innovative Ethnographic Workshop Model

ERIC Educational Resources Information Center

Cordner, Alissa; Klein, Peter T.; Baiocchi, Gianpaolo

2012-01-01

This article describes an innovative collaboration between graduate students and a faculty member to co-design and co-teach a graduate-level workshop-style qualitative methods course. The goal of co-designing and co-teaching the course was to involve advanced graduate students in all aspects of designing a syllabus and leading class discussions in…

(E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodological Ambiguity in Qualitative Research Projects

ERIC Educational Resources Information Center

Koro-Ljungberg, Mirka; Yendol-Hoppey, Diane; Smith, Jason Jude; Hayes, Sharon B.

2009-01-01

This article explores epistemological awareness and instantiation of methods, as well as uninformed ambiguity, in qualitative methodological decision making and research reporting. The authors argue that efforts should be made to make the research process, epistemologies, values, methodological decision points, and argumentative logic open,…

Screening method to evaluate point-of-care human chorionic gonadotropin (hCG) devices for susceptibility to the hook effect by hCG β core fragment: evaluation of 11 devices.

PubMed

Nerenz, Robert D; Song, Haowei; Gronowski, Ann M

2014-04-01

The predominant hCG variant in urine, hCG β core fragment (hCGβcf), has been demonstrated to cause false-negative results in qualitative point-of-care (POC) hCG devices. This is a major concern for healthcare professionals using POC pregnancy tests. We developed a screening method to evaluate qualitative POC hCG devices for their susceptibility to inhibition by hCGβcf. Using this method, we evaluated the performance of 11 commonly used devices. A wide range of purified hCG and hCGβcf concentrations were mixed and tested on 2 POC devices. By use of those results, a screening method was defined and 9 additional POC devices were evaluated. Two solutions containing (a) 500 pmol/L (171 IU/L) intact hCG with 0 pmol/L hCGβcf and (b) 500 pmol/L intact hCG with 500 000 pmol/L hCGβcf were used to screen all POC devices. The OSOM and Cen-Med Elite devices were found to be most susceptible to false-negative results due to hCGβcf. The BC Icon 20 and the Alere were the least susceptible. The remaining 7 were moderately affected. Devices that gave the strongest signal with hCGβcf alone were those that were least likely to show a hook effect. The screening method put forth here can be used by device users and manufacturers to evaluate POC devices for inhibition by hCGβcf. Of 11 devices evaluated, only 2 have been identified that exhibit minimal to no susceptibility to hCGβcf.

Evaluation of shear wave elastography for differential diagnosis of breast lesions: A new qualitative analysis versus conventional quantitative analysis.

PubMed

Ren, Wei-Wei; Li, Xiao-Long; Wang, Dan; Liu, Bo-Ji; Zhao, Chong-Ke; Xu, Hui-Xiong

2018-04-13

To evaluate a special kind of ultrasound (US) shear wave elastography for differential diagnosis of breast lesions, using a new qualitative analysis (i.e. the elasticity score in the travel time map) compared with conventional quantitative analysis. From June 2014 to July 2015, 266 pathologically proven breast lesions were enrolled in this study. The maximum, mean, median, minimum, and standard deviation of shear wave speed (SWS) values (m/s) were assessed. The elasticity score, a new qualitative feature, was evaluated in the travel time map. The area under the receiver operating characteristic (AUROC) curves were plotted to evaluate the diagnostic performance of both qualitative and quantitative analyses for differentiation of breast lesions. Among all quantitative parameters, SWS-max showed the highest AUROC (0.805; 95% CI: 0.752, 0.851) compared with SWS-mean (0.786; 95% CI:0.732, 0.834; P = 0.094), SWS-median (0.775; 95% CI:0.720, 0.824; P = 0.046), SWS-min (0.675; 95% CI:0.615, 0.731; P = 0.000), and SWS-SD (0.768; 95% CI:0.712, 0.817; P = 0.074). The AUROC of qualitative analysis in this study obtained the best diagnostic performance (0.871; 95% CI: 0.825, 0.909, compared with the best parameter of SWS-max in quantitative analysis, P = 0.011). The new qualitative analysis of shear wave travel time showed the superior diagnostic performance in the differentiation of breast lesions in comparison with conventional quantitative analysis.

Situating methodology within qualitative research.

PubMed

Kramer-Kile, Marnie L

2012-01-01

Qualitative nurse researchers are required to make deliberate and sometimes complex methodological decisions about their work. Methodology in qualitative research is a comprehensive approach in which theory (ideas) and method (doing) are brought into close alignment. It can be difficult, at times, to understand the concept of methodology. The purpose of this research column is to: (1) define qualitative methodology; (2) illuminate the relationship between epistemology, ontology and methodology; (3) explicate the connection between theory and method in qualitative research design; and 4) highlight relevant examples of methodological decisions made within cardiovascular nursing research. Although there is no "one set way" to do qualitative research, all qualitative researchers should account for the choices they make throughout the research process and articulate their methodological decision-making along the way.

PRO development: rigorous qualitative research as the crucial foundation.

PubMed

Lasch, Kathryn Eilene; Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-10-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.

PRO development: rigorous qualitative research as the crucial foundation

PubMed Central

Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-01-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity. PMID:20512662

Focused Group Interviews as an Innovative Quanti-Qualitative Methodology (QQM): Integrating Quantitative Elements into a Qualitative Methodology

ERIC Educational Resources Information Center

Grim, Brian J.; Harmon, Alison H.; Gromis, Judy C.

2006-01-01

There is a sharp divide between quantitative and qualitative methodologies in the social sciences. We investigate an innovative way to bridge this gap that incorporates quantitative techniques into a qualitative method, the "quanti-qualitative method" (QQM). Specifically, our research utilized small survey questionnaires and experiment-like…

Qualitative and quantitative evaluation of some vocal function parameters following fitting of a prosthesis.

PubMed

Cavalot, A L; Palonta, F; Preti, G; Nazionale, G; Ricci, E; Vione, N; Albera, R; Cortesina, G

2001-12-01

The insertion of a prosthesis and restoration with pectoralis major myocutaneous flaps for patients subjected to total pharyngolaryngectomy is a technique now universally accepted; however the literature on the subject is lacking. Our study considers 10 patients subjected to total pharyngolaryngectomy and restoration with pectoralis major myocutaneous flaps who were fitted with vocal function prostheses and a control group of 50 subjects treated with a total laryngectomy without pectoralis major myocutaneous flaps and who were fitted with vocal function prostheses. Specific qualitative and quantitative parameters were compared. The quantitative measurement of the levels of voice intensity and the evaluation of the harmonics-to-noise ratio were not statistically significant (p > 0.05) between the two study groups at either high- or low-volume speech. On the contrary, statistically significant differences were found (p < 0.05) for the basic frequency of both the low and the high volume voice. For the qualitative analysis seven parameters were established for evaluation by trained and untrained listeners: on the basis of these parameters the control group had statistically better voices.

Qualitative Evaluation of a Role Play Bullying Simulation.

PubMed

Gillespie, Gordon L; Brown, Kathryn; Grubb, Paula; Shay, Amy; Montoya, Karen

Bullying against nurses is becoming a pervasive problem. In this article, a role play simulation designed for undergraduate nursing students is described. In addition, the evaluation findings from a subsample of students who participated in a role play simulation addressing bullying behaviors are reported. Focus group sessions were completed with a subset of eight students who participated in the intervention. Sessions were audiorecorded, transcribed verbatim, and analyzed using Colaizzi's procedural steps for qualitative analysis. Themes derived from the data were "The Experience of Being Bullied", "Implementation of the Program", "Desired Outcome of the Program", and "Context of Bullying in the Nursing Profession". Role play simulation was an effective and active learning strategy to diffuse education on bullying in nursing practice. Bullying in nursing was identified as a problem worthy of incorporation into the undergraduate nursing curriculum. To further enhance the learning experience with role play simulation, adequate briefing instructions, opportunity to opt out of the role play, and comprehensive debriefing are essential.

'Stories' or 'snapshots'? A study directed at comparing qualitative and quantitative approaches to curriculum evaluation.

PubMed

Pateman, B; Jinks, A M

1999-01-01

The focus of this paper is a study designed to explore the validity of quantitative approaches of student evaluation in a pre-registration degree programme. As managers of the students' education we were concerned that the quantitative method, which used lecturer criteria, may not fully represent students' views. The approach taken is that of a process-type strategy for curriculum evaluation as described by Parlett and Hamilton (1972). The aim of the study is to produce illuminative data, or students' 'stories' of their educational experiences through use of semi-structured interviews. The results are then compared to the current quantitative measurement tools designed to obtain 'snapshots' of the educational effectiveness of the curriculum. The quantitative measurement tools use Likert scale measurements of teacher-devised criterion statements. The results of the study give a rich source of qualitative data which can be used to inform future curriculum development. However, complete validation of the current quantitative instruments used was not achieved in this study. Student and teacher agendas in respect of important issues pertaining to the course programme were found to differ. Limitations of the study are given. There is discussion of the options open to the management team with regard to future development of curriculum evaluation systems.

Spiraling between qualitative and quantitative data on women's health behaviors: a double helix model for mixed methods.

PubMed

Mendlinger, Sheryl; Cwikel, Julie

2008-02-01

A double helix spiral model is presented which demonstrates how to combine qualitative and quantitative methods of inquiry in an interactive fashion over time. Using findings on women's health behaviors (e.g., menstruation, breast-feeding, coping strategies), we show how qualitative and quantitative methods highlight the theory of knowledge acquisition in women's health decisions. A rich data set of 48 semistructured, in-depth ethnographic interviews with mother-daughter dyads from six ethnic groups (Israeli, European, North African, Former Soviet Union [FSU], American/Canadian, and Ethiopian), plus seven focus groups, provided the qualitative sources for analysis. This data set formed the basis of research questions used in a quantitative telephone survey of 302 Israeli women from the ages of 25 to 42 from four ethnic groups. We employed multiple cycles of data analysis from both data sets to produce a more detailed and multidimensional picture of women's health behavior decisions through a spiraling process.

Patients' perceptions of joint teleconsultations: a qualitative evaluation.

PubMed

Harrison, Robert; Macfarlane, Anne; Murray, Elizabeth; Wallace, Paul

2006-03-01

To determine patient perceptions of joint teleconsultations (JTC), with particular reference to reasons underlying, and factors contributing to, patient satisfaction and dissatisfaction with this mode of health delivery. Telemedicine has been welcomed as one way of improving health-care delivery, by improving patient access to secondary care and specialist services hence widening patient choice, particularly for patients outside major conurbations. However, a recent systematic review found currently available data on patient satisfaction with telemedicine to be methodologically flawed. Qualitative evaluations offer the opportunity to elucidate the details of patient satisfaction with this mode of health-care delivery. Qualitative study using semi-structured interviews. Purposive sample of 28 participants of a major randomized controlled trial (Virtual Outreach study) of JTC conducted in one urban and one rural area in Britain. Joint teleconferenced consultations with the patient, patient's general practitioner (GP), and a hospital specialist. The patient and GP were sited in the local practice, while the hospital specialist was in the hospital outpatient department, and the two parties were connected by an ISDN2 link and video-conferencing software. Patient experiences of JTC, with particular reference to reasons underlying, and factors contributing to, overall satisfaction or dissatisfaction. Two major themes were identified: customer care and doctor-patient interaction. Patients appreciated the customer care aspects of JTC, particularly the enhanced convenience, reduced costs and improved punctuality associated with JTC. However, there were divergent views about the doctor-patient interactions with some patients expressing a sense of alienation arising from the use of technology, and problems with doctor-patient communication. These data add significantly to the existing literature on patient satisfaction with telemedicine, by elucidating the factors underlying

Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays

PubMed Central

Guetterman, Timothy C.; Fetters, Michael D.; Creswell, John W.

2015-01-01

PURPOSE Mixed methods research is becoming an important methodology to investigate complex health-related topics, yet the meaningful integration of qualitative and quantitative data remains elusive and needs further development. A promising innovation to facilitate integration is the use of visual joint displays that bring data together visually to draw out new insights. The purpose of this study was to identify exemplar joint displays by analyzing the various types of joint displays being used in published articles. METHODS We searched for empirical articles that included joint displays in 3 journals that publish state-of-the-art mixed methods research. We analyzed each of 19 identified joint displays to extract the type of display, mixed methods design, purpose, rationale, qualitative and quantitative data sources, integration approaches, and analytic strategies. Our analysis focused on what each display communicated and its representation of mixed methods analysis. RESULTS The most prevalent types of joint displays were statistics-by-themes and side-by-side comparisons. Innovative joint displays connected findings to theoretical frameworks or recommendations. Researchers used joint displays for convergent, explanatory sequential, exploratory sequential, and intervention designs. We identified exemplars for each of these designs by analyzing the inferences gained through using the joint display. Exemplars represented mixed methods integration, presented integrated results, and yielded new insights. CONCLUSIONS Joint displays appear to provide a structure to discuss the integrated analysis and assist both researchers and readers in understanding how mixed methods provides new insights. We encourage researchers to use joint displays to integrate and represent mixed methods analysis and discuss their value. PMID:26553895

Mentoring doctoral students for qualitative research: interviews with experienced nursing faculty in Japan.

PubMed

Kayama, Mami; Gregg, Misuzu F; Asahara, Kiyomi; Yamamoto-Mitani, Noriko; Okuma, Keiko; Ohta, Kikuko; Kinoshita, Yasuhito

2013-05-01

This study aimed to describe the process of mentoring doctoral students for qualitative research in Japanese graduate programs in nursing. Nine experienced faculty-seven nurse researchers and two sociologists-were interviewed. Participants were asked about their process of mentoring students for qualitative nursing dissertations. Data analysis was conducted using a qualitative descriptive method. Participants' age ranged from 48 to 60 years. The first theme in the mentoring process is about the individualized, one-on-one mentorship process. The second theme occurs in a group process. The third theme is coordinating mentors and establishing a network to support the evaluation system. The mentoring processes identified in this study will be useful for future faculty development. The study elucidated much room for improvement in doctoral education programs for qualitative research methods in nursing science. Copyright 2013, SLACK Incorporated.

Qualitative research in palliative care 1990-1999: a descriptive review.

PubMed

Froggatt, Katherine A; Field, David; Bailey, Chris; Krishnasamy, Meinir

2003-03-01

A collaborative, evaluative review of qualitative research in palliative care published between 1990 and 1999 has been conducted. Nearly 30,000 articles in 48 journals from specialist palliative care, oncology, death studies, medicine, nursing, gerontology, health and the social sciences were examined. From these journals, 138 articles (0.5%) reporting qualitative research with a focus on palliative care in the context of death, dying or bereavement were identified. These articles were reviewed using a proforma designed by the group. This article describes the review process, and the following findings: the distribution of different forms of qualitative research in palliative care; the location of such papers; the focus of the research; and the research methodology and methods adopted.

The relevance of qualitative research for clinical programs in psychiatry.

PubMed

Goering, Paula; Boydell, Katherine M; Pignatiello, Antonio

2008-03-01

It is time to move beyond education about qualitative research theory and methods to using them to understand and improve psychiatric practice. There is a good fit between this agenda and current thinking about research use that broadens definitions of evidence beyond the results of experiments. This paper describes a qualitative program evaluation to illustrate what kind of useful knowledge is generated and how it can be created through a clinician-researcher partnership. The linkage and exchange model of effective knowledge translation described involves interaction between clinicians and researchers throughout the research process and results in mutual learning through the planning, disseminating, and application of existing or new qualitative research in decision making.

Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays.

PubMed

Guetterman, Timothy C; Fetters, Michael D; Creswell, John W

2015-11-01

Mixed methods research is becoming an important methodology to investigate complex health-related topics, yet the meaningful integration of qualitative and quantitative data remains elusive and needs further development. A promising innovation to facilitate integration is the use of visual joint displays that bring data together visually to draw out new insights. The purpose of this study was to identify exemplar joint displays by analyzing the various types of joint displays being used in published articles. We searched for empirical articles that included joint displays in 3 journals that publish state-of-the-art mixed methods research. We analyzed each of 19 identified joint displays to extract the type of display, mixed methods design, purpose, rationale, qualitative and quantitative data sources, integration approaches, and analytic strategies. Our analysis focused on what each display communicated and its representation of mixed methods analysis. The most prevalent types of joint displays were statistics-by-themes and side-by-side comparisons. Innovative joint displays connected findings to theoretical frameworks or recommendations. Researchers used joint displays for convergent, explanatory sequential, exploratory sequential, and intervention designs. We identified exemplars for each of these designs by analyzing the inferences gained through using the joint display. Exemplars represented mixed methods integration, presented integrated results, and yielded new insights. Joint displays appear to provide a structure to discuss the integrated analysis and assist both researchers and readers in understanding how mixed methods provides new insights. We encourage researchers to use joint displays to integrate and represent mixed methods analysis and discuss their value. © 2015 Annals of Family Medicine, Inc.

The role of economic evaluation in the decision-making process of family physicians: design and methods of a qualitative embedded multiple-case study

PubMed Central

Lessard, Chantale; Contandriopoulos, André-Pierre; Beaulieu, Marie-Dominique

2009-01-01

Background A considerable amount of resource allocation decisions take place daily at the point of the clinical encounter; especially in primary care, where 80 percent of health problems are managed. Ignoring economic evaluation evidence in individual clinical decision-making may have a broad impact on the efficiency of health services. To date, almost all studies on the use of economic evaluation in decision-making used a quantitative approach, and few investigated decision-making at the clinical level. An important question is whether economic evaluations affect clinical practice. The project is an intervention research study designed to understand the role of economic evaluation in the decision-making process of family physicians (FPs). The contributions of the project will be from the perspective of Pierre Bourdieu's sociological theory. Methods/design A qualitative research strategy is proposed. We will conduct an embedded multiple-case study design. Ten case studies will be performed. The FPs will be the unit of analysis. The sampling strategies will be directed towards theoretical generalization. The 10 selected cases will be intended to reflect a diversity of FPs. There will be two embedded units of analysis: FPs (micro-level of analysis) and field of family medicine (macro-level of analysis). The division of the determinants of practice/behaviour into two groups, corresponding to the macro-structural level and the micro-individual level, is the basis for Bourdieu's mode of analysis. The sources of data collection for the micro-level analysis will be 10 life history interviews with FPs, documents and observational evidence. The sources of data collection for the macro-level analysis will be documents and 9 open-ended, focused interviews with key informants from medical associations and academic institutions. The analytic induction approach to data analysis will be used. A list of codes will be generated based on both the original framework and new themes

Rationale, design and methods for process evaluation in the HEALTHY study.

PubMed

Schneider, M; Hall, W J; Hernandez, A E; Hindes, K; Montez, G; Pham, T; Rosen, L; Sleigh, A; Thompson, D; Volpe, S L; Zeveloff, A; Steckler, A

2009-08-01

The HEALTHY study was a multi-site randomized trial designed to determine whether a 3-year school-based intervention targeting nutrition and physical activity behaviors could effectively reduce risk factors associated with type 2 diabetes in middle school children. Pilot and formative studies were conducted to inform the development of the intervention components and the process evaluation methods for the main trial. During the main trial, both qualitative and quantitative assessments monitored the fidelity of the intervention and motivated modifications to improve intervention delivery. Structured observations of physical education classes, total school food environments, classroom-based educational modules, and communications and promotional campaigns provided verification that the intervention was delivered as intended. Interviews and focus groups yielded a multidimensional assessment of how the intervention was delivered and received, as well as identifying the barriers to and facilitators of the intervention across and within participating schools. Interim summaries of process evaluation data were presented to the study group as a means of ensuring standardization and quality of the intervention across the seven participating centers. Process evaluation methods and procedures documented the fidelity with which the HEALTHY study was implemented across 21 intervention schools and identified ways in which the intervention delivery might be enhanced throughout the study.

Impact of the Macmillan specialist Care at Home service: a mixed methods evaluation across six sites.

PubMed

Johnston, Bridget; Patterson, Anne; Bird, Lydia; Wilson, Eleanor; Almack, Kathryn; Mathews, Gillian; Seymour, Jane

2018-02-23

The Midhurst Macmillan Specialist Palliative Care at Home Service was founded in 2006 to improve community-based palliative care provision. Principal components include; early referral; home-based clinical interventions; close partnership working; and flexible teamwork. Following a successful introduction, the model was implemented in six further sites across England. This article reports a mixed methods evaluation of the implementation across these 'Innovation Centres'. The evaluation aimed to assess the process and impact on staff, patients and carers of providing Macmillan Specialist Care at Home services across the six sites. The study was set within a Realist Evaluation framework and used a longitudinal, mixed methods research design. Data collection over 15 months (2014-2016) included: Quantitative outcome measures - Palliative Performance Scale [PPS] and Palliative Prognostic Index [PPI] (n = 2711); Integrated Palliative Outcome Scales [IPOS] (n = 1157); Carers Support Needs Assessment Tool [CSNAT] (n = 241); Views of Informal Carers -Evaluation of Services [VOICES-SF] (n = 102); a custom-designed Service Data Tool [SDT] that gathered prospective data from each site (n = 88). Qualitative data methods included: focus groups with project team and staff (n = 32 groups with n = 190 participants), and, volunteers (n = 6 groups with n = 32 participants). Quantitative data were analysed using SPPS Vs. 21 and qualitative data was examined via thematic analysis. Comparison of findings across the six sites revealed the impact of their unique configurations on outcomes, compounded by variations in stage and mode of implementation. PPS, PPI and IPOS data revealed disparity in early referral criteria, complicated by contrasting interpretations of palliative care. The qualitative analysis, CSNAT and VOICES-SF data confirmed the value of the Macmillan model of care but uptake of specialist home-based clinical interventions was limited. The

Methods and Management of the Healthy Brain Study: A Large Multisite Qualitative Research Project

ERIC Educational Resources Information Center

Laditka, Sarah B.; Corwin, Sara J.; Laditka, James N.; Liu, Rui; Friedman, Daniela B.; Mathews, Anna E.; Wilcox, Sara

2009-01-01

Purpose of the study: To describe processes used in the Healthy Brain project to manage data collection, coding, and data distribution in a large qualitative project, conducted by researchers at 9 universities in 9 states. Design and Methods: Project management protocols included: (a) managing audiotapes and surveys to ensure data confidentiality,…

Writing Our Way into Shared Understanding: Collaborative Autobiographical Writing in the Qualitative Methods Class

ERIC Educational Resources Information Center

Lapadat, Judith C.

2009-01-01

From her experience as an instructor, the author finds that it is valuable to engage graduate students in conducting a study within their qualitative methods course. In this article, the author discusses how she used a collaborative autobiographical research approach. Class members generate autobiographical writing to be shared with the group, and…

Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations.

PubMed

Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C

2015-03-10

In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross

Improving Foster Parent Engagement: Using Qualitative Methods to Guide Tailoring of Evidence-based Engagement Strategies

PubMed Central

Conover, Kate L.; Cox, Julia Revillion

2014-01-01

Objective This qualitative study examined applicability and need for tailoring of an evidence-based engagement intervention, combined with Trauma-focused Cognitive Behavioral Therapy, for foster parents. Method Qualitative methods were used, including individual interviews with participating foster parents (N = 7), review of interview findings with an independent group of foster parents (N = 5), and review of the combined foster parent findings by child welfare caseworkers (N = 5), an important stakeholder group. Results The engagement intervention, with its primary focus on perceptual barriers (e.g., past experiences with mental health), was relevant for the foster care population. However, the study identified areas for tailoring to better recognize and address the unique needs and situation of foster parents as substitute caregivers. Conclusions Perceptually-focused engagement interventions may have broad applicability to a range of populations, including foster parents, with the potential for improving caregiver participation in children’s mental health services. PMID:24611600

Reconciling incongruous qualitative and quantitative findings in mixed methods research: exemplars from research with drug using populations.

PubMed

Wagner, Karla D; Davidson, Peter J; Pollini, Robin A; Strathdee, Steffanie A; Washburn, Rachel; Palinkas, Lawrence A

2012-01-01

Mixed methods research is increasingly being promoted in the health sciences as a way to gain more comprehensive understandings of how social processes and individual behaviours shape human health. Mixed methods research most commonly combines qualitative and quantitative data collection and analysis strategies. Often, integrating findings from multiple methods is assumed to confirm or validate the findings from one method with the findings from another, seeking convergence or agreement between methods. Cases in which findings from different methods are congruous are generally thought of as ideal, whilst conflicting findings may, at first glance, appear problematic. However, the latter situation provides the opportunity for a process through which apparently discordant results are reconciled, potentially leading to new emergent understandings of complex social phenomena. This paper presents three case studies drawn from the authors' research on HIV risk amongst injection drug users in which mixed methods studies yielded apparently discrepant results. We use these case studies (involving injection drug users [IDUs] using a Needle/Syringe Exchange Program in Los Angeles, CA, USA; IDUs seeking to purchase needle/syringes at pharmacies in Tijuana, Mexico; and young street-based IDUs in San Francisco, CA, USA) to identify challenges associated with integrating findings from mixed methods projects, summarize lessons learned, and make recommendations for how to more successfully anticipate and manage the integration of findings. Despite the challenges inherent in reconciling apparently conflicting findings from qualitative and quantitative approaches, in keeping with others who have argued in favour of integrating mixed methods findings, we contend that such an undertaking has the potential to yield benefits that emerge only through the struggle to reconcile discrepant results and may provide a sum that is greater than the individual qualitative and quantitative parts

Reconciling incongruous qualitative and quantitative findings in mixed methods research: exemplars from research with drug using populations

PubMed Central

Wagner, Karla D.; Davidson, Peter J.; Pollini, Robin A.; Strathdee, Steffanie A.; Washburn, Rachel; Palinkas, Lawrence A.

2011-01-01

Mixed methods research is increasingly being promoted in the health sciences as a way to gain more comprehensive understandings of how social processes and individual behaviours shape human health. Mixed methods research most commonly combines qualitative and quantitative data collection and analysis strategies. Often, integrating findings from multiple methods is assumed to confirm or validate the findings from one method with the findings from another, seeking convergence or agreement between methods. Cases in which findings from different methods are congruous are generally thought of as ideal, while conflicting findings may, at first glance, appear problematic. However, the latter situation provides the opportunity for a process through which apparently discordant results are reconciled, potentially leading to new emergent understandings of complex social phenomena. This paper presents three case studies drawn from the authors’ research on HIV risk among injection drug users in which mixed methods studies yielded apparently discrepant results. We use these case studies (involving injection drug users [IDUs] using a needle/syringe exchange program in Los Angeles, California, USA; IDUs seeking to purchase needle/syringes at pharmacies in Tijuana, Mexico; and young street-based IDUs in San Francisco, CA, USA) to identify challenges associated with integrating findings from mixed methods projects, summarize lessons learned, and make recommendations for how to more successfully anticipate and manage the integration of findings. Despite the challenges inherent in reconciling apparently conflicting findings from qualitative and quantitative approaches, in keeping with others who have argued in favour of integrating mixed methods findings, we contend that such an undertaking has the potential to yield benefits that emerge only through the struggle to reconcile discrepant results and may provide a sum that is greater than the individual qualitative and quantitative

The Use of Quantitative and Qualitative Methods in the Analysis of Academic Achievement among Undergraduates in Jamaica

ERIC Educational Resources Information Center

McLaren, Ingrid Ann Marie

2012-01-01

This paper describes a study which uses quantitative and qualitative methods in determining the relationship between academic, institutional and psychological variables and degree performance for a sample of Jamaican undergraduate students. Quantitative methods, traditionally associated with the positivist paradigm, and involving the counting and…

Asthma education: different viewpoints elicited by qualitative and quantitative methods.

PubMed

Damon, Scott A; Tardif, Richard R

2015-04-01

This project began as a qualitative examination of how asthma education provided by health professionals could be improved. Unexpected qualitative findings regarding the use of Asthma Action Plans and the importance of insurance reimbursement for asthma education prompted further quantitative examination. Qualitative individual interviews were conducted with primary care physicians in private practice who routinely provide initial diagnoses of asthma and focus groups were conducted with other clinicians in private primary care practices who routinely provide asthma education. Using the DocStyles quantitative tool two questions regarding Asthma Action Plans and insurance reimbursement were asked of a representative sample of physicians and other clinicians. The utility of Asthma Action Plans was questioned in the 2012 qualitative study. Qualitative findings also raised questions regarding whether reimbursement is the barrier to asthma education for patients performed by medical professionals it is thought to be. 2013 quantitative findings show that the majority of clinicians see Asthma Action Plans as useful. The question of whether reimbursement is a barrier to providing asthma education to patients was not resolved by the quantitative data. The majority of clinicians see Asthma Action Plans as a useful tool for patient education. Clinicians had less clear opinions on whether the lack of defined reimbursement codes acted as a barrier to asthma education. The study also provided useful audience data for design of new asthma educational tools developed by CDC.

Post-16 Physics and Chemistry Uptake: Combining Large-Scale Secondary Analysis with In-Depth Qualitative Methods

ERIC Educational Resources Information Center

Hampden-Thompson, Gillian; Lubben, Fred; Bennett, Judith

2011-01-01

Quantitative secondary analysis of large-scale data can be combined with in-depth qualitative methods. In this paper, we discuss the role of this combined methods approach in examining the uptake of physics and chemistry in post compulsory schooling for students in England. The secondary data analysis of the National Pupil Database (NPD) served…

The quantitative and qualitative recovery of Campylobacter from raw poultry using USDA and Health Canada methods.

PubMed

Sproston, E L; Carrillo, C D; Boulter-Bitzer, J

2014-12-01

Harmonisation of methods between Canadian government agencies is essential to accurately assess and compare the prevalence and concentrations present on retail poultry intended for human consumption. The standard qualitative procedure used by Health Canada differs to that used by the USDA for both quantitative and qualitative methods. A comparison of three methods was performed on raw poultry samples obtained from an abattoir to determine if one method is superior to the others in isolating Campylobacter from chicken carcass rinses. The average percent of positive samples was 34.72% (95% CI, 29.2-40.2), 39.24% (95% CI, 33.6-44.9), 39.93% (95% CI, 34.3-45.6) for the direct plating US method and the US enrichment and Health Canada enrichment methods, respectively. Overall there were significant differences when comparing either of the enrichment methods to the direct plating method using the McNemars chi squared test. On comparison of weekly data (Fishers exact test) direct plating was only inferior to the enrichment methods on a single occasion. Direct plating is important for enumeration and establishing the concentration of Campylobacter present on raw poultry. However, enrichment methods are also vital to identify positive samples where concentrations are below the detection limit for direct plating. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

Using Qualitative Research to Inform Development of Professional Guidelines: A Case Study of the Society of Critical Care Medicine Family-Centered Care Guidelines.

PubMed

Coombs, Maureen A; Davidson, Judy E; Nunnally, Mark E; Wickline, Mary A; Curtis, J Randall

2017-08-01

To explore the importance, challenges, and opportunities using qualitative research to enhance development of clinical practice guidelines, using recent guidelines for family-centered care in the ICU as an example. In developing the Society of Critical Care Medicine guidelines for family-centered care in the neonatal ICU, PICU, and adult ICU, we developed an innovative adaptation of the Grading of Recommendations, Assessments, Development and Evaluations approach to explicitly incorporate qualitative research. Using Grading of Recommendations, Assessments, Development and Evaluations and the Council of Medical Specialty Societies principles, we conducted a systematic review of qualitative research to establish family-centered domains and outcomes. Thematic analyses were undertaken on study findings and used to support Population, Intervention, Comparison, Outcome question development. We identified and employed three approaches using qualitative research in these guidelines. First, previously published qualitative research was used to identify important domains for the Population, Intervention, Comparison, Outcome questions. Second, this qualitative research was used to identify and prioritize key outcomes to be evaluated. Finally, we used qualitative methods, member checking with patients and families, to validate the process and outcome of the guideline development. In this, a novel report, we provide direction for standardizing the use of qualitative evidence in future guidelines. Recommendations are made to incorporate qualitative literature review and appraisal, include qualitative methodologists in guideline taskforce teams, and develop training for evaluation of qualitative research into guideline development procedures. Effective methods of involving patients and families as members of guideline development represent opportunities for future work.

Introducing dyadic interviews as a method for collecting qualitative data.

PubMed

Morgan, David L; Ataie, Jutta; Carder, Paula; Hoffman, Kim

2013-09-01

In dyadic interviews, two participants interact in response to open-ended research questions. There are few precedents for using dyadic interviews as a technique for qualitative research. We introduce this method largely in comparison to focus groups, because both represent forms of interactive interviewing. We do not, however, view dyadic interviews as miniature focus groups, and treat them as generating their own opportunities and issues. To illustrate the nature of dyadic interviewing, we present summaries of three studies using this method. In the first study, we used dyadic interviews and photovoice techniques to examine experiences of people with early-stage dementia. In the second study, we explored the experiences of staff who provided services to elderly housing residents. In the third study, we examined barriers and facilitators to substance abuse treatment among Asian Americans and Pacific Islanders in Hawaii. We conclude with a discussion of directions for future research using dyadic interviews.

A novel evaluation method for building construction project based on integrated information entropy with reliability theory.

PubMed

Bai, Xiao-ping; Zhang, Xi-wei

2013-01-01

Selecting construction schemes of the building engineering project is a complex multiobjective optimization decision process, in which many indexes need to be selected to find the optimum scheme. Aiming at this problem, this paper selects cost, progress, quality, and safety as the four first-order evaluation indexes, uses the quantitative method for the cost index, uses integrated qualitative and quantitative methodologies for progress, quality, and safety indexes, and integrates engineering economics, reliability theories, and information entropy theory to present a new evaluation method for building construction project. Combined with a practical case, this paper also presents detailed computing processes and steps, including selecting all order indexes, establishing the index matrix, computing score values of all order indexes, computing the synthesis score, sorting all selected schemes, and making analysis and decision. Presented method can offer valuable references for risk computing of building construction projects.

Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews

PubMed Central

Lucas, Patricia J; Baird, Janis; Arai, Lisa; Law, Catherine; Roberts, Helen M

2007-01-01

Background The inclusion of qualitative studies in systematic reviews poses methodological challenges. This paper presents worked examples of two methods of data synthesis (textual narrative and thematic), used in relation to one review, with the aim of enabling researchers to consider the strength of different approaches. Methods A systematic review of lay perspectives of infant size and growth was conducted, locating 19 studies (including both qualitative and quantitative). The data extracted from these were synthesised using both a textual narrative and a thematic synthesis. Results The processes of both methods are presented, showing a stepwise progression to the final synthesis. Both methods led us to similar conclusions about lay views toward infant size and growth. Differences between methods lie in the way they dealt with study quality and heterogeneity. Conclusion On the basis of the work reported here, we consider textual narrative and thematic synthesis have strengths and weaknesses in relation to different research questions. Thematic synthesis holds most potential for hypothesis generation, but may obscure heterogeneity and quality appraisal. Textual narrative synthesis is better able to describe the scope of existing research and account for the strength of evidence, but is less good at identifying commonality. PMID:17224044

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A

Rethinking a Case Study Method in Educational Research: A Comparative Analysis Method in Qualitative Research

ERIC Educational Resources Information Center

Murakami, Yusuke

2013-01-01

There are two types of qualitative research that analyze a small number of cases or a single case: idiographic differentiation and nomothetic/generalization. There are few case studies of generalization. This is because theoretical inclination is weak in the field of education, and the binary framework of quantitative versus qualitative research…

Influence on Learning of a Collaborative Learning Method Comprising the Jigsaw Method and Problem-based Learning (PBL).

PubMed

Takeda, Kayoko; Takahashi, Kiyoshi; Masukawa, Hiroyuki; Shimamori, Yoshimitsu

2017-01-01

Recently, the practice of active learning has spread, increasingly recognized as an essential component of academic studies. Classes incorporating small group discussion (SGD) are conducted at many universities. At present, assessments of the effectiveness of SGD have mostly involved evaluation by questionnaires conducted by teachers, by peer assessment, and by self-evaluation of students. However, qualitative data, such as open-ended descriptions by students, have not been widely evaluated. As a result, we have been unable to analyze the processes and methods involved in how students acquire knowledge in SGD. In recent years, due to advances in information and communication technology (ICT), text mining has enabled the analysis of qualitative data. We therefore investigated whether the introduction of a learning system comprising the jigsaw method and problem-based learning (PBL) would improve student attitudes toward learning; we did this by text mining analysis of the content of student reports. We found that by applying the jigsaw method before PBL, we were able to improve student attitudes toward learning and increase the depth of their understanding of the area of study as a result of working with others. The use of text mining to analyze qualitative data also allowed us to understand the processes and methods by which students acquired knowledge in SGD and also changes in students' understanding and performance based on improvements to the class. This finding suggests that the use of text mining to analyze qualitative data could enable teachers to evaluate the effectiveness of various methods employed to improve learning.

Qualitative Evaluation of a Role Play Bullying Simulation

PubMed Central

Gillespie, Gordon L.; Brown, Kathryn; Grubb, Paula; Shay, Amy; Montoya, Karen

2015-01-01

Bullying against nurses is becoming a pervasive problem. In this article, a role play simulation designed for undergraduate nursing students is described. In addition, the evaluation findings from a subsample of students who participated in a role play simulation addressing bullying behaviors are reported. Focus group sessions were completed with a subset of eight students who participated in the intervention. Sessions were audiorecorded, transcribed verbatim, and analyzed using Colaizzi’s procedural steps for qualitative analysis. Themes derived from the data were “The Experience of Being Bullied”, “Implementation of the Program”, “Desired Outcome of the Program”, and “Context of Bullying in the Nursing Profession”. Role play simulation was an effective and active learning strategy to diffuse education on bullying in nursing practice. Bullying in nursing was identified as a problem worthy of incorporation into the undergraduate nursing curriculum. To further enhance the learning experience with role play simulation, adequate briefing instructions, opportunity to opt out of the role play, and comprehensive debriefing are essential. PMID:26504502

Academic Impact of Qualitative Studies in Healthcare: Bibliometric Analysis

PubMed Central

Mori, Hiroko; Nakayama, Takeo

2013-01-01

Context Although qualitative studies are becoming more appreciated in healthcare, the number of publications of quality studies remains low. Little is known about the frequency and characteristics of citation in qualitative studies. Objective To compare the academic impact of qualitative studies to that of two quantitative studies: systematic reviews and randomized controlled trials. Methods Publications in BMJ between 1997 and 2006 (BMJ’s median impact factor was 7.04 during this period) employing qualitative methods were matched to two quantitative studies appearing the same year using PubMed. Using Web of Science, citations within a 24-month publication period were determined. Additionally, three hypotheses were examined: qualitative studies are 1) infrequently cited in original articles or reviews; 2) rarely cited by authors in non-English-speaking countries; and 3) more frequently cited in non-medical disciplines (e.g., psychology or sociology). Results A total of 121 qualitative studies, 270 systematic reviews, and 515 randomised controlled trials were retrieved. Qualitative studies were cited a total of 1,089 times, with a median of 7.00 times (range, 0–34) for each study. Matched systematic reviews and randomized controlled trials were cited 2,411times and 1,600 times, respectively. With respect to citing documents, original articles and reviews exceeded 60% for each study design. Relative to quantitative studies, qualitative studies were cited more often by authors in English-speaking countries. With respect to subject area, medical disciplines were more frequently cited than non-medical disciplines for all three study designs (>80%). Conclusion The median number of citations for qualitative studies was almost the same as the median of BMJ’s impact factor during the survey period. For a suitable evaluation of qualitative studies in healthcare, it will be necessary to develop a reporting framework and include explicit discussions of clinical

Qualitative methods in health services and management research: pockets of excellence and progress, but still a long way to go.

PubMed

Devers, Kelly J

2011-02-01

The 10-year systematic review of published health services and management research by Weiner et al. (2011) chronicles the contributions of qualitative methods, highlights areas of substantial progress, and identifies areas in need of more progress. This article (Devers, 2011) discusses possible reasons for lack of progress in some areas--related to the under-supply of well-trained qualitative researchers and more tangible demand for their research--and mechanisms for future improvement. To ensure a robust health services research toolbox, the field must take additional steps to provide stronger education and training in qualitative methods and more funding and publication opportunities. Given the rapidly changing health care system post the passage of national health reform and the chalresearch issues associated with it, the health services research and management field will not meet its future challenges with quantitative methods alone or with a half-empty toolbox.