Making Sense of Alternative Assessment in a Qualitative Evaluation System

ERIC Educational Resources Information Center

Rojas Serrano, Javier

2017-01-01

In a Colombian private English institution, a qualitative evaluation system has been incorporated. This type of evaluation poses challenges to students who have never been evaluated through a system that eliminates exams or quizzes and, as a consequence, these students have to start making sense of it. This study explores the way students face the…

Online versus Paper Evaluations: Differences in Both Quantitative and Qualitative Data

ERIC Educational Resources Information Center

Burton, William B.; Civitano, Adele; Steiner-Grossman, Penny

2012-01-01

This study sought to determine if differences exist in the quantitative and qualitative data collected with paper and online versions of a medical school clerkship evaluation form. Data from six-and-a-half years of clerkship evaluations were used, some collected before and some after the conversion from a paper to an online evaluation system. The…

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed

Devers, K J

1999-12-01

To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. Existing literature in the social sciences and health services research, particularly in primary care and medicine. Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results.

Reported credibility techniques in higher education evaluation studies that use qualitative methods: A research synthesis.

PubMed

Liao, Hongjing; Hitchcock, John

2018-06-01

This synthesis study examined the reported use of credibility techniques in higher education evaluation articles that use qualitative methods. The sample included 118 articles published in six leading higher education evaluation journals from 2003 to 2012. Mixed methods approaches were used to identify key credibility techniques reported across the articles, document the frequency of these techniques, and describe their use and properties. Two broad sets of techniques were of interest: primary design techniques (i.e., basic), such as sampling/participant recruitment strategies, data collection methods, analytic details, and additional qualitative credibility techniques (e.g., member checking, negative case analyses, peer debriefing). The majority of evaluation articles reported use of primary techniques although there was wide variation in the amount of supporting detail; most of the articles did not describe the use of additional credibility techniques. This suggests that editors of evaluation journals should encourage the reporting of qualitative design details and authors should develop strategies yielding fuller methodological description. Copyright © 2018 Elsevier Ltd. All rights reserved.

Shifting Practices in Teacher Performance Evaluation: A Qualitative Examination of Administrator Change Readiness

ERIC Educational Resources Information Center

Spina, Nancy; Buckley, Phillip; Puchner, Laurel

2014-01-01

This study examines the perceptions, attitudes and beliefs of administrators and teachers in a Southwestern Illinois School District regarding the recent reforms in teacher performance evaluation. This study uses a qualitative approach and provides data from individual and focus group interviews to determine the extent to which the district is…

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Quality dimensions in health evaluation: manager's conceptions.

PubMed

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed Central

Devers, K J

1999-01-01

OBJECTIVE: To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. DATA SOURCES: Existing literature in the social sciences and health services research, particularly in primary care and medicine. PRINCIPAL FINDING: Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. CONCLUSION: The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results. Images Figure 1 PMID:10591278

Challenges of teacher-based clinical evaluation from nursing students' point of view: Qualitative content analysis.

PubMed

Sadeghi, Tabandeh; Seyed Bagheri, Seyed Hamid

2017-01-01

Clinical evaluation is very important in the educational system of nursing. One of the most common methods of clinical evaluation is evaluation by the teacher, but the challenges that students would face in this evaluation method, have not been mentioned. Thus, this study aimed to explore the experiences and views of nursing students about the challenges of teacher-based clinical evaluation. This study was a descriptive qualitative study with a qualitative content analysis approach. Data were gathered through semi-structured focused group sessions with undergraduate nursing students who were passing their 8 th semester at Rafsanjan University of Medical Sciences. Date were analyzed using Graneheim and Lundman's proposed method. Data collection and analysis were concurrent. According to the findings, "factitious evaluation" was the main theme of study that consisted of three categories: "Personal preferences," "unfairness" and "shirking responsibility." These categories are explained using quotes derived from the data. According to the results of this study, teacher-based clinical evaluation would lead to factitious evaluation. Thus, changing this approach of evaluation toward modern methods of evaluation is suggested. The finding can help nursing instructors to get a better understanding of the nursing students' point of view toward this evaluation approach and as a result could be planning for changing of this approach.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses.

PubMed

Flemming, Kate; Booth, Andrew; Hannes, Karin; Cargo, Margaret; Noyes, Jane

2018-05-01

To outline contemporary and novel developments for the presentation and reporting of syntheses of qualitative, implementation, and process evaluation evidence and provide recommendations for the use of reporting guidelines. An overview of reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses drawing on current international literature and the collective expert knowledge of the Cochrane Qualitative and Implementation Methods Group. Several reporting guidelines exist that can be used or adapted to report syntheses of qualitative, implementation, and process evaluation evidence. Methods to develop individual guidance varied. The use of a relevant reporting guideline can enhance the transparency, consistency, and quality of reporting. Guidelines that exist are generic, method specific, and for particular aspects of the reviewing process, searching. Caution is expressed over the potential for reporting guidelines to produce a mechanistic approach moving the focus away from the content and toward the procedural aspects of the review. The use of a reporting guideline is recommended and a five-step decision flowchart to guide the choice of reporting guideline is provided. Gaps remain in method-specific reporting guidelines such as mixed-study, implementation, and process evaluation evidence syntheses. Copyright © 2017 Elsevier Inc. All rights reserved.

Residential Wilderness Programs: The Role of Social Support in Influencing Self-Evaluations of Male Adolescents

ERIC Educational Resources Information Center

Cook, Emily C.

2008-01-01

This qualitative study explores the aspects of a residential wilderness experience that informed self-evaluations in male adolescents, ages 12-16. To assess change in self-evaluations and program factors associated with change, qualitative interviews were conducted with adolescents upon entry to the program and four months later. Participants'…

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Commentary: Writing and Evaluating Qualitative Research Reports.

PubMed

Wu, Yelena P; Thompson, Deborah; Aroian, Karen J; McQuaid, Elizabeth L; Deatrick, Janet A

2016-06-01

To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field's ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A comparison between findings from the DREEM questionnaire and that from qualitative interviews.

PubMed

Denz-Penhey, Harriet; Murdoch, J Campbell

2009-10-01

The Rural Clinical School of Western Australia educates one quarter of all Western Australian medical students in their first clinical year in rural settings. As part of a comprehensive evaluation programme students give feedback regularly. To identify if the Dundee Ready Education Environment Measurement (DREEM) data could be used qualitatively and descriptively to determine specific problems from the data alone despite the small numbers at some sites. The DREEM questionnaire was administered on the same day as qualitative interviews were undertaken. The qualitative interviews were analysed thematically first and then compared with findings from DREEM. Each major (student related) evaluation issue identified by the qualitative interviews was also identified by the DREEM questionnaire analysis. When the DREEM study was undertaken in the Rural Clinical School of Western Australia there was no real expectation that it would provide sufficient information to identify issues picked up in the extensive and time consuming qualitative study. About half of the work undertaken by the qualitative evaluation, that of the experiences of the students at the site, was picked up by the DREEM questionnaire in a much shorter time frame and at less cost of staff time and resources. The DREEM questionnaire can be used qualitatively to assess very specific issues relating to each of the subscales. These findings extend the use of DREEM from quantitative and statistically significant research to qualitative meaning-filled interpretations. The issues then need to be addressed sensitively.

Formative Qualitative Evaluation for "Exploratory" ITS Research.

ERIC Educational Resources Information Center

Murray, Tom

1993-01-01

Discusses evaluation methods applicable to exploratory research areas, provides an overview of qualitative and formative methods for exploratory research on intelligent tutoring systems (ITS) and describes an exploratory study in ITS knowledge acquisition which involved working with three educators to build an ITS for high school physics.…

A Qualitative Evaluation of Instructors' Exam Questions at a Primary Education Department in Terms of Certain Variables

ERIC Educational Resources Information Center

Demir, Mehmet Kaan; Eryaman, Mustafa Yunus

2012-01-01

The purpose of this qualitative research study is to analyze instructors' exam questions at a Primary Education Department in terms of the exam's period, the comprehensibility of the instructions, cognitive level, and the appropriateness to the critical thinking. This qualitative study is based on document analysis method. 100 randomly selected…

Peer support for parents of children with chronic disabling conditions: a systematic review of quantitative and qualitative studies.

PubMed

Shilling, Val; Morris, Christopher; Thompson-Coon, Jo; Ukoumunne, Obioha; Rogers, Morwenna; Logan, Stuart

2013-07-01

To review the qualitative and quantitative evidence of the benefits of peer support for parents of children with disabling conditions in the context of health, well-being, impact on family, and economic and service implications. We comprehensively searched multiple databases. Eligible studies evaluated parent-to-parent support and reported on the psychological health and experience of giving or receiving support. There were no limits on the child's condition, study design, language, date, or setting. We sought to aggregate quantitative data; findings of qualitative studies were combined using thematic analysis. Qualitative and quantitative data were brought together in a narrative synthesis. Seventeen papers were included: nine qualitative studies, seven quantitative studies, and one mixed-methods evaluation. Four themes were identified from qualitative studies: (1) shared social identity, (2) learning from the experiences of others, (3) personal growth, and (4) supporting others. Some quantitative studies reported a positive effect of peer support on psychological health and other outcomes; however, this was not consistently confirmed. It was not possible to aggregate data across studies. No costing data were identified. Qualitative studies strongly suggest that parents perceive benefit from peer support programmes, an effect seen across different types of support and conditions. However, quantitative studies provide inconsistent evidence of positive effects. Further research should explore whether this dissonance is substantive or an artefact of how outcomes have been measured. © The Authors. Developmental Medicine & Child Neurology © 2013 Mac Keith Press.

Experiences from a pilot study on how to conduct a qualitative multi-country research project regarding use of antibiotics in Southeast Europe.

PubMed

Kaae, Susanne; Sporrong, Sofia Kälvemark; Traulsen, Janine Morgall; Wallach Kildemoes, Helle; Nørgaard, Lotte Stig; Jakupi, Arianit; Raka, Denis; Gürpinar, Emre Umut; Alkan, Ali; Hoxha, Iris; Malaj, Admir; Cantarero, Lourdes Arevalo

2016-01-01

In 2014, a qualitative multi-country research project was launched to study the reasons behind the high use of antibiotics in regions of Southeast Europe by using previously untrained national interviewers (who were engaged in other antibiotic microbial resistance-related investigations) to conduct qualitative interviews with local patients, physicians and pharmacists. Little knowledge exists about how to implement qualitative multi-country research collaborations involving previously untrained local data collectors. The aim of this paper was therefore to contribute to the knowledge regarding how to conduct these types of research projects by evaluating a pilot study of the project. Local data collectors conducted the study according to a developed protocol and evaluated the study with the responsible researcher-team from University of Copenhagen. The pilot study focused on 'local ownership', 'research quality' and 'feasibility' with regard to successful implementation and evaluation. The evaluation was achieved by interpreting 'Skype' and 'face to face' meetings and email correspondence by applying 'critical common sense'. Local data collectors achieved a sense of joint ownership. Overall, the protocol worked well. Several minor challenges pertaining to research quality and feasibility were identified, in particular obtaining narratives when conducting interviews and recruiting patients for the study. Furthermore, local data collectors found it difficult to allocate sufficient time to the project. Solutions were discussed and added to the protocol. Despite the challenges, it was possible to achieve an acceptable scientific level of research when conducting qualitative multi-country research collaboration under the given circumstances. Specific recommendations to achieve this are provided by the authors.

[The positioning of nursing research in the academic studies: the origin and development of qualitative and quantitative studies].

PubMed

Lu, Pei-Pei; Ting, Shing-Shiang; Chen, Mei-Ling; Tang, Woung-Ru

2005-12-01

The purpose of this study is to discuss the historical context of qualitative and quantitative research so as to explain the principle of qualitative study and examine the positioning of nursing research within academic study as a whole. This paper guides the readers towards the historical context from empirical science, discusses the influences of qualitative and quantitative research on nursing research, then investigates the nature of research paradigms, examines the positioning of nursing research, which includes the characteristics of fields such as natural science, humanity and social studies, and science, and lastly, presents the research standard proposed by Yardley in 2000. The research paradigms include Positivism, Postpositivism, Criticism, and Constructivism, which can be compared with Ontology, Epistemology, and Methodology. The nature of the paradigm is to determine the assumption of the paradigm on the basis of Ontology, Epistemology, and Methodology. The paradigm determines how the researcher views the world and decides on what to answer, how to research, and how to answer. The difference in academic environment is reflected in the long-term dialogue between qualitative and quantitative studies, as well as the standard for criticism. This paper introduces the method of evaluation of the quality of qualitative study proposed by Yardley in 2002, namely the sensitivity of the context, the promise and conscientiousness, transparency and consistency, influence and significance. The paper is intended to provide a guideline for readers in evaluating the quality of qualitative study.

Enabler for Interdisciplinary eHealthcare: A Qualitative Study.

PubMed

Yu, Dan; Poon, Simon K; Tran, Vivienne; Lam, Mary K; Hines, Monique; Brunner, Melissa; Power, Emma; Shaw, Tim; Togher, Leanne

2017-01-01

The complex relations between Health Technologies and clinical practices have been the focus of intensive research in recent years. This research represents a shift towards a holistic view where evaluation of health technologies is linked to organisational practices. In this paper, we address the gaps in existing literature regarding the holistic evaluation of e-health in clinical practice. We report the results from a qualitative study conducted to gain insight into e-health in practice within an interdisciplinary healthcare domain. Findings from this qualitative study, provides the foundation for the creation of a generic measurement model that allows for the comparative analysis of health technologies and assist in the decision-making of its stakeholders.

Methodological Reflections on the Contribution of Qualitative Research to the Evaluation of Clinical Ethics Support Services.

PubMed

Wäscher, Sebastian; Salloch, Sabine; Ritter, Peter; Vollmann, Jochen; Schildmann, Jan

2017-05-01

This article describes a process of developing, implementing and evaluating a clinical ethics support service intervention with the goal of building up a context-sensitive structure of minimal clinical-ethics in an oncology department without prior clinical ethics structure. Scholars from different disciplines have called for an improvement in the evaluation of clinical ethics support services (CESS) for different reasons over several decades. However, while a lot has been said about the concepts and methodological challenges of evaluating CESS up to the present time, relatively few empirical studies have been carried out. The aim of this article is twofold. On the one hand, it describes a process of development, modifying and evaluating a CESS intervention as part of the ETHICO research project, using the approach of qualitative-formative evaluation. On the other hand, it provides a methodological analysis which specifies the contribution of qualitative empirical methods to the (formative) evaluation of CESS. We conclude with a consideration of the strengths and limitations of qualitative evaluation research with regards to the evaluation and development of context sensitive CESS. We further discuss our own approach in contrast to rather traditional consult or committee models. © 2017 John Wiley & Sons Ltd.

Evaluating Continuing Nursing Education: A Qualitative Study of Intention to Change Practice and Perceived Barriers to Knowledge Translation.

PubMed

Wellings, Cynthea A; Gendek, Marilyn A; Gallagher, Silvia E

Evaluating the effectiveness of continuing nursing education does not always include behavioral change and patient health outcomes. A qualitative analysis of open-ended evaluation questions from continuing nursing education activities was conducted. The aim was to evaluate learners' intentions to change their practice resulting from their learning and their perceived barriers to implementing practice changes. Results revealed the multiple, interconnected challenges involved in translating new learning into practice.

Barriers and facilitators of interventions for improving antiretroviral therapy adherence: a systematic review of global qualitative evidence.

PubMed

Ma, Qingyan; Tso, Lai Sze; Rich, Zachary C; Hall, Brian J; Beanland, Rachel; Li, Haochu; Lackey, Mellanye; Hu, Fengyu; Cai, Weiping; Doherty, Meg; Tucker, Joseph D

2016-01-01

Qualitative research on antiretroviral therapy (ART) adherence interventions can provide a deeper understanding of intervention facilitators and barriers. This systematic review aims to synthesize qualitative evidence of interventions for improving ART adherence and to inform patient-centred policymaking. We searched 19 databases to identify studies presenting primary qualitative data on the experiences, attitudes and acceptability of interventions to improve ART adherence among PLHIV and treatment providers. We used thematic synthesis to synthesize qualitative evidence and the CERQual (Confidence in the Evidence from Reviews of Qualitative Research) approach to assess the confidence of review findings. Of 2982 references identified, a total of 31 studies from 17 countries were included. Twelve studies were conducted in high-income countries, 13 in middle-income countries and six in low-income countries. Study populations focused on adults living with HIV (21 studies, n =1025), children living with HIV (two studies, n =46), adolescents living with HIV (four studies, n =70) and pregnant women living with HIV (one study, n =79). Twenty-three studies examined PLHIV perspectives and 13 studies examined healthcare provider perspectives. We identified six themes related to types of interventions, including task shifting, education, mobile phone text messaging, directly observed therapy, medical professional outreach and complex interventions. We also identified five cross-cutting themes, including strengthening social relationships, ensuring confidentiality, empowerment of PLHIV, compensation and integrating religious beliefs into interventions. Our qualitative evidence suggests that strengthening PLHIV social relationships, PLHIV empowerment and developing culturally appropriate interventions may facilitate adherence interventions. Our study indicates that potential barriers are inadequate training and compensation for lay health workers and inadvertent disclosure of serostatus by participating in the intervention. Our study evaluated adherence interventions based on qualitative data from PLHIV and health providers. The study underlines the importance of incorporating social and cultural factors into the design and implementation of interventions. Further qualitative research is needed to evaluate ART adherence interventions.

Professional Readiness Level of Candidate Teachers: A Qualitative Evaluation

ERIC Educational Resources Information Center

Yildirim, Nail

2016-01-01

The study investigates novice teachers? self-perceptions of their professional readiness. The study has a qualitative research design, adopting the phenomenology pattern. The study group comprised subject matter teachers employed at different educational stages (primary, secondary and high schools). The participants were selected according to the…

Improving the Quality of Experience Journals: Training Educational Psychology Students in Basic Qualitative Methodology

ERIC Educational Resources Information Center

Reynolds-Keefer, Laura

2010-01-01

This study evaluates the impact of teaching basic qualitative methodology to preservice teachers enrolled in an educational psychology course in the quality of observation journals. Preservice teachers enrolled in an educational psychology course requiring 45 hr of field experience were given qualitative methodological training as a part of the…

Qualitative radiology assessment of tumor response: does it measure up?

PubMed

Gottlieb, Ronald H; Litwin, Alan; Gupta, Bhavna; Taylor, John; Raczyk, Cheryl; Mashtare, Terry; Wilding, Gregory; Fakih, Marwan

2008-01-01

Our purpose was to assess whether a simpler qualitative evaluation of tumor response by computed tomography is as reproducible and predictive of clinical outcome as the Response Evaluation Criteria in Solid Tumors (RECIST) and World Health Organization (WHO) methods. This study was a two-reader retrospective evaluation in which qualitative assessment resulted in agreement in 21 of 23 patients with metastatic colorectal carcinoma (91.3%, kappa=0.78; 95% CI, 0.51-1.00). Hepatic metastases were classified as increased, decreased, or unchanged, compared with agreement in 20 of 23 patients (87.0%) for RECIST (kappa=0.62; 95% CI, 0.23-1.00) and WHO (kappa=0.67; 95% CI, 0.34-1.00) methods. Patients were placed into partial response, stable disease, and disease progression categories. Time to progression of disease was better predicted qualitatively than by RECIST or WHO. Our pilot data suggest that our qualitative scoring system is more reproducible and predictive of patient clinical outcome than the RECIST and WHO methods.

Developing patient-centered treatment protocols in brain stimulation: a rationale for combining quantitative and qualitative approaches in persons with HIV.

PubMed

Rosedale, Mary; Malaspina, Dolores; Malamud, Daniel; Strauss, Shiela M; Horne, Jaclyn D; Abouzied, Salman; Cruciani, Ricardo A; Knotkova, Helena

2012-01-01

This article reports and discusses how quantitative (physiological and behavioral) and qualitative methods are being combined in an open-label pilot feasibility study. The study evaluates safety, tolerability, and acceptability of a protocol to treat depression in HIV-infected individuals, using a 2-week block of transcranial direct current stimulation (tDCS) over the dorsolateral prefrontal cortex. Major depressive disorder (MDD) is the second most prevalent psychiatric disorder after substance abuse among HIV-positive adults, and novel antidepressant treatments are needed for this vulnerable population. The authors describe the challenges and contributions derived from different research perspectives and methodological approaches and provide a philosophical framework for combining quantitative and qualitative measurements for a fuller examination of the disorder. Four methodological points are presented: (1) the value of combining quantitative and qualitative approaches; (2) the need for context-specific measures when studying patients with medical and psychiatric comorbidities; (3) the importance of research designs that integrate physiological, behavioral, and qualitative approaches when evaluating novel treatments; and (4) the need to explore the relationships between biomarkers, clinical symptom assessments, patient self-evaluations, and patient experiences when developing new, patient-centered protocols. The authors conclude that the complexity of studying novel treatments in complex and new patient populations requires complex research designs to capture the richness of data that inform translational research.

Integration of a Professional Dancer into College

ERIC Educational Resources Information Center

Pulinkala, Ivan

2011-01-01

This paper evaluates the experience of integrating a professional dancer into a collegiate environment using a case study method of qualitative research. Interviews, focus groups, observation studies and document analysis techniques were used to gather qualitative data for this study. The innovation of diffusion theory was used to highlight the…

Commentary: Writing and evaluating qualitative research reports

USDA-ARS?s Scientific Manuscript database

An overview of qualitative methods is provided, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals ...

A Qualitative Case Study of Reading-While-Listening to Audiobooks Simultaneously

ERIC Educational Resources Information Center

Linton, Sorena Christina

2017-01-01

This study was a qualitative, evaluative, multicase study to determine the educator perspectives on the barriers to using Reading While Listening (RWL) simultaneously to audiobooks and their corresponding printed material. The goal of this study was to understand whether RWL should be used more extensively, implemented into a set curriculum, and…

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

This paper explores the variety of qualitative methods available, in the context of a larger quantitative-qualitative debate in the field of educational evaluation. Each approach is reviewed in terms of the work of its major proponents. The dominant forms of qualitative evaluation include: (1) ethnography; (2) naturalistic inquiry; (3) generic…

Corroborating qualitative benefits of online ATIS with modeling : Los Angeles case study

DOT National Transportation Integrated Search

2003-03-01

This report documents a modeling study performed as a follow-up to a qualitative online evaluation of the Traveler Advisory News Network (TANN) and SmarTraveler traffic information web sites (7,8) by researchers at the Volpe National Transportation S...

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Evaluation of the Cultural Elements in the Textbook "Genki I: an Integrated Course in Elementary Japanese"

ERIC Educational Resources Information Center

Er, Onur

2017-01-01

This study aims to examine the textbook "Genki I: An Integrated Course in Elementary Japanese" in terms of cultural elements. The data of this qualitative research were collected by means of the document review method. Content analysis, one of the qualitative analysis techniques, was used in the evaluation of the research data. A second…

Using mixed methods to develop and evaluate an online weight management intervention.

PubMed

Bradbury, Katherine; Dennison, Laura; Little, Paul; Yardley, Lucy

2015-02-01

This article illustrates the use of mixed methods in the development and evaluation of the Positive Online Weight Reduction (POWeR) programme, an e-health intervention designed to support sustainable weight loss. The studies outlined also explore how human support might enhance intervention usage and weight loss. Mixed methods were used to develop and evaluate POWeR. In the development phase, we drew on both quantitative and qualitative findings to plan and gain feedback on the intervention. Next, a feasibility trial, with nested qualitative study, explored what level of human support might lead to the most sustainable weight loss. Finally, a large community-based trial of POWeR, with nested qualitative study, explored whether the addition of brief telephone coaching enhances usage. Findings suggest that POWeR is acceptable and potentially effective. Providing human support enhanced usage in our trials, but was not unproblematic. Interestingly, there were some indications that more basic (brief) human support may produce more sustainable weight loss outcomes than more regular support. Qualitative interviews suggested that more regular support might foster reliance, meaning patients cannot sustain their weight losses when support ends. Qualitative findings in the community trial also suggested explanations for why many people may not take up the opportunity for human support. Integrating findings from both our qualitative and quantitative studies provided far richer insights than would have been gained using only a single method of inquiry. Further research should investigate the optimum delivery of human support needed to maximize sustainable weight loss in online interventions. Statement of contribution What is already known on this subject? There is evidence that human support may increase the effectiveness of e-health interventions. It is unclear what level of human support might be optimal or how human support improves effectiveness. Triangulation of quantitative and qualitative methods can be used to inform the design and implementation of interventions What does this study add? This paper demonstrates the value of a mixed methods approach when developing and evaluating an intervention. Qualitative methods provided complementary insights into the optimal level of human support. Brief human support is valued by some and may enhance usage and outcomes of an e-health intervention for weight loss. © 2014 The British Psychological Society.

Evaluation of shear wave elastography for differential diagnosis of breast lesions: A new qualitative analysis versus conventional quantitative analysis.

PubMed

Ren, Wei-Wei; Li, Xiao-Long; Wang, Dan; Liu, Bo-Ji; Zhao, Chong-Ke; Xu, Hui-Xiong

2018-04-13

To evaluate a special kind of ultrasound (US) shear wave elastography for differential diagnosis of breast lesions, using a new qualitative analysis (i.e. the elasticity score in the travel time map) compared with conventional quantitative analysis. From June 2014 to July 2015, 266 pathologically proven breast lesions were enrolled in this study. The maximum, mean, median, minimum, and standard deviation of shear wave speed (SWS) values (m/s) were assessed. The elasticity score, a new qualitative feature, was evaluated in the travel time map. The area under the receiver operating characteristic (AUROC) curves were plotted to evaluate the diagnostic performance of both qualitative and quantitative analyses for differentiation of breast lesions. Among all quantitative parameters, SWS-max showed the highest AUROC (0.805; 95% CI: 0.752, 0.851) compared with SWS-mean (0.786; 95% CI:0.732, 0.834; P = 0.094), SWS-median (0.775; 95% CI:0.720, 0.824; P = 0.046), SWS-min (0.675; 95% CI:0.615, 0.731; P = 0.000), and SWS-SD (0.768; 95% CI:0.712, 0.817; P = 0.074). The AUROC of qualitative analysis in this study obtained the best diagnostic performance (0.871; 95% CI: 0.825, 0.909, compared with the best parameter of SWS-max in quantitative analysis, P = 0.011). The new qualitative analysis of shear wave travel time showed the superior diagnostic performance in the differentiation of breast lesions in comparison with conventional quantitative analysis.

Diabetes Education Needs of Chinese Australians: A Qualitative Study

ERIC Educational Resources Information Center

Choi, Tammie S. T.; Walker, Karen Z.; Ralston, Robin A.; Palermo, Claire

2015-01-01

Objective: The aim of this study was to evaluate a type 2 diabetes education programme for Chinese Australians, based on the experience of participants and by exploring the unique needs of Chinese patients, their health beliefs and their cultural behaviours. Design and setting: A qualitative ethnographic study was undertaken in a community health…

77 FR 30512 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-23

..., including through the use of information technology. Please note that written comments received in response.... This study aims to fill a gap by conducting qualitative case studies of up to 15 sites. This study will systematically analyze qualitative data across multiple respondents to generate portraits of programs and...

Evaluation of background parenchymal enhancement on breast MRI: a systematic review

PubMed Central

Signori, Alessio; Valdora, Francesca; Rossi, Federica; Calabrese, Massimo; Durando, Manuela; Mariscotto, Giovanna; Tagliafico, Alberto

2017-01-01

Objective: To perform a systematic review of the methods used for background parenchymal enhancement (BPE) evaluation on breast MRI. Methods: Studies dealing with BPE assessment on breast MRI were retrieved from major medical libraries independently by four reviewers up to 6 October 2015. The keywords used for database searching are “background parenchymal enhancement”, “parenchymal enhancement”, “MRI” and “breast”. The studies were included if qualitative and/or quantitative methods for BPE assessment were described. Results: Of the 420 studies identified, a total of 52 articles were included in the systematic review. 28 studies performed only a qualitative assessment of BPE, 13 studies performed only a quantitative assessment and 11 studies performed both qualitative and quantitative assessments. A wide heterogeneity was found in the MRI sequences and in the quantitative methods used for BPE assessment. Conclusion: A wide variability exists in the quantitative evaluation of BPE on breast MRI. More studies focused on a reliable and comparable method for quantitative BPE assessment are needed. Advances in knowledge: More studies focused on a quantitative BPE assessment are needed. PMID:27925480

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

Field evaluation of Abbott Real Time HIV-1 Qualitative test for early infant diagnosis using dried blood spots samples in comparison to Roche COBAS Ampliprep/COBAS TaqMan HIV-1 Qual Test in Kenya

PubMed Central

Chang, Joy; Omuomo, Kenneth; Anyango, Emily; Kingwara, Leonard; Basiye, Frank; Morwabe, Alex; Shanmugam, Vedapuri; Nguyen, Shon; Sabatier, Jennifer; Zeh, Clement; Ellenberger, Dennis

2016-01-01

Timely diagnosis and treatment of infants infected with HIV are critical for reducing infant mortality. High-throughput automated diagnostic tests like Roche COBAS AmpliPrep/COBAS TaqMan HIV-1 Qual Test (Roche CAPCTM Qual) and the Abbott Real Time HIV-1 Qualitative (Abbott Qualitative) can be used to rapidly expand early infant diagnosis testing services. In this study, the performance characteristics of the Abbott Qualitative were evaluated using two hundred dried blood spots (DBS) samples (100 HIV-1 positive and 100 HIV-1 negative) collected from infants attending the antenatal facilities in Kisumu, Kenya. The Abbott Qualitative results were compared to the diagnostic testing completed using the Roche CAPCTM Qual in Kenya. The sensitivity and specificity of the Abbott Qualitative were 99.0% (95% CI: 95.0–100.0) and 100.0% (95% CI: 96.0–100.0), respectively, and the overall reproducibility was 98.0% (95% CI: 86.0–100.0). The limits of detection for the Abbott Qualitative and Roche CAPCTM Qual were 56.5 and 6.9 copies/mL at 95% CIs (p = 0.005), respectively. The study findings demonstrate that the Abbott Qualitative test is a practical option for timely diagnosis of HIV in infants. PMID:24726703

Field evaluation of Abbott Real Time HIV-1 Qualitative test for early infant diagnosis using dried blood spots samples in comparison to Roche COBAS Ampliprep/COBAS TaqMan HIV-1 Qual test in Kenya.

PubMed

Chang, Joy; Omuomo, Kenneth; Anyango, Emily; Kingwara, Leonard; Basiye, Frank; Morwabe, Alex; Shanmugam, Vedapuri; Nguyen, Shon; Sabatier, Jennifer; Zeh, Clement; Ellenberger, Dennis

2014-08-01

Timely diagnosis and treatment of infants infected with HIV are critical for reducing infant mortality. High-throughput automated diagnostic tests like Roche COBAS AmpliPrep/COBAS TaqMan HIV-1 Qual Test (Roche CAPCTM Qual) and the Abbott Real Time HIV-1 Qualitative (Abbott Qualitative) can be used to rapidly expand early infant diagnosis testing services. In this study, the performance characteristics of the Abbott Qualitative were evaluated using two hundred dried blood spots (DBS) samples (100 HIV-1 positive and 100 HIV-1 negative) collected from infants attending the antenatal facilities in Kisumu, Kenya. The Abbott Qualitative results were compared to the diagnostic testing completed using the Roche CAPCTM Qual in Kenya. The sensitivity and specificity of the Abbott Qualitative were 99.0% (95% CI: 95.0-100.0) and 100.0% (95% CI: 96.0-100.0), respectively, and the overall reproducibility was 98.0% (95% CI: 86.0-100.0). The limits of detection for the Abbott Qualitative and Roche CAPCTM Qual were 56.5 and 6.9copies/mL at 95% CIs (p=0.005), respectively. The study findings demonstrate that the Abbott Qualitative test is a practical option for timely diagnosis of HIV in infants. Published by Elsevier B.V.

Use of MRI in Differentiation of Papillary Renal Cell Carcinoma Subtypes: Qualitative and Quantitative Analysis.

PubMed

Doshi, Ankur M; Ream, Justin M; Kierans, Andrea S; Bilbily, Matthew; Rusinek, Henry; Huang, William C; Chandarana, Hersh

2016-03-01

The purpose of this study was to determine whether qualitative and quantitative MRI feature analysis is useful for differentiating type 1 from type 2 papillary renal cell carcinoma (PRCC). This retrospective study included 21 type 1 and 17 type 2 PRCCs evaluated with preoperative MRI. Two radiologists independently evaluated various qualitative features, including signal intensity, heterogeneity, and margin. For the quantitative analysis, a radiology fellow and a medical student independently drew 3D volumes of interest over the entire tumor on T2-weighted HASTE images, apparent diffusion coefficient parametric maps, and nephrographic phase contrast-enhanced MR images to derive first-order texture metrics. Qualitative and quantitative features were compared between the groups. For both readers, qualitative features with greater frequency in type 2 PRCC included heterogeneous enhancement, indistinct margin, and T2 heterogeneity (all, p < 0.035). Indistinct margins and heterogeneous enhancement were independent predictors (AUC, 0.822). Quantitative analysis revealed that apparent diffusion coefficient, HASTE, and contrast-enhanced entropy were greater in type 2 PRCC (p < 0.05; AUC, 0.682-0.716). A combined quantitative and qualitative model had an AUC of 0.859. Qualitative features within the model had interreader concordance of 84-95%, and the quantitative data had intraclass coefficients of 0.873-0.961. Qualitative and quantitative features can help discriminate between type 1 and type 2 PRCC. Quantitative analysis may capture useful information that complements the qualitative appearance while benefiting from high interobserver agreement.

A comparative study of qualitative and quantitative methods for the assessment of adhesive remnant after bracket debonding.

PubMed

Cehreli, S Burcak; Polat-Ozsoy, Omur; Sar, Cagla; Cubukcu, H Evren; Cehreli, Zafer C

2012-04-01

The amount of the residual adhesive after bracket debonding is frequently assessed in a qualitative manner, utilizing the adhesive remnant index (ARI). This study aimed to investigate whether quantitative assessment of the adhesive remnant yields more precise results compared to qualitative methods utilizing the 4- and 5-point ARI scales. Twenty debonded brackets were selected. Evaluation and scoring of the adhesive remnant on bracket bases were made consecutively using: 1. qualitative assessment (visual scoring) and 2. quantitative measurement (image analysis) on digital photographs. Image analysis was made on scanning electron micrographs (SEM) and high-precision elemental maps of the adhesive remnant as determined by energy dispersed X-ray spectrometry. Evaluations were made in accordance with the original 4-point and the modified 5-point ARI scales. Intra-class correlation coefficients (ICCs) were calculated, and the data were evaluated using Friedman test followed by Wilcoxon signed ranks test with Bonferroni correction. ICC statistics indicated high levels of agreement for qualitative visual scoring among examiners. The 4-point ARI scale was compliant with the SEM assessments but indicated significantly less adhesive remnant compared to the results of quantitative elemental mapping. When the 5-point scale was used, both quantitative techniques yielded similar results with those obtained qualitatively. These results indicate that qualitative visual scoring using the ARI is capable of generating similar results with those assessed by quantitative image analysis techniques. In particular, visual scoring with the 5-point ARI scale can yield similar results with both the SEM analysis and elemental mapping.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year

PubMed Central

McKibbon, Kathleen Ann; Gadd, Cynthia S

2004-01-01

Background Quantitative studies are becoming more recognized as important to understanding health care with all of its richness and complexities. The purpose of this descriptive survey was to provide a quantitative evaluation of the qualitative studies published in 170 core clinical journals for 2000. Methods All identified studies that used qualitative methods were reviewed to ascertain which clinical journals publish qualitative studies and to extract research methods, content (persons and health care issues studied), and whether mixed methods (quantitative and qualitative methods) were used. Results 60 330 articles were reviewed. 355 reports of original qualitative studies and 12 systematic review articles were identified in 48 journals. Most of the journals were in the discipline of nursing. Only 4 of the most highly cited health care journals, based on ISI Science Citation Index (SCI) Impact Factors, published qualitative studies. 37 of the 355 original reports used both qualitative and quantitative (mixed) methods. Patients and non-health care settings were the most common groups of people studied. Diseases and conditions were cancer, mental health, pregnancy and childbirth, and cerebrovascular disease with many other diseases and conditions represented. Phenomenology and grounded theory were commonly used; substantial ethnography was also present. No substantial differences were noted for content or methods when articles published in all disciplines were compared with articles published in nursing titles or when studies with mixed methods were compared with studies that included only qualitative methods. Conclusions The clinical literature includes many qualitative studies although they are often published in nursing journals or journals with low SCI Impact Factor journals. Many qualitative studies incorporate both qualitative and quantitative methods. PMID:15271221

Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study

PubMed Central

Glenton, Claire; Oxman, Andrew D

2009-01-01

Objective To examine the use of qualitative approaches alongside randomised trials of complex healthcare interventions. Design Review of randomised controlled trials of interventions to change professional practice or the organisation of care. Data sources Systematic sample of 100 trials published in English from the register of the Cochrane Effective Practice and Organisation of Care Review Group. Methods Published and unpublished qualitative studies linked to the randomised controlled trials were identified through database searches and contact with authors. Data were extracted from each study by two reviewers using a standard form. We extracted data describing the randomised controlled trials and qualitative studies, the quality of these studies, and how, if at all, the qualitative and quantitative findings were combined. A narrative synthesis of the findings was done. Results 30 of the 100 trials had associated qualitative work and 19 of these were published studies. 14 qualitative studies were done before the trial, nine during the trial, and four after the trial. 13 studies reported an explicit theoretical basis and 11 specified their methodological approach. Approaches to sampling and data analysis were poorly described. For most cases (n=20) we found no indication of integration of qualitative and quantitative findings at the level of either analysis or interpretation. The quality of the qualitative studies was highly variable. Conclusions Qualitative studies alongside randomised controlled trials remain uncommon, even where relatively complex interventions are being evaluated. Most of the qualitative studies were carried out before or during the trials with few studies used to explain trial results. The findings of the qualitative studies seemed to be poorly integrated with those of the trials and often had major methodological shortcomings. PMID:19744976

Qualitative Parameters for Evaluation Procedures of Non-Formal and Informal Learning Achievements

ERIC Educational Resources Information Center

Stasiunaitiene, Egle; Kaminskiene, Lina

2009-01-01

The article introduces evaluation principles of non-formal and informal learning that determine the quality of evaluation, describes stages of the evaluation procedure, differentiates their qualitative parameters and defines their criteria and indicators. It also brings in the discussion that consideration of qualitative parameters for the…

Improving Evaluation of Dental Hygiene Students' Cultural Competence with a Mixed-Methods Approach.

PubMed

Flynn, Priscilla; Sarkarati, Nassim

2018-02-01

Most dental hygiene educational programs include cultural competence education, but may not evaluate student outcomes. The aim of this study was to design and implement a mixed-methods evaluation to measure dental hygiene students' progression toward cultural competence. Two cohorts consisting of consecutive classes in one U.S. dental hygiene program participated in the study. A total of 47 dental hygiene students (100% response rate) completed self-assessments to measure their attitudes and knowledge at three time points between 2014 and 2016. Mean scores were calculated for three domains: Physical Environment, Communication, and Values. Qualitative analysis of the students' cultural diversity papers was also conducted to further evaluate students' knowledge and skills. Bennett's five-level conceptual framework was used to code phrases or sentences to place students in the general categories of ethnocentric or ethno-relative. The quantitative and qualitative results yielded different outcomes for Cohort 1, but not for Cohort 2. The Cohort 1 students assessed themselves statistically significantly lower over time in one of the three measured domains. However, the Cohort 2 students assessed themselves as statistically significantly more culturally competent in all three domains. Qualitative results placed 72% of Cohort 1 students and 83% of Cohort 2 students in the more desirable ethno-relative category. Since quantitative methods consisting of student self-assessments may not adequately measure students' cultural competence, adding qualitative methods to measure skills specific to patient care in this study added a robust dimension to evaluating this complex dental hygiene student competence.

[Participation, knowledge production, and evaluative research: participation by different actors in a mental health study].

PubMed

Furtado, Juarez Pereira; Campos, Rosana Onocko

2008-11-01

This article reflects on the interrelations between participation, knowledge production, and public policy evaluation in light of issues from our own experience with evaluative research on a municipal network of Psychosocial Care Centers (CAPS) in Brazil. The article discusses the coordination of the complex process and the potentials and limits of partnerships for conducting qualitative evaluative studies in mental health with participation by different social actors. The authors conclude that qualitative evaluative research aligned with the perspective of including different points of view representing various segments is the best approach for understanding the numerous spin-offs from the implementation of services linked to the Brazilian psychiatric reform movement, given the inherent specificities of the mental health field.

Promoting and evaluating scientific rigour in qualitative research.

PubMed

Baillie, Lesley

2015-07-15

This article explores perspectives on qualitative research and the variety of views concerning rigour in the research process. Evaluating and ensuring the quality of research are essential considerations for practitioners who are appraising evidence to inform their practice or research. Several criteria and principles for evaluating quality in qualitative research are presented, recognising that their application in practice is influenced by the qualitative methodology used. The article examines a range of techniques that a qualitative researcher can use to promote rigour and apply it to practice.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment.

PubMed

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment

PubMed Central

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action. PMID:28992759

General practitioners learning qualitative research: A case study of postgraduate education.

PubMed

Hepworth, Julie; Kay, Margaret

2015-10-01

Qualitative research is increasingly being recognised as a vital aspect of primary healthcare research. Teaching and learning how to conduct qualitative research is especially important for general practitioners and other clinicians in the professional educational setting. This article examines a case study of postgraduate professional education in qualitative research for clinicians, for the purpose of enabling a robust discussion around teaching and learning in medicine and the health sciences. A series of three workshops was delivered for primary healthcare academics. The workshops were evaluated using a quantitative survey and qualitative free-text responses to enable descriptive analyses. Participants found qualitative philosophy and theory the most difficult areas to engage with, and learning qualitative coding and analysis was considered the easiest to learn. Key elements for successful teaching were identified, including the use of adult learning principles, the value of an experienced facilitator and an awareness of the impact of clinical subcultures on learning.

The Influence of Body Mapping on Student Musicians' Performance Experiences

ERIC Educational Resources Information Center

Buchanan, Heather J.; Hays, Terrence

2014-01-01

This qualitative study examines student musicians' perceptions of their performance and development resulting from Body Mapping (BMG) technique. BMG is a somatic (mind-body) education technique designed to teach musicians skills in self-evaluation and change for performing with sensory-motor integrity. A qualitative study guided by an…

Service Quality in Alcohol Treatment: A Qualitative Study

ERIC Educational Resources Information Center

Resnick, Sheilagh M.; Griffiths, Mark D.

2010-01-01

The objective of the study was to qualitatively evaluate the managerial and organisational issues associated with service quality in a privately funded alcohol treatment centre in the UK. Two different groups of participants at a private treatment clinic were interviewed. The first group comprised 25 of its patients. The second group comprised 15…

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

A Critical Review of Qualitative Research Methods in Evaluating Nursing Curriculum Models: Implication for Nursing Education in the Arab World

ERIC Educational Resources Information Center

Devadas, Briliya

2016-01-01

Aim: The purpose of this critical literature review was to examine qualitative studies done on innovative nursing curriculums in order to determine which qualitative methods have been most effective in investigating the effectiveness of the curriculum and which would be most appropriate in an Arab Islamic country. Data Sources: At least 25 studies…

From themes to hypotheses: following up with quantitative methods.

PubMed

Morgan, David L

2015-06-01

One important category of mixed-methods research designs consists of quantitative studies that follow up on qualitative research. In this case, the themes that serve as the results from the qualitative methods generate hypotheses for testing through the quantitative methods. That process requires operationalization to translate the concepts from the qualitative themes into quantitative variables. This article illustrates these procedures with examples that range from simple operationalization to the evaluation of complex models. It concludes with an argument for not only following up qualitative work with quantitative studies but also the reverse, and doing so by going beyond integrating methods within single projects to include broader mutual attention from qualitative and quantitative researchers who work in the same field. © The Author(s) 2015.

Evaluation of life and death studies course on attitudes toward life and death among nursing students.

PubMed

Hwang, Huei-Lih; Lin, Huey-Shyan; Chen, Wen-Tin

2005-12-01

The aim of this study was to evaluate attitudes toward life and death among nursing students after attending the life and death studies (LDS) program. Both qualitative and quantitative methods were used to collect data. The pretest-posttest control group design randomly assigned students to an experimental (n = 47) or control group (n = 49). The 13-week course included lectures, video appraisal, games, simulations, films, books, assignments and group sharing. Statistical and content analysis were used to analyze qualitative and quantitative data. The findings showed a significant improvement in perception of the meaningfulness of life in four categories of improvement: expanded viewpoint, sadness about death, treating life sincerely, and instilling hope in life. The qualitative data indicated that a positive change in meaning of life was associated with interaction with others and self-reflection.

Student Satisfaction With Blackboard-Style Videos.

PubMed

Wolf, Andrew B; Peyre, Sarah E

2018-04-19

Blackboard-style videos with simple drawings illustrating concepts have become immensely popular in recent years. However, there has been no published research evaluating their efficacy in nursing education. This pilot study evaluates the use of blackboard-style videos in an online pathophysiology course. Quantitative and qualitative evaluation data were analyzed to evaluate student satisfaction. The data indicated that students were highly satisfied with the course and the delivery of content using blackboard-style videos. The qualitative analysis uncovered two key themes explaining the high level of satisfaction: visual plus narrative explanations support learning and student control over pacing enhances learning.

Non cardiopatic and cardiopatic beta thalassemic patients: quantitative and qualitative cardiac iron deposition evaluation with MRI.

PubMed

Macarini, L; Marini, S; Pietrapertosa, A; Scardapane, A; Ettorre, G C

2005-01-01

Cardiomyopathy is one of the major complications of b thalassaemia major as a result of transfusional iron overload. The aim of our study is to evaluate with MR if there is any difference of iron deposition signal intensity (SI) or distribution between non-cardiopathic and cardiopathic thalassaemic patients in order to establish if there is a relationship between cardiopathy and iron deposition. We studied 20 patients affected by b thalassaemia major, of whom 10 cardiopathic and 10 non-cardiopathic, and 10 healthy volunteers as control group. Serum ferritin and left ventricular ejection fraction were calculated in thalassaemic patients. All patients were examined using a 1.5 MR unit with ECG-gated GE cine-MR T2*-weighted, SE T1-weighted and GE T2*-weighted sequences. In all cases, using an adequate ROI, the myocardial and skeletal muscle signal intensity (SI), the myocardial/skeletal muscle signal intensity ratio (SIR) and the SI average of the myocardium and skeletal muscle were calculated for every study group. The qualitative evaluation of iron deposition distribution was independently performed by three radiologists who analyzed the extension, the site and the morphology of iron deposition on the MR images and reported their observations on the basis of a four-level rating scale: 0 (absent), 1 (limited), 2 (partial), 3 (widespread deposition). The result of quantitative and qualitative evaluations were analysed with statistical tests. Cardiac iron deposition was found in 8/10 non-cardiopathic thalassaemic patients and in all cardiopathic thalassaemic patients. We noticed a significant SI difference (p>0.05) between the healthy volunteer control group and the thalassaemic patients with iron deposition, but no significant SI difference in iron deposition between non-cardiopathic and cardiopathic thalassaemic patients in the areas evaluated. The qualitative evaluation revealed a different distribution of iron deposition between the two thalassaemic groups, with more widespread distribution in cardiopathic patients. We found cardiac iron deposition also in non-cardiopathic b thalassaemic patients and a qualitative difference in cardiac iron distribution between non-cardiopathic and cardiopathic patients. The qualitative evaluation of cardiac iron deposition was useful for an easier classification of the disease, bypassing the SI quantitative value which is affected by the extremely uneven distribution of iron deposition and by the sampling technique used. MR evaluation of non-cardiopathic thalassaemic patients may be useful to evaluate early iron deposition and to establish the most suitable chelation therapy.

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Quality of qualitative studies centred on patients in family practice: a systematic review.

PubMed

Cambon, Benoit; Vorilhon, Philippe; Michel, Laurence; Cadwallader, Jean-Sébastien; Aubin-Auger, Isabelle; Pereira, Bruno; Vaillant Roussel, Hélène

2016-12-01

Qualitative research is often used in the field of general medicine. Our objective was to evaluate the quality of published qualitative studies conducted using individual interviews or focus groups centred on patients monitored in general practice. We have undertaken a review of the literature in the PubMed and Embase databases of articles up to February 2014. The selection criteria were qualitative studies conducted using individual interviews or focus groups, centred on patients monitored in general practice. The articles chosen were analysed and evaluated using a score established from the Relevance, Appropriateness, Transparency and Soundness (RATS) grid. The average score of the 52 studies chosen was 28 out of 42. The criteria least often present were the description of the patients who chose not to participate in the study, the justification of the end of data collection, the discussion of the influence of the researchers and the discussion of the confidentiality of the data. The criteria most frequently described were an explicit research question, justified and in relation to existing knowledge, the agreement of the ethical committee and the presence of quotations. The number of studies and the score increased from year-to-year. The score was independent of the impact factor of the journal. Even though the qualitative research was published in reviews with a low impact factor, our results suggest that this research responded to the quality criteria of the RATS grid. The evaluation scored using RATS could be useful for authors or reviewers and for literature reviews. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Visual salience metrics for image inpainting

NASA Astrophysics Data System (ADS)

Ardis, Paul A.; Singhal, Amit

2009-01-01

Quantitative metrics for successful image inpainting currently do not exist, with researchers instead relying upon qualitative human comparisons to evaluate their methodologies and techniques. In an attempt to rectify this situation, we propose two new metrics to capture the notions of noticeability and visual intent in order to evaluate inpainting results. The proposed metrics use a quantitative measure of visual salience based upon a computational model of human visual attention. We demonstrate how these two metrics repeatably correlate with qualitative opinion in a human observer study, correctly identify the optimum uses for exemplar-based inpainting (as specified in the original publication), and match qualitative opinion in published examples.

Expediting the Analysis of Qualitative Data in Evaluation: A Procedure for the Rapid Identification of Themes from Audio Recordings (RITA)

ERIC Educational Resources Information Center

Neal, Jennifer Watling; Neal, Zachary P.; VanDyke, Erika; Kornbluh, Mariah

2015-01-01

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

A Database Evaluation Based on Information Needs of Academic Social Scientists.

ERIC Educational Resources Information Center

Buterbaugh, Nancy Toth

This study evaluates two databases, "Historical Abstracts" and REESWeb, to determine their effectiveness in supporting academic social science research. While many performance evaluations gather quantitative data from isolated query and response transactions, this study is a qualitative evaluation of the databases in the context of…

Mentoring doctoral students for qualitative research: interviews with experienced nursing faculty in Japan.

PubMed

Kayama, Mami; Gregg, Misuzu F; Asahara, Kiyomi; Yamamoto-Mitani, Noriko; Okuma, Keiko; Ohta, Kikuko; Kinoshita, Yasuhito

2013-05-01

This study aimed to describe the process of mentoring doctoral students for qualitative research in Japanese graduate programs in nursing. Nine experienced faculty-seven nurse researchers and two sociologists-were interviewed. Participants were asked about their process of mentoring students for qualitative nursing dissertations. Data analysis was conducted using a qualitative descriptive method. Participants' age ranged from 48 to 60 years. The first theme in the mentoring process is about the individualized, one-on-one mentorship process. The second theme occurs in a group process. The third theme is coordinating mentors and establishing a network to support the evaluation system. The mentoring processes identified in this study will be useful for future faculty development. The study elucidated much room for improvement in doctoral education programs for qualitative research methods in nursing science. Copyright 2013, SLACK Incorporated.

Using Qualitative Methods to Evaluate a Family Behavioral Intervention for Type 1 Diabetes

PubMed Central

Herbert, Linda Jones; Sweenie, Rachel; Kelly, Katherine Patterson; Holmes, Clarissa; Streisand, Randi

2013-01-01

Introduction The objectives of this study were to qualitatively evaluate a dyadic adolescent-parent type 1 diabetes (T1D) program developed to prevent deterioration in diabetes care among adolescents with T1D and provide recommendations for program refinement. Method Thirteen adolescent-parent dyads who participated in the larger RCT, the TeamWork Project, were interviewed regarding their perceptions of their participation in the program and current T1D challenges. Interviews were transcribed and coded to establish broad themes. Results Adolescents and parents thought the TeamWork Project sessions were helpful and taught them new information. Five themes catalog findings from the qualitative interviews: TeamWork content, TeamWork structure, transition of responsibility, current and future challenges, and future intervention considerations. Discussion Addressing T1D challenges as a parent-adolescent dyad via a behavioral clinic program is helpful to families during adolescence. Findings highlight the utility of qualitative evaluation to tailor interventions for the unique challenges related to pediatric chronic illness. PMID:24269281

Teachers' Applications of Principals' Evaluative Feedback

ERIC Educational Resources Information Center

Mueller, Lori M.

2016-01-01

The purpose of this study was to identify considerations that influenced teachers' implementation of principals' evaluative feedback to improve instructional practices. The research question for this study was: What considerations contribute to teachers' applications of principals' evaluative feedback? Participants in this qualitative study…

Qualitative assessment of vaginal microflora during use of tampons of various compositions.

PubMed Central

Onderdonk, A B; Zamarchi, G R; Rodriguez, M L; Hirsch, M L; Muñoz, A; Kass, E H

1987-01-01

The effect of vaginal tampons on the microbial flora during menstruation has recently been studied by several investigators. However, little information regarding the qualitative effects attributable to particular tampon fibers is available. The purpose of the present study was to compare the effects of polyacrylate rayon tampons and cotton-viscose rayon blend tampons on the qualitative bacterial counts obtained from tampons and concomitant vaginal swabs and to determine whether either of these tampon types alters the qualitative makeup of the vaginal microflora when compared with the microflora in the same women using all-cotton tampons or external catamenial pads. Tampon and swab samples were obtained as described previously (A. B. Onderdonk, G. R. Zamarchi, M. L. Rodriguez, M. L. Hirsch, A. Muñoz, and E. H. Kass, Appl. Environ. Microbiol. 53:2774-2778). The genus and species of the six dominant bacterial species in each sample were identified, if possible. A statistical evaluation of the qualitative makeup of the microflora revealed that the same numerically dominant phenotypes were present regardless of sample type, sample time, or catamenial product. Predictable changes in total numbers among the dominant species were also noted when the data were evaluated by day of menstrual cycle. The correlation between the total numbers of each dominant species present was evaluated by day of cycle, and the findings are discussed. PMID:3435143

An Exploratory Study of the United States Naval Academy Engineering Curriculum

DTIC Science & Technology

2007-06-01

research was conducted in an entirely quantitative fashion. There is a large amount of qualitative data that was not analyzed. These data are from the... qualitative assessment of the Naval Academy’s engineering program, and would be an excellent opportunity for future research . Overall, the results of...California: Sage Publications. Patton, M. Q. (1987). How to Use Qualitative Methods in Evaluation. California: Sage Publications. 89

Inquiry-Based Stress Reduction Meditation Technique for Teacher Burnout: A Qualitative Study

ERIC Educational Resources Information Center

Schnaider-Levi, Lia; Mitnik, Inbal; Zafrani, Keren; Goldman, Zehavit; Lev-Ari, Shahar

2017-01-01

An inquiry-based intervention has been found to have a positive effect on burnout and mental well-being parameters among teachers. The aim of the current study was to qualitatively evaluate the effect of the inquiry-based stress reduction (IBSR) meditation technique on the participants. Semi-structured interviews were conducted before and after…

Designing a mixed methods study in primary care.

PubMed

Creswell, John W; Fetters, Michael D; Ivankova, Nataliya V

2004-01-01

Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research.

Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles

PubMed Central

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-01-01

Objectives Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. Data Sources All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. Study Design All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Principal Findings Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ2(1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ2(1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Conclusion Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. PMID:22092040

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Protocol for the mixed-methods process and context evaluation of the TB & Tobacco randomised controlled trial in Bangladesh and Pakistan: a hybrid effectiveness–implementation study

PubMed Central

Nohavova, Iveta; Dogar, Omara; Kralikova, Eva; Pankova, Alexandra; Zvolska, Kamila; Huque, Rumana; Fatima, Razia; Noor, Maryam; Elsey, Helen; Sheikh, Aziz; Siddiqi, Kamran; Kotz, Daniel

2018-01-01

Introduction Tuberculosis (TB) remains a significant public health problem in South Asia. Tobacco use increases the risks of TB infection and TB progression. The TB& Tobacco placebo-controlled randomised trial aims to (1) assess the effectiveness of the tobacco cessation medication cytisine versus placebo when combined with behavioural support and (2) implement tobacco cessation medication and behavioural support as part of general TB care in Bangladesh and Pakistan. This paper summarises the process and context evaluation protocol embedded in the effectiveness–implementation hybrid design. Methods and analysis We are conducting a mixed-methods process and context evaluation informed by an intervention logic model that draws on the UK Medical Research Council’s Process Evaluation Guidance. Our approach includes quantitative and qualitative data collection on context, recruitment, reach, dose delivered, dose received and fidelity. Quantitative data include patient characteristics, reach of recruitment among eligible patients, routine trial data on dose delivered and dose received, and a COM-B (‘capability’, ‘opportunity’, ‘motivation’ and ‘behaviour’) questionnaire filled in by participating health workers. Qualitative data include semistructured interviews with TB health workers and patients, and with policy-makers at district and central levels in each country. Interviews will be analysed using the framework approach. The behavioural intervention delivery is audio recorded and assessed using a predefined fidelity coding index based on behavioural change technique taxonomy. Ethics and dissemination The study complies with the guidelines of the Declaration of Helsinki. Ethics approval for the study and process evaluation was granted by the University of Leeds (qualitative components), University of York (trial data and fidelity assessment), Bangladesh Medical Research Council and Bangladesh Drug Administration (trial data and qualitative components) and Pakistan Medical Research Council (trial data and qualitative components). Results of this research will be disseminated through reports to stakeholders and peer-reviewed publications and conference presentations. Trial registration number ISRCTN43811467; Pre-results. PMID:29602847

Learning from Evaluation by Peer Team: A Case Study of a Family Counselling Organization

ERIC Educational Resources Information Center

Muniute-Cobb, Eivina I.; Alfred, Mary V.

2010-01-01

This qualitative study explores how employees learn from Team Primacy Concept-based employee evaluation and how they use the feedback in performing their jobs. Team Primacy Concept-based evaluation is a type of multirater evaluation. The distinctive characteristic of such evaluation is its peer feedback component during which the employee's…

Task sharing in rural Haiti: Qualitative assessment of a brief, structured training with and without apprenticeship supervision for community health workers

PubMed Central

McLean, Kristen E; Kaiser, Bonnie N; Hagaman, Ashley K; Wagenaar, Bradley H; Therosme, Tatiana P; Kohrt, Brandon A

2015-01-01

Despite growing support for supervision after task sharing trainings in humanitarian settings, there is limited research on the experience of trainees in apprenticeship and other supervision approaches. Studying apprenticeships from trainees’ perspectives is crucial to refine supervision and enhance motivation for service implementation. The authors implemented a multi-stage, transcultural adaptation for a pilot task sharing training in Haiti entailing three phases: 1) literature review and qualitative research to adapt a mental health and psychosocial support training; 2) implementation and qualitative process evaluation of a brief, structured group training; and 3) implementation and qualitative evaluation of an apprenticeship training, including a two year follow-up of trainees. Structured group training revealed limited knowledge acquisition, low motivation, time and resource constraints on mastery, and limited incorporation of skills into practice. Adding an apprenticeship component was associated with subjective clinical competency, increased confidence regarding utilising skills, and career advancement. Qualitative findings support the added value of apprenticeship according to trainees. PMID:26190953

Assessing healthcare professionals' experiences of integrated care: do surveys tell the full story?

PubMed

Stephenson, Matthew D; Campbell, Jared M; Lisy, Karolina; Aromataris, Edoardo C

2017-09-01

Integrated care is the combination of different healthcare services with the goal to provide comprehensive, seamless, effective and efficient patient care. Assessing the experiences of healthcare professionals (HCPs) is an important aspect when evaluating integrated care strategies. The aim of this rapid review was to investigate if quantitative surveys used to assess HCPs' experiences with integrated care capture all the aspects highlighted as being important in qualitative research, with a view to informing future survey development. The review considered all types of health professionals in primary care, and hospital and specialist services, with a specific focus on the provision of integrated care aimed at improving the patient journey. PubMed, CINAHL and grey literature sources were searched for relevant surveys/program evaluations and qualitative research studies. Full text articles deemed to be of relevance to the review were appraised for methodological quality using abridged critical appraisal instruments from the Joanna Briggs Institute. Data were extracted from included studies using standardized data extraction templates. Findings from included studies were grouped into domains based on similarity of meaning. Similarities and differences in the domains covered in quantitative surveys and those identified as being important in qualitative research were explored. A total of 37 studies (19 quantitative surveys, 14 qualitative studies and four mixed-method studies) were included in the review. A range of healthcare professions participated in the included studies, the majority being primary care providers. Common domains identified from quantitative surveys and qualitative studies included Communication, Agreement on Clear Roles and Responsibilities, Facilities, Information Systems, and Coordination of Care and Access. Qualitative research highlighted domains identified by HCPs as being relevant to their experiences with integrated care that have not routinely being surveyed, including Workload, Clear Leadership/Decision-Making, Management, Flexibility of Integrated Care Model, Engagement, Usefulness of Integrated Care and Collaboration, and Positive Impact/Clinical Benefits/Practice Level Benefits. There were several domains identified from qualitative research that are not routinely included in quantitative surveys to assess health professionals' experiences of integrated care. In addition, the qualitative findings suggest that the experiences of HCPs are often impacted by deeper aspects than those measured by existing surveys. Incorporation of targeted items within these domains in the design of surveys should enhance the capture of data that are relevant to the experiences of HCPs with integrated care, which may assist in more comprehensive evaluation and subsequent improvement of integrated care programs.

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study

PubMed Central

2014-01-01

Background Qualitative research is undertaken with randomized controlled trials of health interventions. Our aim was to explore the perceptions of researchers with experience of this endeavour to understand the added value of qualitative research to the trial in practice. Methods A telephone semi-structured interview study with 18 researchers with experience of undertaking the trial and/or the qualitative research. Results Interviewees described the added value of qualitative research for the trial, explaining how it solved problems at the pretrial stage, explained findings, and helped to increase the utility of the evidence generated by the trial. From the interviews, we identified three models of relationship of the qualitative research to the trial. In ‘the peripheral’ model, the trial was an opportunity to undertake qualitative research, with no intention that it would add value to the trial. In ‘the add-on’ model, the qualitative researcher understood the potential value of the qualitative research but it was viewed as a separate and complementary endeavour by the trial lead investigator and wider team. Interviewees described how this could limit the value of the qualitative research to the trial. Finally ‘the integral’ model played out in two ways. In ‘integral-in-theory’ studies, the lead investigator viewed the qualitative research as essential to the trial. However, in practice the qualitative research was under-resourced relative to the trial, potentially limiting its ability to add value to the trial. In ‘integral-in-practice’ studies, interviewees described how the qualitative research was planned from the beginning of the study, senior qualitative expertise was on the team from beginning to end, and staff and time were dedicated to the qualitative research. In these studies interviewees described the qualitative research adding value to the trial although this value was not necessarily visible beyond the original research team due to the challenges of publishing this research. Conclusions Health researchers combining qualitative research and trials viewed this practice as strengthening evaluative research. Teams viewing the qualitative research as essential to the trial, and resourcing it in practice, may have a better chance of delivering its added value to the trial. PMID:24913438

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study.

PubMed

O'Cathain, Alicia; Goode, Jackie; Drabble, Sarah J; Thomas, Kate J; Rudolph, Anne; Hewison, Jenny

2014-06-09

Qualitative research is undertaken with randomized controlled trials of health interventions. Our aim was to explore the perceptions of researchers with experience of this endeavour to understand the added value of qualitative research to the trial in practice. A telephone semi-structured interview study with 18 researchers with experience of undertaking the trial and/or the qualitative research. Interviewees described the added value of qualitative research for the trial, explaining how it solved problems at the pretrial stage, explained findings, and helped to increase the utility of the evidence generated by the trial. From the interviews, we identified three models of relationship of the qualitative research to the trial. In 'the peripheral' model, the trial was an opportunity to undertake qualitative research, with no intention that it would add value to the trial. In 'the add-on' model, the qualitative researcher understood the potential value of the qualitative research but it was viewed as a separate and complementary endeavour by the trial lead investigator and wider team. Interviewees described how this could limit the value of the qualitative research to the trial. Finally 'the integral' model played out in two ways. In 'integral-in-theory' studies, the lead investigator viewed the qualitative research as essential to the trial. However, in practice the qualitative research was under-resourced relative to the trial, potentially limiting its ability to add value to the trial. In 'integral-in-practice' studies, interviewees described how the qualitative research was planned from the beginning of the study, senior qualitative expertise was on the team from beginning to end, and staff and time were dedicated to the qualitative research. In these studies interviewees described the qualitative research adding value to the trial although this value was not necessarily visible beyond the original research team due to the challenges of publishing this research. Health researchers combining qualitative research and trials viewed this practice as strengthening evaluative research. Teams viewing the qualitative research as essential to the trial, and resourcing it in practice, may have a better chance of delivering its added value to the trial.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

Academic Impact of Qualitative Studies in Healthcare: Bibliometric Analysis

PubMed Central

Mori, Hiroko; Nakayama, Takeo

2013-01-01

Context Although qualitative studies are becoming more appreciated in healthcare, the number of publications of quality studies remains low. Little is known about the frequency and characteristics of citation in qualitative studies. Objective To compare the academic impact of qualitative studies to that of two quantitative studies: systematic reviews and randomized controlled trials. Methods Publications in BMJ between 1997 and 2006 (BMJ’s median impact factor was 7.04 during this period) employing qualitative methods were matched to two quantitative studies appearing the same year using PubMed. Using Web of Science, citations within a 24-month publication period were determined. Additionally, three hypotheses were examined: qualitative studies are 1) infrequently cited in original articles or reviews; 2) rarely cited by authors in non-English-speaking countries; and 3) more frequently cited in non-medical disciplines (e.g., psychology or sociology). Results A total of 121 qualitative studies, 270 systematic reviews, and 515 randomised controlled trials were retrieved. Qualitative studies were cited a total of 1,089 times, with a median of 7.00 times (range, 0–34) for each study. Matched systematic reviews and randomized controlled trials were cited 2,411times and 1,600 times, respectively. With respect to citing documents, original articles and reviews exceeded 60% for each study design. Relative to quantitative studies, qualitative studies were cited more often by authors in English-speaking countries. With respect to subject area, medical disciplines were more frequently cited than non-medical disciplines for all three study designs (>80%). Conclusion The median number of citations for qualitative studies was almost the same as the median of BMJ’s impact factor during the survey period. For a suitable evaluation of qualitative studies in healthcare, it will be necessary to develop a reporting framework and include explicit discussions of clinical implications when reporting findings. Coordination between researchers and editors will be needed to achieve this goal. PMID:23516404

A human factors systems approach to understanding team-based primary care: a qualitative analysis

PubMed Central

Mundt, Marlon P.; Swedlund, Matthew P.

2016-01-01

Background. Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. Objective. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. Methods. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Results. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Conclusions. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. PMID:27578837

A Qualitative Evaluation of Ethics Educational Program in Health Science.

PubMed

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-06-01

This paper originates from a panel discussion on the evaluation of "Ethics Educational Program in Health Sciences" held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs.

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions

PubMed Central

Abildgaard, Johan S.; Saksvik, Per Ø.; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire (N = 285) as well as an extensive interview study (N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies. PMID:27713707

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions.

PubMed

Abildgaard, Johan S; Saksvik, Per Ø; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire ( N = 285) as well as an extensive interview study ( N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies.

From Qualitative to Quantitative and Back Again: Philosophical and Methodological Transitions.

ERIC Educational Resources Information Center

Fetterman, David M.

Allegations by a resigning employee of intimidation, cover-up, unethical behavior, legal violations, waste, and mismanagement were investigated at a major university, relying on confidential interviews and a review of relevant documentation. The case study of this evaluation illustrates the advantages of a mix of qualitative and quantitative…

New Statistical Techniques for Evaluating Longitudinal Models.

ERIC Educational Resources Information Center

Murray, James R.; Wiley, David E.

A basic methodological approach in developmental studies is the collection of longitudinal data. Behavioral data cen take at least two forms, qualitative (or discrete) and quantitative. Both types are fallible. Measurement errors can occur in quantitative data and measures of these are based on error variance. Qualitative or discrete data can…

Alumni Perspectives on Career Preparation during a Postdoctoral Training Program: A Qualitative Study

ERIC Educational Resources Information Center

Faupel-Badger, Jessica M.; Raue, Kimberley; Nelson, David E.; Tsakraklides, Sophia

2015-01-01

Published evaluations of career preparation of alumni from long-standing postdoctoral fellowship programs in the biomedical sciences are limited and often focus on quantitative analysis of data from extant publicly available sources. Qualitative methods provide the opportunity to gather robust information about specific program elements from…

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

PubMed

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development. To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care. Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients' experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor's knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. 'Resistance' emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines. The synthesis of studies of lay experiences of living with rheumatoid arthritis began with 29 papers. Four could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with rheumatoid arthritis. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory. In both topic areas, only a minority of the studies included in the syntheses were found to have referenced each other, suggesting that unnecessary replication had occurred. We only evaluated meta-ethnography as a method for synthesising qualitative research, but there are other methods being employed. Further research is required to investigate how different methods of qualitative synthesis influence the outcome of the synthesis. Meta-ethnography is an effective method for synthesising qualitative research. The process of reciprocally translating the findings from each individual study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a 'line of argument' that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, but not all meta-ethnographic syntheses do so. Instead, some will identify fields in which saturation has been reached and in which no theoretical development has taken place for some time. Both outcomes are helpful in either moving research forward or avoiding wasted resources. Meta-ethnography is a highly interpretative method requiring considerable immersion in the individual studies to achieve a synthesis. It places substantial demands upon the synthesiser and requires a high degree of qualitative research skill. Meta-ethnography has great potential as a method of synthesis in qualitative health technology assessment but it is still evolving and cannot, at present, be regarded as a standardised approach capable of application in a routinised way. Funding for this study was provided by the Health Technology Assessment programme of the National Institute for Health Research.

Evaluating Work-Based Learning: Insights from an Illuminative Evaluation Study of Work-Based Learning in a Vocational Qualification

ERIC Educational Resources Information Center

van Rensburg, Estelle

2008-01-01

This article outlines an illuminative evaluation study of the work-based module in a vocational qualification in Animal Health offered for the paraveterinary industry by a distance education institution in South Africa. In illuminative evaluation, a programme is studied by qualitative methods to gain an in-depth understanding of its…

Prospects for Public Library Evaluation.

ERIC Educational Resources Information Center

Van House, Nancy A.; Childers, Thomas

1991-01-01

Discusses methods of evaluation that can be used to measure public library effectiveness, based on a conference sponsored by the Council on Library Resources. Topics discussed include the Public Library Effectiveness Study (PLES), quantitative and qualitative evaluation, using evaluative information for resource acquisition and resource…

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing students’ clinical competencies seems necessary. PMID:24554959

Evaluating Creative Thinking of Rn-Bsn Students in the Course of Clinical Case Study and Practicum

ERIC Educational Resources Information Center

Ku, Ya-Lie

2015-01-01

This case study evaluated creative thinking of RN-BSN students in the course of clinical case study and practicum. Study design used quantitative and qualitative evaluations of creative thinking of RN-BSN students by triangulation method in the course of clinical case study and practicum. Sixty RN-BSN students self-perceived the changing levels of…

Evaluation of board performance in Iran's universities of medical sciences.

PubMed

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-10-01

The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Participants believed that the boards had no acceptable performance for a long time.RESULTS also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards' resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process.

Evaluation of board performance in Iran’s universities of medical sciences

PubMed Central

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-01-01

Background: The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. Methods: The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Results: Participants believed that the boards had no acceptable performance for a long time.Results also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards’ resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Conclusion: Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process. PMID:25337597

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study

PubMed Central

Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-01-01

Background To improve workers’ health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. Objective The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Methods Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Results Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Conclusions Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users’ characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees’ mental models; practicability; resources; and skills required of experts and users. PMID:29592846

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

PubMed

de Korte, Elsbeth Marieke; Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-03-28

To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users. ©Elsbeth Marieke de Korte, Noortje Wiezer, Joris H Janssen, Peter Vink, Wessel Kraaij. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 28.03.2018.

Designing A Mixed Methods Study In Primary Care

PubMed Central

Creswell, John W.; Fetters, Michael D.; Ivankova, Nataliya V.

2004-01-01

BACKGROUND Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. METHODS We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. RESULTS Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. DISCUSSION We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research. PMID:15053277

Complicity Revisited: Balancing Stakeholder Input and Roles in Evaluation Use

ERIC Educational Resources Information Center

Sturges, Keith M.

2015-01-01

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

Process evaluations of task sharing interventions for perinatal depression in low and middle income countries (LMIC): a systematic review and qualitative meta-synthesis.

PubMed

Munodawafa, Memory; Mall, Sumaya; Lund, Crick; Schneider, Marguerite

2018-03-23

Perinatal depression is common in low and middle income countries (LAMICs). Task sharing interventions have been implemented to treat perinatal depression in these settings, as a way of dealing with staff shortages. Task sharing allows lay health workers to provide services for less complex cases while being trained and supervised by specialists. Randomized controlled trials suggest that these interventions can be effective but there is limited qualitative information exploring barriers and facilitators to their implementation. This systematic review aims to systematically review current qualitative evidence of process evaluations of task sharing interventions for perinatal depression in LAMICs in relation to the United Kingdom (UK) Medical Research Council (MRC) framework for conducting process evaluations. We searched Medline/ PubMed, PsycINFO, Scopus, Cochrane Library and Web of science for studies from LAMICS using search terms under the broad categories of: (a) "maternal depression'" (b) "intervention" (c) "lay counsellor" OR "community health worker" OR "non-specialist" and (d) "LAMICs". Abstracts were independently reviewed for inclusion by two authors. Full text articles were screened and data for included articles were extracted using a standard data extraction sheet. Qualitative synthesis of qualitative evidence was conducted. 8420 articles were identified from initial searches. Of these, 26 full text articles were screened for eligibility with only three studies meeting the inclusion criteria. Main findings revealed that participants identified the following crucial factors: contextual factors included physical location, accessibility and cultural norms. Implementation factors included acceptability of the intervention and characteristics of the personnel. Mechanisms included counsellor factors such as motivating and facilitating trust; intervention factors such as use of stories and visual aids, and understandability of the content; and participant factors such as shared experience, meeting learning needs, and meeting expectations. While task sharing has been suggested as an effective way of filling the treatment gap for perinatal depression, there is a paucity of qualitative research exploring barriers and facilitators to implementing these interventions. Qualitative process evaluations are crucial for the development of culturally relevant interventions.

A Question-Answer System for Mobile Devices in Lecture-Based Instruction: A Qualitative Analysis of Student Engagement and Learning

ERIC Educational Resources Information Center

Hatun Atas, Amine; Delialioglu, Ömer

2018-01-01

The aim of this study was to explore the opinions, perceptions and evaluations of students about their experiences with a question-answer system used on mobile devices in a lecture-based course. Basic qualitative research method was employed in this study to understand how students made sense of their experiences during the instruction. The…

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

An Interprofessional Program Evaluation Case Study: Utilizing Multiple Measures To Assess What Matters. AIR 1997 Annual Forum Paper.

ERIC Educational Resources Information Center

Delaney, Anne Marie

This paper reviews the first two years of a model program-evaluation case study which is intended to show: (1) how program evaluation can contribute to academic and professional degree programs; (2) how qualitative and quantitative techniques can be used to produce reliable measures for evaluation studies; and (3) how the role of the institutional…

Recent advances in the use of NIR spectroscopy for qualitative control and protection of extra virgin olive oil

USDA-ARS?s Scientific Manuscript database

Recent studies on the use of near infrared (NIR) spectroscopy for the qualitative characterization of extra virgin olive oil, are reported and discussed in this paper. Research results confirms that NIR spectroscopy, combined with chemometric data analysis, allows to simultaneously evaluate all qual...

Nondestructive evaluation of degradation in papaya fruit using intensity based algorithms

NASA Astrophysics Data System (ADS)

Kumari, Shubhashri; Nirala, Anil Kumar

2018-05-01

In the proposed work degradation in Papaya fruit has been evaluated nondestructively using laser biospeckle technique. The biospeckle activity inside the fruit has been evaluated qualitatively and quantitatively during its maturity to degradation stage using intensity based algorithms. Co-occurrence matrix (COM) has been used for qualitative analysis whereas Inertia Moment (IM), Absolute value Difference (AVD) and Autocovariance methods have been used for quantitative analysis. The biospeckle activity has been found to first increase and then decrease during study period of five days. In addition Granulometric size distribution (GSD) has also been used for the first time for the evaluation of degradation of the papaya. It is concluded that the degradation process of papaya fruit can be evaluated nondestructively using all the mentioned algorithms.

A Qualitative Evaluation of Ethics Educational Program in Health Science1

PubMed Central

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-01-01

This paper originates from a panel discussion on the evaluation of “Ethics Educational Program in Health Sciences” held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs. PMID:26664129

A qualitative review of immigrant women's experiences of maternal adaptation in South Korea.

PubMed

Song, Ju-Eun; Ahn, Jeong-Ah; Kim, Tiffany; Roh, Eun Ha

2016-08-01

to synthesise the evidence of immigrant women's experiences of maternal adaptation in Korea. eligible studies were identified by searching MEDLINE, CINAHL, and the Korean electronic databases. Qualitative research studies, published in English and Korean addressing maternal adaptation experiences of immigrant women by marriage in Korea, were considered in the review. The suitability of the quality of articles was evaluated using the Joanna Briggs Institute's Critical Appraisal Checklist. Fifteen studies met the inclusion criteria for data analysis. Authors, purpose of the study, study design, theoretical framework, population (nationality and sample size), data collection (setting and method), and main study findings were extracted and summarised in a data extraction form for further narrative analysis and synthesis. A qualitative systematic review was performed by means of thematic synthesis. the literature search identified 7,628 articles, of which 15 studies, published between 2009 and 2014, were evaluated in the systematic review. Two overarching categories including five themes were identified in the qualitative studies related to maternal adaptation experiences; 'Experiences of motherhood transition' and 'Experiences of child-rearing'. these findings demonstrate the importance of understanding and improving maternal adaptation of immigrant women living in Korea. This can be achieved by enhancing social support, providing culturally sensitive maternal healthcare services, and expanding opportunities for immigrant women in education, job training, and economic independence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Teacher Perceptions about New Evaluation Model Implementations

ERIC Educational Resources Information Center

Bush, Charles D.

2017-01-01

The challenge of designing and implementing teacher evaluation reform throughout the U.S. has been represented by different policies, teacher evaluation components, and difficulties with implementation. The purpose of this qualitative embedded single case study was to explore teacher perceptions about new evaluation model implementations and how…

Methodological reporting in qualitative, quantitative, and mixed methods health services research articles.

PubMed

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-04-01

Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. © Health Research and Educational Trust.

A model for using the VIPS framework for person-centred care for persons with dementia in nursing homes: a qualitative evaluative study.

PubMed

Røsvik, Janne; Kirkevold, Marit; Engedal, Knut; Brooker, Dawn; Kirkevold, Øyvind

2011-09-01

The 'VIPS' framework sums up the elements in Kitwood's philosophy of person-centred care (PCC) for persons with dementia as values, individualised approach, the perspective of the person living with dementia and social environment. There are six indicators for each element. Aim.  To conduct an initial evaluation of a model aimed at facilitating the application of the VIPS framework. Qualitative evaluative study. A model was trialled in a 9-week pilot study in two nursing homes and evaluated in four focus groups using qualitative content analysis. Five themes emerged: (1) Legitimacy of the model was secured when central roles were held by nurses representing the majority of the staff; (2) The model facilitated the staff's use of their knowledge of PCC; (3) Support to the persons holding the internal facilitating roles in the model was needed; (4) The authority of the leading registered nurse in the ward was crucial to support the legitimacy of the model and (5) Form of organisation seemed to be of importance in how the model was experienced. The model worked best in wards organised with a leading registered nurse who could support an auxiliary nurse holding the facilitating function. © 2011 Blackwell Publishing Ltd.

Issues and Research in Special Education. Volume 2.

ERIC Educational Resources Information Center

Gaylord-Ross, Robert, Ed.

This compilation presents five papers on issues and research in special education. "Qualitative Research in Special Education: An Evaluative Review" (Charles A. Peck and Gail C. Furman) explicates some of the epistemological assumptions underlying qualitative research methods, reviews examples of qualitative research, evaluates the contributions…

The Effect of Student Evaluations on Faculty Performance

ERIC Educational Resources Information Center

Hartford, Kenneth M.

2017-01-01

The purpose of this study was to understand the behavior of professors as a consequence of receiving student evaluations. To address this purpose, a single research question directed this study: In what ways and to what extent might faculty compromise good pedagogical practices for positive student evaluations of teaching? A qualitative research…

Integrating qualitative research into evidence based practice.

PubMed

Greenhalgh, Trisha

2002-09-01

This article attempts to provide an overview of qualitative tools and methods using mainly examples from diabetes research. The other articles in this issue of the Endocrinology and Metabolism Clinics of North America have demonstrated the enormous contribution made in the past 15 years or so by rigorous quantitative studies of prevalence, diagnosis, prognosis, and therapy to clinical decision-making in endocrinology. In the early 21st century, the state of qualitative research into such topics as the illness experience of diabetes; the barriers to effective self care and positive health choices; the design of complex educational interventions; the design of appropriate, acceptable and responsive health services; and the decision-making behavior of health professionals, is such that there remain many more questions than answers. But qualitative research is increasingly recognized as an important, legitimate and expanding dimension of evidence-based health care (18;19). It is highly likely that the major landmark studies in diabetes care over the next decade will build on an exploratory qualitative study or incorporate an explanatory or evaluative dimension based on qualitative methods.

Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

PubMed

Cypress, Brigitte S

Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.

Impact of Participation in TimeSlips, a Creative Group-Based Storytelling Program, on Medical Student Attitudes Toward Persons With Dementia: A Qualitative Study

PubMed Central

George, Daniel R.; Stuckey, Heather L.; Dillon, Caroline F.; Whitehead, Megan M.

2011-01-01

Purpose: To evaluate whether medical student participation in TimeSlips (TS), a creative group-based storytelling program, with persons affected by dementia would improve student attitudes toward this patient population. Design and Methods: Fifteen fourth-year medical students from Penn State College of Medicine participated in a month-long regimen of TS sessions at a retirement community. Student course evaluations were analyzed at the conclusion of the program to examine perceived qualitative changes in attitude. Findings: Qualitative data revealed insights into the manner in which student attitudes toward a geriatric patient population became more positive. Implications: This is the first known pilot study to suggest that participation in a creative group-based storytelling program might improve medical student attitudes toward persons with dementia. PMID:21665958

An Approach to Using Toxicogenomic Data in US EPA Human ...

EPA Pesticide Factsheets

This draft report is a description of an approach to evaluate genomic data for use in risk assessment and a case study to illustrate the approach. The dibutyl phthalate (DBP) case study example focuses on male reproductive developmental effects and the qualitative application of the available genomic data. The case study presented in this draft document is a separate activity from any of the ongoing IRIS human health assessments for the phthalates. This draft report is a description of an approach to evaluate genomic data for use in risk assessment and a case study to illustrate the approach. The dibutyl phthalate (DBP) case study example focuses on male reproductive developmental effects and the qualitative application of the available genomic data.

Evaluation of Multimedia Authoring Instruction Based in a Behaviorist-Cognitive-Constructivist Continuum.

ERIC Educational Resources Information Center

Sherry, Annette C.

1998-01-01

This evaluative case study examines the learning experiences of graduate students studying effective multimedia authoring. Continuum-based instructional design, behaviorism, cognitivism, constructivism, collaboration, the role of a matrix, transfer of training, and qualitative and quantitative results are discussed. (LRW)

How to Read a Research Paper

MedlinePlus

... book is not reviewed by other scientists to evaluate the content. Make sure the article is written ... models, meta-analyses, and qualitative studies. You should evaluate each of these differently. Experiments If the article ...

Interlaboratory study of DNA extraction from multiple ground samples, multiplex real-time PCR, and multiplex qualitative PCR for individual kernel detection system of genetically modified maize.

PubMed

Akiyama, Hiroshi; Sakata, Kozue; Makiyma, Daiki; Nakamura, Kosuke; Teshima, Reiko; Nakashima, Akie; Ogawa, Asako; Yamagishi, Toru; Futo, Satoshi; Oguchi, Taichi; Mano, Junichi; Kitta, Kazumi

2011-01-01

In many countries, the labeling of grains, feed, and foodstuff is mandatory if the genetically modified (GM) organism content exceeds a certain level of approved GM varieties. We previously developed an individual kernel detection system consisting of grinding individual kernels, DNA extraction from the individually ground kernels, GM detection using multiplex real-time PCR, and GM event detection using multiplex qualitative PCR to analyze the precise commingling level and varieties of GM maize in real sample grains. We performed the interlaboratory study of the DNA extraction with multiple ground samples, multiplex real-time PCR detection, and multiplex qualitative PCR detection to evaluate its applicability, practicality, and ruggedness for the individual kernel detection system of GM maize. DNA extraction with multiple ground samples, multiplex real-time PCR, and multiplex qualitative PCR were evaluated by five laboratories in Japan, and all results from these laboratories were consistent with the expected results in terms of the commingling level and event analysis. Thus, the DNA extraction with multiple ground samples, multiplex real-time PCR, and multiplex qualitative PCR for the individual kernel detection system is applicable and practicable in a laboratory to regulate the commingling level of GM maize grain for GM samples, including stacked GM maize.

A human factors systems approach to understanding team-based primary care: a qualitative analysis.

PubMed

Mundt, Marlon P; Swedlund, Matthew P

2016-12-01

Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Impact of Disciplinary Background and Teaching Experience on the Use of Evaluative Language in Teacher Feedback

ERIC Educational Resources Information Center

Hu, Guangwei; Choo, Lilin

2016-01-01

This study was designed to examine secondary teachers' use of evaluative language resources in their qualitative written feedback on student work and factors shaping the deployment of such resources. Drawing on appraisal theory as an analytic framework for the language of evaluation, the study analyzed 84 teachers' evaluative reports on their…

Capturing the experiences of patients across multiple complex interventions: a meta-qualitative approach

PubMed Central

Webster, Fiona; Christian, Jennifer; Mansfield, Elizabeth; Bhattacharyya, Onil; Hawker, Gillian; Levinson, Wendy; Naglie, Gary; Pham, Thuy-Nga; Rose, Louise; Schull, Michael; Sinha, Samir; Stergiopoulos, Vicky; Upshur, Ross; Wilson, Lynn

2015-01-01

Objectives The perspectives, needs and preferences of individuals with complex health and social needs can be overlooked in the design of healthcare interventions. This study was designed to provide new insights on patient perspectives drawing from the qualitative evaluation of 5 complex healthcare interventions. Setting Patients and their caregivers were recruited from 5 interventions based in primary, hospital and community care in Ontario, Canada. Participants We included 62 interviews from 44 patients and 18 non-clinical caregivers. Intervention Our team analysed the transcripts from 5 distinct projects. This approach to qualitative meta-evaluation identifies common issues described by a diverse group of patients, therefore providing potential insights into systems issues. Outcome measures This study is a secondary analysis of qualitative data; therefore, no outcome measures were identified. Results We identified 5 broad themes that capture the patients’ experience and highlight issues that might not be adequately addressed in complex interventions. In our study, we found that: (1) the emergency department is the unavoidable point of care; (2) patients and caregivers are part of complex and variable family systems; (3) non-medical issues mediate patients’ experiences of health and healthcare delivery; (4) the unanticipated consequences of complex healthcare interventions are often the most valuable; and (5) patient experiences are shaped by the healthcare discourses on medically complex patients. Conclusions Our findings suggest that key assumptions about patients that inform intervention design need to be made explicit in order to build capacity to better understand and support patients with multiple chronic diseases. Across many health systems internationally, multiple models are being implemented simultaneously that may have shared features and target similar patients, and a qualitative meta-evaluation approach, thus offers an opportunity for cumulative learning at a system level in addition to informing intervention design and modification. PMID:26351182

Discovering the Future of the Case Study Method in Evaluation Research.

ERIC Educational Resources Information Center

Yin, Robert K.

1994-01-01

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

Qualitative methods in PhD theses from general practice in Scandinavia.

PubMed

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-12-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox.

Qualitative methods in PhD theses from general practice in Scandinavia

PubMed Central

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-01-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox. PMID:29094644

External Evaluation as Contract Work: The Production of Evaluator Identity

ERIC Educational Resources Information Center

Sturges, Keith M.

2014-01-01

Extracted from a larger study of the educational evaluation profession, this qualitative analysis explores how evaluator identity is shaped with constant reference to political economy, knowledge work, and personal history. Interviews with 24 social scientists who conduct or have conducted evaluations as a major part of their careers examined how…

Evaluation of Educational Administration: A Decade Review of Research (2001-2010)

ERIC Educational Resources Information Center

Parylo, Oksana

2012-01-01

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

A Qualitative Study of the Treatment Improvement Protocols (TIPs): An Assessment of the Use of TIPs by Individuals Affiliated with the Addiction Technology Transfer Centers (ATTCs).

ERIC Educational Resources Information Center

Hayashi, Susan W.; Suzuki, Marcia; Hubbard, Susan M.; Huang, Judy Y.; Cobb, Anita M.

2003-01-01

Evaluated the Addiction Technology Transfer Centers (ATTCs) of the Center for Substance Abuse Treatment (CSAT) as a means of diffusion of innovations, focusing on use of the Treatment Improvement Protocols (TIPs). Qualitative studies at 6 ATTCs that included 57 interviews show that the CSAT is at the forefront of providing resources to the…

Understanding the Impact of Organizational Power on Evaluation Outcomes

ERIC Educational Resources Information Center

Kim, Hanbyul; Cervero, Ronald M.

2007-01-01

The purpose of this study is to examine how power relations among stakeholders, especially between the human resource development (HRD) practitioners and others, affect evaluation outcomes. Using a qualitative case study design, a managerial leadership development programme in a Korean company is analysed. This study shows that the HRD…

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

The Design, Development, and Evaluation of a Qualitative Data Collection Application for Pregnant Women.

PubMed

Keedle, Hazel; Schmied, Virginia; Burns, Elaine; Dahlen, Hannah

2018-01-01

This article explores the development and evaluation of a smartphone mobile software application (app) to collect qualitative data. The app was specifically designed to capture real-time qualitative data from women planning a vaginal birth after caesarean delivery. This article outlines the design and development of the app to include funding, ethics, and the recruitment of an app developer, as well as the evaluation of using the app by seven participants. Data collection methods used in qualitative research include interviews and focus groups (either online, face-to-face, or by phone), participant diaries, or observations of interactions. This article identifies an alternative data collection methodology using a smartphone app to collect real-time data. The app provides real-time data and instant access to data alongside the ability to access participants from a variety of locations. This allows the researcher to gain insight into the experiences of participants through audio or video recordings in longitudinal studies without the need for constant interactions or interviews with participants. Using smartphone applications can allow researchers to access participants who are traditionally hard to reach and access their data in real time. Evaluating these apps before use in research is invaluable. © 2017 Sigma Theta Tau International.

Criteria for quantitative and qualitative data integration: mixed-methods research methodology.

PubMed

Lee, Seonah; Smith, Carrol A M

2012-05-01

Many studies have emphasized the need and importance of a mixed-methods approach for evaluation of clinical information systems. However, those studies had no criteria to guide integration of multiple data sets. Integrating different data sets serves to actualize the paradigm that a mixed-methods approach argues; thus, we require criteria that provide the right direction to integrate quantitative and qualitative data. The first author used a set of criteria organized from a literature search for integration of multiple data sets from mixed-methods research. The purpose of this article was to reorganize the identified criteria. Through critical appraisal of the reasons for designing mixed-methods research, three criteria resulted: validation, complementarity, and discrepancy. In applying the criteria to empirical data of a previous mixed methods study, integration of quantitative and qualitative data was achieved in a systematic manner. It helped us obtain a better organized understanding of the results. The criteria of this article offer the potential to produce insightful analyses of mixed-methods evaluations of health information systems.

Qualitative and quantitative evaluation of some vocal function parameters following fitting of a prosthesis.

PubMed

Cavalot, A L; Palonta, F; Preti, G; Nazionale, G; Ricci, E; Vione, N; Albera, R; Cortesina, G

2001-12-01

The insertion of a prosthesis and restoration with pectoralis major myocutaneous flaps for patients subjected to total pharyngolaryngectomy is a technique now universally accepted; however the literature on the subject is lacking. Our study considers 10 patients subjected to total pharyngolaryngectomy and restoration with pectoralis major myocutaneous flaps who were fitted with vocal function prostheses and a control group of 50 subjects treated with a total laryngectomy without pectoralis major myocutaneous flaps and who were fitted with vocal function prostheses. Specific qualitative and quantitative parameters were compared. The quantitative measurement of the levels of voice intensity and the evaluation of the harmonics-to-noise ratio were not statistically significant (p > 0.05) between the two study groups at either high- or low-volume speech. On the contrary, statistically significant differences were found (p < 0.05) for the basic frequency of both the low and the high volume voice. For the qualitative analysis seven parameters were established for evaluation by trained and untrained listeners: on the basis of these parameters the control group had statistically better voices.

Active thermography in qualitative evaluation of protective materials.

PubMed

Gralewicz, Grzegorz; Wiecek, Bogusław

2009-01-01

This is a study of the possibilities of a qualitative evaluation of protective materials with active thermography. It presents a simulation of a periodic excitation of a multilayer composite material. Tests were conducted with lock-in thermography on Kevlar composite consisting of 16 layers of Kevlar fabric reinforced with formaldehyde resin with implanted delamination defects. Lock-in thermography is a versatile tool for nondestructive evaluation. It is a fast, remote and nondestructive procedure. Hence, it was used to detect delaminations in the composite structure of materials used in the production of components designed for personal protection. This method directly contributes to an improvement in safety.

Evaluating the comparative effectiveness of different demand side interventions to increase maternal health service utilization and practice of birth spacing in South Kivu, Democratic Republic of Congo: an innovative, mixed methods approach.

PubMed

Dumbaugh, Mari; Bapolisi, Wyvine; van de Weerd, Jennie; Zabiti, Michel; Mommers, Paula; Balaluka, Ghislain Bisimwa; Merten, Sonja

2017-07-03

In this protocol we describe a mixed methods study in the province of South Kivu, Democratic Republic of Congo evaluating the effectiveness of different demand side strategies to increase maternal health service utilization and the practice of birth spacing. Conditional service subsidization, conditional cash transfers and non-monetary incentives aim to encourage women to use maternal health services and practice birth spacing in two different health districts. Our methodology will comparatively evaluate the effectiveness of different approaches against each other and no intervention. This study comprises four main research activities: 1) Formative qualitative research to determine feasibility of planned activities and inform development of the quantitative survey; 2) A community-based, longitudinal survey; 3) A retrospective review of health facility records; 4) Qualitative exploration of intervention acceptability and emergent themes through in-depth interviews with program participants, non-participants, their partners and health providers. Female community health workers are engaged as core members of the research team, working in tandem with female survey teams to identify women in the community who meet eligibility criteria. Female community health workers also act as key informants and community entry points during methods design and qualitative exploration. Main study outcomes are completion of antenatal care, institutional delivery, practice of birth spacing, family planning uptake and intervention acceptability in the communities. Qualitative methods also explore decision making around maternal health service use, fertility preference and perceptions of family planning. The innovative mixed methods design allows quantitative data to inform the relationships and phenomena to be explored in qualitative collection. In turn, qualitative findings will be triangulated with quantitative findings. Inspired by the principles of grounded theory, qualitative analysis will begin while data collection is ongoing. This "conversation" between quantitative and qualitative data will result in a more holistic, context-specific exploration and understanding of research topics, including the mechanisms through which the interventions are or are not effective. In addition, engagement of female community health workers as core members of the research team roots research methods in the realities of the community and provides teams with key informants who are simultaneously implicated in the health system, community and target population.

Evaluating Research Administration: Methods and Utility

ERIC Educational Resources Information Center

Marina, Sarah; Davis-Hamilton, Zoya; Charmanski, Kara E.

2015-01-01

Three studies were jointly conducted by the Office of Research Administration and Office of Proposal Development at Tufts University to evaluate the services within each respective office. The studies featured assessments that used, respectively, (1) quantitative metrics; (2) a quantitative satisfaction survey with limited qualitative questions;…

Evaluation of Turkish Grammar Instruction Based on Primary School Teachers' Opinions

ERIC Educational Resources Information Center

Anilan, Hüseyin

2014-01-01

This study aims to evaluate the effectiveness of the holistic approach to Turkish grammar instruction in the first stage of primary education from the opinions and experiences of Turkish primary school teachers. This study is a qualitative research designed as a phenomenological study. The study participants were selected using maximum variation…

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

The Lesser of Two Evils? A Qualitative Study of Offenders' Preferences for Prison Compared to Alternatives

ERIC Educational Resources Information Center

Williams, Alisha; May, David C.; Wood, Peter B.

2008-01-01

Recent work has demonstrated that many offenders will choose to serve prison rather than any amount of a community-based sanction. This primarily quantitative research has found that offender-generated exchange rates are influenced by a wide variety of experiences and characteristics. Missing from this literature is a qualitative evaluation of…

A Qualitative Evaluation of Perceptions of the Role of Competition in the Success and Distress of Law Students

ERIC Educational Resources Information Center

Stallman, Helen

2012-01-01

This qualitative study investigated the role of competition in the success and distress of law students. Participants from an Australian law faculty attended one of four focus groups (undergraduate, postgraduate, academic staff and administrative staff). They discussed their perceptions of competition, the competitive behaviours in law students,…

In the Eye of the Beholder: Mothers' Perceptions of Poor Neighborhoods as Places to Raise Children

ERIC Educational Resources Information Center

Dahl, Trayci; Ceballo, Rosario; Huerta, Marisela

2010-01-01

This study explores how mothers facing similar neighborhood conditions evaluate their neighborhoods as places to raise children. The authors relied upon a triangulation of methods, using both quantitative and qualitative methodologies, with a sample of 91 low-income mothers. Content analysis of qualitative interviews revealed that mothers often…

77 FR 47617 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-09

... information technology. Please note that written comments received in response to this notice will be... conducting qualitative case studies of up to 15 sites with a focus on preventing students from dropping out... qualitative data across multiple respondents to generate portraits of programs and strategies that the sites...

On Becoming Allies: A Qualitative Study of Lesbian-, Gay-, and Bisexual-Affirmative Counselor Training

ERIC Educational Resources Information Center

Dillon, Frank R.; Worthington, Roger L.; Savoy, Holly Bielstein; Rooney, S. Craig; Becker-Schutte, Ann; Guerra, Rachael M.

2004-01-01

The authors present a qualitative analysis of a process by which a research team of counselors-in-training confronted their heterosexist biases while investigating heterosexual attitudes toward sexual minorities. Members of the research team discovered that it was essential to reflect on and evaluate their attitudes, assumptions, and biases before…

On the evaluation of segmentation editing tools

PubMed Central

Heckel, Frank; Moltz, Jan H.; Meine, Hans; Geisler, Benjamin; Kießling, Andreas; D’Anastasi, Melvin; dos Santos, Daniel Pinto; Theruvath, Ashok Joseph; Hahn, Horst K.

2014-01-01

Abstract. Efficient segmentation editing tools are important components in the segmentation process, as no automatic methods exist that always generate sufficient results. Evaluating segmentation editing algorithms is challenging, because their quality depends on the user’s subjective impression. So far, no established methods for an objective, comprehensive evaluation of such tools exist and, particularly, intermediate segmentation results are not taken into account. We discuss the evaluation of editing algorithms in the context of tumor segmentation in computed tomography. We propose a rating scheme to qualitatively measure the accuracy and efficiency of editing tools in user studies. In order to objectively summarize the overall quality, we propose two scores based on the subjective rating and the quantified segmentation quality over time. Finally, a simulation-based evaluation approach is discussed, which allows a more reproducible evaluation without the need for human input. This automated evaluation complements user studies, allowing a more convincing evaluation, particularly during development, where frequent user studies are not possible. The proposed methods have been used to evaluate two dedicated editing algorithms on 131 representative tumor segmentations. We show how the comparison of editing algorithms benefits from the proposed methods. Our results also show the correlation of the suggested quality score with the qualitative ratings. PMID:26158063

Exploring the gender gap in the conceptual survey of electricity and magnetism

NASA Astrophysics Data System (ADS)

Henderson, Rachel; Stewart, Gay; Stewart, John; Michaluk, Lynnette; Traxler, Adrienne

2017-12-01

The "gender gap" on various physics conceptual evaluations has been extensively studied. Men's average pretest scores on the Force Concept Inventory and Force and Motion Conceptual Evaluation are 13% higher than women's, and post-test scores are on average 12% higher than women's. This study analyzed the gender differences within the Conceptual Survey of Electricity and Magnetism (CSEM) in which the gender gap has been less well studied and is less consistent. In the current study, data collected from 1407 students (77% men, 23% women) in a calculus-based physics course over ten semesters showed that male students outperformed female students on the CSEM pretest (5%) and post-test (6%). Separate analyses were conducted for qualitative and quantitative problems on lab quizzes and course exams and showed that male students outperformed female students by 3% on qualitative quiz and exam problems. Male and female students performed equally on the quantitative course exam problems. The gender gaps within CSEM post-test scores, qualitative lab quiz scores, and qualitative exam scores were insignificant for students with a CSEM pretest score of 25% or less but grew as pretest scores increased. Structural equation modeling demonstrated that a latent variable, called Conceptual Physics Performance/Non-Quantitative (CPP/NonQnt), orthogonal to quantitative test performance was useful in explaining the differences observed in qualitative performance; this variable was most strongly related to CSEM post-test scores. The CPP/NonQnt of male students was 0.44 standard deviations higher than female students. The CSEM pretest measured CPP/NonQnt much less accurately for women (R2=4 % ) than for men (R2=17 % ). The failure to detect a gender gap for students scoring 25% or less on the pretest suggests that the CSEM instrument itself is not gender biased. The failure to find a performance difference in quantitative test performance while detecting a gap in qualitative performance suggests the qualitative differences do not result from psychological factors such as science anxiety or stereotype threat.

Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ

PubMed Central

2012-01-01

Background The syntheses of multiple qualitative studies can pull together data across different contexts, generate new theoretical or conceptual models, identify research gaps, and provide evidence for the development, implementation and evaluation of health interventions. This study aims to develop a framework for reporting the synthesis of qualitative health research. Methods We conducted a comprehensive search for guidance and reviews relevant to the synthesis of qualitative research, methodology papers, and published syntheses of qualitative health research in MEDLINE, Embase, CINAHL and relevant organisational websites to May 2011. Initial items were generated inductively from guides to synthesizing qualitative health research. The preliminary checklist was piloted against forty published syntheses of qualitative research, purposively selected to capture a range of year of publication, methods and methodologies, and health topics. We removed items that were duplicated, impractical to assess, and rephrased items for clarity. Results The Enhancing transparency in reporting the synthesis of qualitative research (ENTREQ) statement consists of 21 items grouped into five main domains: introduction, methods and methodology, literature search and selection, appraisal, and synthesis of findings. Conclusions The ENTREQ statement can help researchers to report the stages most commonly associated with the synthesis of qualitative health research: searching and selecting qualitative research, quality appraisal, and methods for synthesising qualitative findings. The synthesis of qualitative research is an expanding and evolving methodological area and we would value feedback from all stakeholders for the continued development and extension of the ENTREQ statement. PMID:23185978

Publicly Available Information Regarding the Evaluation of School District Superintendents in New York State

ERIC Educational Resources Information Center

Powers, Jarett

2017-01-01

The purpose of this qualitative case study from archival material was to evaluate the degree of public transparency in the evaluation methodology and procedures of school superintendents of districts with student populations between 700 and 900 students in the State of New York. This study examined the language of the 71 superintendent employment…

A Qualitative Approach to the Evaluation of Expert Systems Shells.

ERIC Educational Resources Information Center

Slawson, Dean A.; And Others

This study explores an approach to the evaluation of expert system shells using case studies. The methodology and some of the results of an evaluation of the prototype development of an expert system using the shell "M1" are detailed, including a description of the participants and the project, the data collection process and materials,…

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Qualitative Evaluation.

ERIC Educational Resources Information Center

Stone, James C., Ed.; James, Raymond A., Ed.

1981-01-01

"Qualitative evaluation" is the theme of this issue of the California Journal of Teacher Education. Ralph Tyler states that evaluation is essentially descriptive, and using numbers does not solve basic problems. Martha Elin Vernazza examines the issue of objectivity in history and its implications for evaluation. She posits that the…

Assessment of cultural competence in Texas nursing faculty.

PubMed

Marzilli, Collen

2016-10-01

Cultural competence [CC] is an essential component of nursing education and nursing practice yet there is a gap in the research evaluating CC in faculty and how to practically develop this skillset for faculty members. To explore CC in faculty as evaluated with the Nurses' Cultural Competence Scale [NCCS] and apply the findings to the Purnell Model of Cultural Competence [PMCC] to guide professional development opportunities for faculty members. This was a concurrent mixed-methods study. Faculty members teaching in Texas nursing programs were recruited for the study. Quantitative data was collected using an online survey tool and qualitative data was collected over the phone. 89 Texas faculty members completed the quantitative strand and a subset of 10 faculty members completed the qualitative strand. Descriptive statistics were used to examine the quantitative data and Strauss and Corbin's methodology guided the evaluation of the qualitative data. These two strands were used to support the results. Faculty in Texas are moderately culturally competent. The qualitative findings support the application of the PMCC to the areas identified by the NCCS. The PMCC may be applied to the application of culture and values in nursing professional education as supported by the NCCS. Recommendations are to include the PMCC as a structure for the creation of professional development opportunities for faculty. Copyright © 2016 Elsevier Ltd. All rights reserved.

Interdisciplinary evaluation of dysphagia: clinical swallowing evaluation and videoendoscopy of swallowing.

PubMed

Sordi, Marina de; Mourão, Lucia Figueiredo; Silva, Ariovaldo Armando da; Flosi, Luciana Claudia Leite

2009-01-01

Patients with dysphagia have impairments in many aspects, and an interdisciplinary approach is fundamental to define diagnosis and treatment. A joint approach in the clinical and videoendoscopy evaluation is paramount. To study the correlation between the clinical assessment (ACD) and the videoendoscopic (VED) assessment of swallowing by classifying the degree of severity and the qualitative/descriptive analyses of the procedures. cross-sectional, descriptive and comparative. held from March to December of 2006, at the Otolaryngology/Dysphagia ward of a hospital in the country side of São Paulo. 30 dysphagic patients with different disorders were assessed by ACD and VED. The data was classified by means of severity scales and qualitative/ descriptive analysis. the correlation between severity ACD and VED scales pointed to a statistically significant low agreement (KAPA = 0.4) (p=0,006). The correlation between the qualitative/descriptive analysis pointed to an excellent and statistically significant agreement (KAPA=0.962) (p<0.001) concerning the entire sample. the low agreement between the severity scales point to a need to perform both procedures, reinforcing VED as a doable procedure. The descriptive qualitative analysis pointed to an excellent agreement, and such data reinforces our need to understand swallowing as a process.

Individualised Qualitative Evaluation.

ERIC Educational Resources Information Center

O'Sullivan, Denis

1987-01-01

The author discusses student evaluation in relation to adult and continuing education programs offered by the Department of Adult Education, University College, Cork. He highlights the need for a more individualized and interactive approach to evaluation, allowing the student to benefit from qualitative feedback in the process of being evaluated.…

Randomized pilot study and qualitative evaluation of a clinical decision support system for brain tumour diagnosis based on SV ¹H MRS: evaluation as an additional information procedure for novice radiologists.

PubMed

Sáez, Carlos; Martí-Bonmatí, Luis; Alberich-Bayarri, Angel; Robles, Montserrat; García-Gómez, Juan M

2014-02-01

The results of a randomized pilot study and qualitative evaluation of the clinical decision support system Curiam BT are reported. We evaluated the system's feasibility and potential value as a radiological information procedure complementary to magnetic resonance (MR) imaging to assist novice radiologists in diagnosing brain tumours using MR spectroscopy (1.5 and 3.0T). Fifty-five cases were analysed at three hospitals according to four non-exclusive diagnostic questions. Our results show that Curiam BT improved the diagnostic accuracy in all the four questions. Additionally, we discuss the findings of the users' feedback about the system, and the further work to optimize it for real environments and to conduct a large clinical trial. © 2013 Published by Elsevier Ltd.

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

Integrating service development with evaluation in telehealthcare: an ethnographic study.

PubMed

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-11-22

To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties-dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Clinicians, managers, technical experts, and researchers involved in the projects. Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS.

Community interventions providing care and support to orphans and vulnerable children: a review of evaluation evidence.

PubMed

Schenk, Katie D

2009-07-01

Children affected by HIV in their families and communities face multiple risks to their health, education and psychosocial wellbeing. Community interventions for children who have been orphaned or rendered vulnerable take many forms, including educational assistance, home-based care, legal protection and psychosocial support. Despite a recent influx of funding for programme implementation, there exists little evidence to inform policymakers about whether their investments are improving the lives of vulnerable children and meeting key benchmarks including the Millennium Development Goals. This paper reviews the current evidence base on evaluations of community interventions for orphans and vulnerable children (OVC) in high HIV-prevalence African settings, focusing on studies' methodologies. Sources reviewed include published research studies and evidence from the unpublished programmatic "grey literature" located through database and internet searches. A total of 21 studies, varying in scope and generalisability, were identified. Interventions reviewed address children's wellbeing through various strategies within their communities. Evaluation methodologies reflect quantitative and qualitative approaches, including surveys (with and without baseline or comparison data), costing studies, focus groups, interviews, case studies, and participatory review techniques. Varied study methodologies reflect diverse research questions, various intervention types, and the challenges associated with evaluating complex interventions; highlighting the need to broaden the research paradigm in order to build the evidence base by including quasi-experimental and process evaluation approaches, and seeking further insights through participatory qualitative methodologies and costing studies. Although findings overall indicate the value of community interventions in effecting measurable improvements in child and family wellbeing, the quality and rigour of evidence is varied. A strategic research agenda is urgently needed to inform resource allocation and programme management decisions. Immediate imperatives include building local technical capacity to conduct quantitative and qualitative evaluation research, and strengthening monitoring and evaluation systems to collect process and outcome data (including costing) on key support models. Donors and implementers must support the collection of sound empirical evidence to inform the development and scale-up of OVC programmes.

The qualitative research proposal.

PubMed

Klopper, H

2008-12-01

Qualitative research in the health sciences has had to overcome many prejudices and a number of misunderstandings, but today qualitative research is as acceptable as quantitative research designs and is widely funded and published. Writing the proposal of a qualitative study, however, can be a challenging feat, due to the emergent nature of the qualitative research design and the description of the methodology as a process. Even today, many sub-standard proposals at post-graduate evaluation committees and application proposals to be considered for funding are still seen. This problem has led the researcher to develop a framework to guide the qualitative researcher in writing the proposal of a qualitative study based on the following research questions: (i) What is the process of writing a qualitative research proposal? and (ii) What does the structure and layout of a qualitative proposal look like? The purpose of this article is to discuss the process of writing the qualitative research proposal, as well as describe the structure and layout of a qualitative research proposal. The process of writing a qualitative research proposal is discussed with regards to the most important questions that need to be answered in your research proposal with consideration of the guidelines of being practical, being persuasive, making broader links, aiming for crystal clarity and planning before you write. While the structure of the qualitative research proposal is discussed with regards to the key sections of the proposal, namely the cover page, abstract, introduction, review of the literature, research problem and research questions, research purpose and objectives, research paradigm, research design, research method, ethical considerations, dissemination plan, budget and appendices.

Evaluation of radiographic interpretation competence of veterinary students in Finland.

PubMed

Koskinen, Heli I; Snellman, Marjatta

2009-01-01

In the evaluation of the clinical competence of veterinary students, many different definitions and methods are approved. Due to the increasing discussion of the quality of outcomes produced by newly graduated veterinarians, methods for the evaluation of clinical competencies should also be evaluated. In this study, this was done by comparing two qualitative evaluation schemes: the well-known structure of observed learning outcome (SOLO) taxonomy and a modification of this taxonomy. A case-based final radiologic examination was selected and the investigation was performed by classifying students' outcomes. These classes were finally put next to original (quantitative) scores and the statistical calculations were initiated. Significant correlations between taxonomies (0.53) and the modified taxonomy and original scores (0.66) were found and some qualitative similarities between evaluation methods were observed. In addition, some supplements were recommended for the structure of evaluation schemes, especially for the structure of the modified SOLO taxonomy.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example

PubMed Central

Mair, Frances S; Dowrick, Christopher; Brún, Mary O’Reilly-de; de Brún, Tomas; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; van den Muijsenbergh, Maria; van Weel-Baumgarten, Evelyn; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-01-01

Objectives To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Design Participatory research approach using qualitative methods. Setting Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. Participants RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Primary outcome measures Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Results Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE’s methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork. Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. Conclusion A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. PMID:28827231

Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences.

PubMed

Harman, Elena; Azzam, Tarek

2018-02-01

This exploratory study examines a novel tool for validating program theory through crowdsourced qualitative analysis. It combines a quantitative pattern matching framework traditionally used in theory-driven evaluation with crowdsourcing to analyze qualitative interview data. A sample of crowdsourced participants are asked to read an interview transcript and identify whether program theory components (Activities and Outcomes) are discussed and to highlight the most relevant passage about that component. The findings indicate that using crowdsourcing to analyze qualitative data can differentiate between program theory components that are supported by a participant's experience and those that are not. This approach expands the range of tools available to validate program theory using qualitative data, thus strengthening the theory-driven approach. Copyright © 2017 Elsevier Ltd. All rights reserved.

Using qualitative and quantitative methods to evaluate small-scale disease management pilot programs.

PubMed

Esposito, Dominick; Taylor, Erin Fries; Gold, Marsha

2009-02-01

Interest in disease management programs continues to grow as managed care plans, the federal and state governments, and other organizations consider such efforts as a means to improve health care quality and reduce costs. These efforts vary in size, scope, and target population. While large-scale programs provide the means to measure impacts, evaluation of smaller interventions remains valuable as they often represent the early planning stages of larger initiatives. This paper describes a multi-method approach for evaluating small interventions that sought to improve the quality of care for Medicaid beneficiaries with multiple chronic conditions. Our approach relied on quantitative and qualitative methods to develop a complete understanding of each intervention. Quantitative data in the form of both process measures, such as case manager contacts, and outcome measures, such as hospital use, were reported and analyzed. Qualitative information was collected through interviews and the development of logic models to document the flow of intervention activities and how they were intended to affect outcomes. The logic models helped us to understand the underlying reasons for the success or lack thereof of each intervention. The analysis provides useful information on several fronts. First, qualitative data provided valuable information about implementation. Second, process measures helped determine whether implementation occurred as anticipated. Third, outcome measures indicated the potential for favorable results later, possibly suggesting further study. Finally, the evaluation of qualitative and quantitative data in combination helped us assess the potential promise of each intervention and identify common themes and challenges across all interventions.

Qualitative Methods in Mental Health Services Research

PubMed Central

Palinkas, Lawrence A.

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This paper reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the papers included in this special series along with representative examples from the literature. Qualitative methods are used to provide a “thick description” or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods, but often differ with respect to study design, data collection and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semi-structured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research. PMID:25350675

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

How Qualitative Research Informs Clinical and Policy Decision Making in Transplantation: A Review.

PubMed

Tong, Allison; Morton, Rachael L; Webster, Angela C

2016-09-01

Patient-centered care is no longer just a buzzword. It is now widely touted as a cornerstone in delivering quality care across all fields of medicine. However, patient-centered strategies and interventions necessitate evidence about patients' decision-making processes, values, priorities, and needs. Qualitative research is particularly well suited to understanding the experience and perspective of patients, donors, clinicians, and policy makers on a wide range of transplantation-related topics including organ donation and allocation, adherence to prescribed therapy, pretransplant and posttransplant care, implementation of clinical guidelines, and doctor-patient communication. In transplantation, evidence derived from qualitative research has been integrated into strategies for shared decision-making, patient educational resources, process evaluations of trials, clinical guidelines, and policies. The aim of this article is to outline key concepts and methods used in qualitative research, guide the appraisal of qualitative studies, and assist clinicians to understand how qualitative research may inform their practice and policy.

Influence on Learning of a Collaborative Learning Method Comprising the Jigsaw Method and Problem-based Learning (PBL).

PubMed

Takeda, Kayoko; Takahashi, Kiyoshi; Masukawa, Hiroyuki; Shimamori, Yoshimitsu

2017-01-01

Recently, the practice of active learning has spread, increasingly recognized as an essential component of academic studies. Classes incorporating small group discussion (SGD) are conducted at many universities. At present, assessments of the effectiveness of SGD have mostly involved evaluation by questionnaires conducted by teachers, by peer assessment, and by self-evaluation of students. However, qualitative data, such as open-ended descriptions by students, have not been widely evaluated. As a result, we have been unable to analyze the processes and methods involved in how students acquire knowledge in SGD. In recent years, due to advances in information and communication technology (ICT), text mining has enabled the analysis of qualitative data. We therefore investigated whether the introduction of a learning system comprising the jigsaw method and problem-based learning (PBL) would improve student attitudes toward learning; we did this by text mining analysis of the content of student reports. We found that by applying the jigsaw method before PBL, we were able to improve student attitudes toward learning and increase the depth of their understanding of the area of study as a result of working with others. The use of text mining to analyze qualitative data also allowed us to understand the processes and methods by which students acquired knowledge in SGD and also changes in students' understanding and performance based on improvements to the class. This finding suggests that the use of text mining to analyze qualitative data could enable teachers to evaluate the effectiveness of various methods employed to improve learning.

How has problem based learning fared in Pakistan?

PubMed

Mahmud, Waqas; Hyder, Omar

2012-10-01

To conduct a systematic review of primary research in undergraduate medical education in Pakistan in order to evaluate PBL programs, examine outcomes and competencies influenced by PBL, and compare them with conventional learning (lecture based learning, LBL). Qualitative content analysis. Rawalpindi Medical College, Rawalpindi, from June 2010 - February 2011. Literature was searched using online resources. Studies evaluating outcomes influenced by PBL, or comparing PBL with lecture based learning (LBL) were selected. Due to heterogeneity, a qualitative content analysis was performed in which studies were classified according to the methods of assessment; results were then summarized by outcome and frequencies were calculated. Eleven studies were included. Apart from knowledge acquisition, students gave high ratings to PBL in selected outcomes, alone, and in comparison with LBL. There was a disagreement among results of studies that evaluated knowledge acquisition alone. Based on student perceptions, PBL has many advantages. However, the results of this review are limited due to heterogeneity and methodological weakness of studies, specially the studies that compared exam scores to assess knowledge acquisition.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Toro, Javier, E-mail: jjtoroca@unal.edu.co; Requena, Ignacio, E-mail: requena@decsai.ugr.es; Duarte, Oscar, E-mail: ogduartev@unal.edu.co

In environmental impact assessment, qualitative methods are used because they are versatile and easy to apply. This methodology is based on the evaluation of the strength of the impact by grading a series of qualitative attributes that can be manipulated by the evaluator. The results thus obtained are not objective, and all too often impacts are eliminated that should be mitigated with corrective measures. However, qualitative methodology can be improved if the calculation of Impact Importance is based on the characteristics of environmental factors and project activities instead on indicators assessed by evaluators. In this sense, this paper proposes themore » inclusion of the vulnerability of environmental factors and the potential environmental impact of project activities. For this purpose, the study described in this paper defined Total Impact Importance and specified a quantification procedure. The results obtained in the case study of oil drilling in Colombia reflect greater objectivity in the evaluation of impacts as well as a positive correlation between impact values, the environmental characteristics at and near the project location, and the technical characteristics of project activities. -- Highlights: • Concept of vulnerability has been used to calculate the importance impact assessment. • This paper defined Total Impact Importance and specified a quantification procedure. • The method includes the characteristics of environmental and project activities. • The application has shown greater objectivity in the evaluation of impacts. • Better correlation between impact values, environment and the project has been shown.« less

Qualitative research in palliative care 1990-1999: a descriptive review.

PubMed

Froggatt, Katherine A; Field, David; Bailey, Chris; Krishnasamy, Meinir

2003-03-01

A collaborative, evaluative review of qualitative research in palliative care published between 1990 and 1999 has been conducted. Nearly 30,000 articles in 48 journals from specialist palliative care, oncology, death studies, medicine, nursing, gerontology, health and the social sciences were examined. From these journals, 138 articles (0.5%) reporting qualitative research with a focus on palliative care in the context of death, dying or bereavement were identified. These articles were reviewed using a proforma designed by the group. This article describes the review process, and the following findings: the distribution of different forms of qualitative research in palliative care; the location of such papers; the focus of the research; and the research methodology and methods adopted.

An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

ERIC Educational Resources Information Center

Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

2016-01-01

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Cognitive Relativism in Evaluation.

ERIC Educational Resources Information Center

Alexander, H. A.

1986-01-01

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

A new qualitative pattern classification of shear wave elastograghy for solid breast mass evaluation.

PubMed

Cong, Rui; Li, Jing; Guo, Song

2017-02-01

To examine the efficacy of qualitative shear wave elastography (SWE) in the classification and evaluation of solid breast masses, and to compare this method with conventional ultrasonograghy (US), quantitative SWE parameters and qualitative SWE classification proposed before. From April 2015 to March 2016, 314 consecutive females with 325 breast masses who decided to undergo core needle biopsy and/or surgical biopsy were enrolled. Conventional US and SWE were previously performed in all enrolled subjects. Each mass was classified by two different qualitative classifications. One was established in our study, herein named the Qual1. Qual1 could classify the SWE images into five color patterns by the visual evaluations: Color pattern 1 (homogeneous pattern); Color pattern 2 (comparative homogeneous pattern); Color pattern 3 (irregularly heterogeneous pattern); Color pattern 4 (intralesional echo pattern); and Color pattern 5 (the stiff rim sign pattern). The second qualitative classification was named Qual2 here, and included a four-color overlay pattern classification (Tozaki and Fukuma, Acta Radiologica, 2011). The Breast Imaging Reporting and Data System (BI-RADS) assessment and quantitative SWE parameters were recorded. Diagnostic performances of conventional US, SWE parameters, and combinations of US and SWE parameters were compared. With pathological results as the gold standard, of the 325 examined breast masses, 139 (42.77%) samples were malignant and 186 (57.23%) were benign. The Qual1 showed a higher Az value than the Qual2 and quantitative SWE parameters (all P<0.05). When applying Qual1=Color pattern 1 for downgrading and Qual1=Color pattern 5 for upgrading the BI-RADS categories, we obtained the highest Az value (0.951), and achieved a significantly higher specificity (86.56%, P=0.002) than that of the US (81.18%) with the same sensitivity (94.96%). The qualitative classification proposed in this study may be representative of SWE parameters and has potential to be relevant assistance in breast mass diagnoses. Copyright © 2016. Published by Elsevier B.V.

[Qualitative research in health services research - discussion paper, Part 2: Qualitative research in health services research in Germany - an overview].

PubMed

Karbach, U; Stamer, M; Holmberg, C; Güthlin, C; Patzelt, C; Meyer, T

2012-08-01

This is the second part of a 3-part discussion paper by the working group on "Qualitative Methods" in the German network of health services research (DNVF) that shall contribute to the development of a memorandum concerning qualitative health services research. It aims to depict the different types of qualitative research that are conducted in health services research in Germany. In addition, the authors present a specific set of qualitative data collection and analysis tools to demonstrate the potential of qualitative research for health services research. QUALITATIVE RESEARCH IN HEALTH SERVICES RESEARCH - AN OVERVIEW: To give an overview of the types of qualitative research conducted in German health services research, the abstracts of the 8th German Conference on Health Services Research were filtered to identify qualitative or mixed-methods studies. These were then analysed by looking at the context which was studied, who was studied, the aims of the studies, and what type of methods were used. Those methods that were mentioned most often for data collection and analysis are described in detail. QUALITATIVE RESEARCH AT THE CONFERENCE FOR HEALTH SERVICES RESEARCH 2009: Approximately a fifth of all abstracts (n=74) had a qualitative (n=47) or a mixed-methods approach combining quantitative and qualitative methods (n=27). Research aims included needs assessment (41%), survey development (36%), evaluation (22%), and theorizing (1%). Data collection mostly consisted of one-on-one interviews (n=45) and group discussions (n=29). Qualitative content analysis was named in 35 abstracts, 30 abstracts did not reference their method of analysis. In addition to a quantitative summary of the abstract findings, the diversity of fields addressed by qualitative methods is highlighted. Although drawing conclusions on the use of qualitative methods in German health services research from the analysis of conference abstracts is not possible, the overview we present demonstrates the diversity of methods used for data collection and analysis and showed that a few select methods are extensively used. One of the tasks a memorandum of qualitative health services research should accomplish is to highlight underutilized research methods, which may help to develop the potential of qualitative methodology in German health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluating a Dutch cardiology primary care plus intervention on the Triple Aim outcomes: study design of a practice-based quantitative and qualitative research.

PubMed

Quanjel, Tessa C C; Spreeuwenberg, Marieke D; Struijs, Jeroen N; Baan, Caroline A; Ruwaard, Dirk

2017-09-06

In an attempt to deal with the pressures on the health-care system and to guarantee sustainability, changes are needed. This study focuses on a cardiology primary care plus intervention. Primary care plus (PC+) is a new health-care delivery model focused on substitution of specialist care in the hospital setting with specialist care in the primary care setting. The intervention consists of a cardiology PC+ centre in which cardiologists, supported by other health-care professionals, provide consultations in a primary care setting. The PC+ centre aims to improve the health of the population and quality of care as experienced by patients, and reduce the number of referrals to hospital-based outpatient specialist care in order to reduce health-care costs. These aims reflect the Triple Aim principle. Hence, the objectives of the study are to evaluate the cardiology PC+ centre in terms of the Triple Aim outcomes and to evaluate the process of the introduction of PC+. The study is a practice-based, quantitative study with a longitudinal observational design, and an additional qualitative study to supplement, interpret and improve the quantitative study. The study population of the quantitative part will consist of adult patients (≥18 years) with non-acute and low-complexity cardiology-related health complaints, who will be referred to the cardiology PC+ centre (intervention group) or hospital-based outpatient cardiology care (control group). All eligible patients will be asked to complete questionnaires at three different time points consisting of questions about their demographics, health status and experience of care. Additionally, quantitative data will be collected about health-care utilization and related health-care costs at the PC+ centre and the hospital. The qualitative part, consisting of semi-structured interviews, focus groups, and observations, is designed to evaluate the process as well as to amplify, clarify and explain quantitative results. This study will evaluate a cardiology PC+ centre using quantitative and supplementary qualitative methods. The findings of both sub-studies will fill a gap in knowledge about the effects of PC+ and in particular whether PC+ is able to pursue the Triple Aim outcomes. NTR6629 (Data registered: 25-08-2017) (registered retrospectively).

Evaluation of the Michigan Public School Academy Initiative: Final Report [and] Executive Summary.

ERIC Educational Resources Information Center

Horn, Jerry; Miron, Gary

This is the final report of a one-year evaluation of the Michigan Public School Academy (PSA) initiative. The evaluation involved both formative and summative evaluations and used both qualitative and quantitative methods. The study was conducted between October 1997 and December 1998. Data-collection methods included a charter-school survey and a…

The trees and the forest: mixed methods in the assessment of recovery based interventions' processes and outcomes in mental health.

PubMed

Hasson-Ohayon, Ilanit; Roe, David; Yanos, Philip T; Lysaker, Paul H

2016-12-01

Recent developments in mental health have emphasized recovery as an outcome for people with serious mental illness (SMI). Accordingly, several studies have attempted to evaluate the process and outcome of recovery-oriented psychosocial interventions. To review and discuss quantitative and qualitative findings from previous efforts to study the impact of five recovery-oriented interventions: Illness Management and Recovery (IMR), Narrative Enhancement and Cognitive Therapy (NECT), Supported Employment (SE), Supported Socialization (SS), and Family Psychoeducation. Reviewing the literature on studies that examine the effectiveness of these interventions by using both quantitative and qualitative approach. Qualitative findings in these studies augment quantitative findings and at times draw attention to unexpected findings and uniquely illuminate the effects of these interventions on self-reflective processes. There is a need for further exploration of how mixed-methods can be implemented to explore recovery-oriented outcomes. Critical questions regarding the implications of qualitative findings are posed.

Scaling up STEM Academies Statewide: Implementation, Network Supports, and Early Outcomes

ERIC Educational Resources Information Center

Young, Viki; House, Ann; Sherer, David; Singleton, Corinne; Wang, Haiwen; Klopfenstein, Kristin

2016-01-01

This chapter presents a case study of scaling up the T-STEM initiative in Texas. Data come from the four-year longitudinal evaluation of the Texas High School Project (THSP). The evaluation studied the implementation and impact of T-STEM and the other THSP reforms using a mixed-methods design, including qualitative case studies; principal,…

The Implementation and Evaluation of an Instructional Design Based on the Interdisciplinary Approach: Conscious Consumer Education

ERIC Educational Resources Information Center

Karakus, Memet; Uyar, Melis Yesilpinar

2018-01-01

The aim of this study was to implement and evaluate the instructional design prepared as consumer-oriented and based upon interdisciplinary curriculum. In this study, case study approach, which is one of the qualitative research patterns, was employed. Observations, interviews and document analysis were used to collect data. For analyzing the…

Qualitative Approaches to Evaluating Education.

ERIC Educational Resources Information Center

Fetterman, David M.

1988-01-01

Discusses qualitative research and its application to educational evaluation. Approaches discussed include the following: (1) ethnography; (2) naturalistic inquiry; (3) generic pragmatic (sociological) inquiry; (4) connoisseurship/criticism; (5) metaphors; and (6) phenomenography. (FMW)

Quantitative and Qualitative Evaluations of the Enhanced Logo-autobiography Program for Korean-American Women.

PubMed

Sung, Kyung Mi; Bernstein, Kunsook

2017-12-01

This study extends Bernstein et al.'s (2016) investigation of the effects of the Enhanced Logo-autobiography Program on Korean-American women's depressive symptoms, coping strategies, purpose in life, and posttraumatic growth by analyzing quantitative and qualitative data. This study's participants significantly improved on quantitative measures of depression, coping strategies, purpose in life, and post-traumatic growth at eight weeks post-intervention and follow-up. The qualitative content analysis revealed 17 themes with five essential themes. The program's activity to promote purpose in life through posttraumatic growth facilitated participants' recovery from traumatic experiences. Standardized guidelines are needed to conduct this program in Korean community centers.

Influence of qualitative research on women's health screening guidelines.

PubMed

Abadir, Anna Maria; Lang, Ariella; Klein, Talia; Abenhaim, Haim Arie

2014-01-01

Considerable time and resources are allocated to carry out qualitative research. The purpose of our study was to evaluate the availability of qualitative research on women's health screening and assess its influence on screening practice guidelines in the United States, Canada, and the United Kingdom. Medline, CINHAL, and WEB of Science databases were used to identify the availability of qualitative research conducted in the past 15 years on 3 different women's health screening topics: cervical cancer screening, breast cancer screening, and prenatal first-trimester screening. Key national practice guidelines on women's health screening were selected using the National Guideline Clearinghouse web site. Bibliometric analysis was used to determine the frequency of qualitative references cited in the guidelines. A total of 272 qualitative research papers on women's health screening was identified: 109 on cervical cancer screening, 104 on breast cancer screening, and 59 on prenatal first-trimester screening. The qualitative studies focused on health care provider perspectives as well as ethical, ethnographic, psychological, and social issues surrounding screening. Fifteen national clinical practice guidelines on women's health screening were identified. A total of 943 references was cited, only 2 of which comprised of qualitative research cited by only 1 clinical practice guideline. Although there is considerable qualitative research that has been carried out on women's health screening, its incorporation into clinical practice guidelines is minimal. Further exploration of the disconnect between the two is important for enhancing knowledge translation of qualitative research within clinical practice. Copyright © 2014 Mosby, Inc. All rights reserved.

Evaluation of the Course of the Flight Simulators from the Perspective of Students and University Teachers

ERIC Educational Resources Information Center

Kaysi, Feyzi; Bavli, Bünyamin; Gürol, Aysun

2016-01-01

The study evaluates the flight simulators course which was opened to fulfill the intermediate staff need of the sector. To collect data, Qualitative techniques were applied. Within this scope, the case study method was employed in the study. The study group consisted of students and instructors. In-depth and focus group interviews were conducted…

Elementary Teachers' Views on the Creative Writing Process: An Evaluation

ERIC Educational Resources Information Center

Akkaya, Nevin

2014-01-01

The goal of this study is to discover and evaluate both the areas of personal interest and the views of 4th and 5th grade classroom teachers regarding the creative writing process. In this study, one of the qualitative study methods, state study, and related to this, single state design which refers to the whole has been chosen. Research was…

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

PubMed Central

2017-01-01

Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). Conclusions This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. PMID:28292738

Validity, reliability, and generalizability in qualitative research

PubMed Central

Leung, Lawrence

2015-01-01

In general practice, qualitative research contributes as significantly as quantitative research, in particular regarding psycho-social aspects of patient-care, health services provision, policy setting, and health administrations. In contrast to quantitative research, qualitative research as a whole has been constantly critiqued, if not disparaged, by the lack of consensus for assessing its quality and robustness. This article illustrates with five published studies how qualitative research can impact and reshape the discipline of primary care, spiraling out from clinic-based health screening to community-based disease monitoring, evaluation of out-of-hours triage services to provincial psychiatric care pathways model and finally, national legislation of core measures for children's healthcare insurance. Fundamental concepts of validity, reliability, and generalizability as applicable to qualitative research are then addressed with an update on the current views and controversies. PMID:26288766

Evaluation of Oral Performance in Outsourced Call Centres: An Exploratory Case Study

ERIC Educational Resources Information Center

Friginal, Eric

2013-01-01

This case study discusses the development and use of an oral performance assessment instrument intended to evaluate Filipino agents' customer service transactions with callers from the United States (US). The design and applications of the instrument were based on a longitudinal, qualitative observation of language training and customer service…

Supplemental Literacy Instruction for Students with Down Syndrome: A Program Evaluation

ERIC Educational Resources Information Center

Regan, Lisa Michelle

2013-01-01

The study utilizes an inductive, qualitative approach to program evaluation to understand the nature of an afterschool literacy tutoring program for students with Down syndrome. Two research questions guide this study: (a) What are the curricular and instructional elements of the Let's Read Now (LRN) literacy tutoring program for students…

Class Size Reduction in a Large Urban School District: A Mixed Methodology Evaluation Research Study.

ERIC Educational Resources Information Center

Munoz, Marco A.

This study evaluated the Class Size Reduction (CSR) program in 34 elementary schools in Kentucky's Jefferson County Public Schools. The CSR program is a federal initiative to help elementary schools improve student learning by hiring additional teachers. Qualitative data were collected using unstructured interviews, site observations, and document…

Transitional Services for Youth with Developmental Disabilities: Living in College Dorms

ERIC Educational Resources Information Center

Kirkendall, Abbie; Doueck, Howard J.; Saladino, Albert

2009-01-01

This study evaluates the impact of a college-based dormitory program on transitioning youth with intellectual disabilities. A qualitative study, with interviews at pre and post, was conducted to evaluate the program's impact. Data were collected with semistructured interviews from young adults with intellectual disabilities who participated in a…

Community Engaged Service-Learning: The Effect on University Students and Community Partners

ERIC Educational Resources Information Center

Steele, Susan C.

2012-01-01

The notion that an ethic of service can be fostered through participation in an academic community engaged service-learning program was the underlying premise for this program evaluation study. The purpose of this program evaluation study, using both quantitative and qualitative measures in a thoughtfully organized setting of university and…

Student Voice in Textbook Evaluation: Comparing Open and Restricted Textbooks

ERIC Educational Resources Information Center

Woodward, Scott; Lloyd, Adam; Kimmons, Royce

2017-01-01

Advocates for student voice in higher education believe students should have the right and power to engage in much of the decision-making traditionally dominated by instructors or administrators. This qualitative study examines the role of student voice in the evaluation of textbook quality. Evaluators included two graduate students enrolled in a…

Evaluation of a Family-Centred Children's Weight Management Intervention

ERIC Educational Resources Information Center

Jinks, Annette; English, Sue; Coufopoulos, Anne

2013-01-01

Purpose: The purpose of this paper is to conduct an in-depth quantitative and qualitative evaluation of a family-based weight loss and healthy life style programme for clinically obese children in England. Design/methodology/approach: The mixed method case study evaluation used included obtaining pre and post measurements of anthropometry and a…

Interviewer as Instrument: Accounting for Human Factors in Evaluation Research

ERIC Educational Resources Information Center

Brown, Joel H.

2006-01-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug,…

Views from Below: Students' Perceptions of Teaching Practice Evaluations and Stakeholder Roles

ERIC Educational Resources Information Center

Sosibo, Lungi

2013-01-01

Interest in teaching practice as an essential component of teacher education is growing. In spite of this, there is a dearth of research investigating students' perceptions of teaching practice evaluations from them as beneficiaries. This qualitative study examines students' perceptions of teaching practice evaluations administered by means of…

School Administrators' Perceptions of the James Stronge Teacher Evaluation System

ERIC Educational Resources Information Center

Schoenlank, Jean

2017-01-01

This qualitative study examined school administrators' perceptions of the James Stronge teacher evaluation system, one of five approved evaluation systems by the New Jersey Department of Education from the Teacher Effectiveness and Accountability for the Children of New Jersey Act (TEACHNJ) in 2012. Fourteen administrators from a suburban district…

Elementary Teachers' Perceptions of a Reformed Teacher-Evaluation System

ERIC Educational Resources Information Center

Pressley, Tim; Roehrig, Alysia D.; Turner, Jeannine E.

2018-01-01

This qualitative case study focused on 13 elementary teachers' perceptions of their evaluations. Using multiple schools (5) and teachers (13) we explored the impact of evaluations on instruction. Informed by Pekrun's control-value theory, our analysis focused on teachers' motivations and emotions. Teachers did not value or feel in control of their…

Evaluation of a Research Mentorship Program in Community Care

ERIC Educational Resources Information Center

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

Integrating service development with evaluation in telehealthcare: an ethnographic study

PubMed Central

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-01-01

Objectives To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Design Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Setting Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties—dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Participants Clinicians, managers, technical experts, and researchers involved in the projects. Results and discussion Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Conclusions Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS. PMID:14630758

Capturing the experiences of patients across multiple complex interventions: a meta-qualitative approach.

PubMed

Webster, Fiona; Christian, Jennifer; Mansfield, Elizabeth; Bhattacharyya, Onil; Hawker, Gillian; Levinson, Wendy; Naglie, Gary; Pham, Thuy-Nga; Rose, Louise; Schull, Michael; Sinha, Samir; Stergiopoulos, Vicky; Upshur, Ross; Wilson, Lynn

2015-09-08

The perspectives, needs and preferences of individuals with complex health and social needs can be overlooked in the design of healthcare interventions. This study was designed to provide new insights on patient perspectives drawing from the qualitative evaluation of 5 complex healthcare interventions. Patients and their caregivers were recruited from 5 interventions based in primary, hospital and community care in Ontario, Canada. We included 62 interviews from 44 patients and 18 non-clinical caregivers. Our team analysed the transcripts from 5 distinct projects. This approach to qualitative meta-evaluation identifies common issues described by a diverse group of patients, therefore providing potential insights into systems issues. This study is a secondary analysis of qualitative data; therefore, no outcome measures were identified. We identified 5 broad themes that capture the patients' experience and highlight issues that might not be adequately addressed in complex interventions. In our study, we found that: (1) the emergency department is the unavoidable point of care; (2) patients and caregivers are part of complex and variable family systems; (3) non-medical issues mediate patients' experiences of health and healthcare delivery; (4) the unanticipated consequences of complex healthcare interventions are often the most valuable; and (5) patient experiences are shaped by the healthcare discourses on medically complex patients. Our findings suggest that key assumptions about patients that inform intervention design need to be made explicit in order to build capacity to better understand and support patients with multiple chronic diseases. Across many health systems internationally, multiple models are being implemented simultaneously that may have shared features and target similar patients, and a qualitative meta-evaluation approach, thus offers an opportunity for cumulative learning at a system level in addition to informing intervention design and modification. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Field evaluation of the myrtle creek advanced curve warning system : final report.

DOT National Transportation Integrated Search

2006-06-01

As part of a larger study focusing on determining optimum countermeasures for speed related crashes, this report presents the results of a quantitative and qualitative before and after evaluation of a dynamic curve warning system deployed at one site...

The effects of infographics and several quantitative versus qualitative formats for cardiovascular disease risk, including heart age, on people's risk understanding.

PubMed

Damman, Olga C; Vonk, Suzanne I; van den Haak, Maaike J; van Hooijdonk, Charlotte M J; Timmermans, Danielle R M

2018-03-11

To study how comprehension of cardiovascular disease (CVD) risk is influenced by: (1) infographics about qualitative risk information, with/without risk numbers; (2) which qualitative risk dimension is emphasized; (3) heart age vs. traditional risk format. For aim 1, a 2 (infographics versus text) x 2 (risk number versus no risk number) between-subjects design was used. For aim 2, three pieces of information were tested within-subjects. Aim 3 used a simple comparison group. Participants (45-65 yrs old) were recruited through an online access panel; low educated people were oversampled. They received hypothetical risk information (20%/61yrs). Primary outcomes: recall, risk appraisals, subjective/objective risk comprehension. behavioral intentions, information evaluations. Infographics of qualitative risk dimensions negatively affected recall, subjective risk comprehension and information evaluations. No effect of type of risk dimension was found on risk perception. Heart age influenced recall, comprehension, evaluations and affective risk appraisals. Infographics of hypothetical CVD risk information had detrimental effects on measures related to risk perception/comprehension, but effects were mainly seen in undereducated participants. Heart age influenced perceptions/comprehension of hypothetical risk in a way that seemed to support understanding. Heart age seems a fruitful risk communication approach in disease risk calculators. Copyright © 2018 Elsevier B.V. All rights reserved.

Does involving volunteers in the provision of palliative care make a difference to patient and family wellbeing? A systematic review of quantitative and qualitative evidence.

PubMed

Candy, Bridget; France, Rachel; Low, Joe; Sampson, Liz

2015-03-01

Despite the extent of volunteers' contribution to palliative care, and their role in direct patient care, there has been no systematic evaluation of the evidence-base on volunteers in relation to patient and family wellbeing. To critically review research, on the impact of volunteers involved in the direct care of palliative patients and their families. We searched for studies, reporting patient and family data on the impact of volunteer services in palliative care in thirteen citation databases up to May 2013. We included quantitative comparative studies. We also noted any non-comparative studies, enabling us to give a comprehensive review of the existing research. We also included qualitative studies that explored the experiences of patients and families who received volunteer support, potentially illustrating which aspects of volunteer activities patients and families value. We applied quality appraisal criteria to all studies meeting inclusion criteria. Two researchers undertook key review processes. We found eight studies. Only two studies were undertaken outside of North America; one in the Netherlands and the other in Uganda. All studies were in adult palliative care services. All evaluated volunteers were in home care settings, three of the studies included other settings such as hospitals and nursing homes. All of the studies fulfilled our quality appraisal criteria. Six of them were quantitative studies and two were comparative: one found that those families who experienced greater (as opposed to lesser) volunteer involvement were significantly more satisfied with care; the other found that patients survived significantly longer if they had received home visits from a volunteer. Four cross-sectional studies focused on satisfaction ratings. No study considered possible disadvantages or adverse effects of volunteer involvement. Two qualitative studies were identified; both highlighted the uniqueness of the role volunteers may fulfil in care support, from the viewpoint of patients and their families. Further research is needed to ensure the resource of volunteers in palliative care is used appropriately and effectively. Evaluation in well-designed comparative studies is recommended including economic analyses, as are further qualitative studies to explore the roles, benefits and possible adverse effects of volunteers. Evaluation is particularly needed outside of North America and in dedicated hospice facilities. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

[Evaluation by case managers dementia : An explorative practice based study on types and content].

PubMed

Ketelaar, Nicole A B M; Jukema, Jan S; van Bemmel, Marlies; Adriaansen, Marian J M; Smits, Carolien H M

2017-06-01

This practice based explorative study aims to provide insight into the ways in which case managers shape and fill up the evaluation phase of their support of the informal care network of persons with dementia. A combination of quantitative and qualitative research methods were used. A group of 57 case managers of persons with dementia in three different organisational networks took part in this study. Results from the quantitative and qualitative data are organized into four themes: (1) attitude towards evaluation, (2) forms of evaluation, (3) implementation of evaluation and (4) content of evaluation. There are different ways in shaping evaluation and the content of it. The importance of interim and final evaluation is recognized, but is difficult to realize in a methodical way. Barriers experienced by the case managers include various factors associated both with clients as professionals. Case managers evaluate continuously and in an informal way to assess whether the extent of their assistance is meeting the needs of the client and informal network. Case managers do not use systematic evaluation to measure the quality of care they offer to persons with dementia and their caregivers. The findings demand a discussion on the level of clients, as well as on the professional and societal level about the way case managers should evaluate their support.

Evaluation of the Effectiveness of an Initiative to Develop Leadership among Women in Africa: A Case Study

ERIC Educational Resources Information Center

Wakahiu, Jane M.

2011-01-01

This qualitative case study assesses the impact of a three-year Hilton Foundation-supported, Sisters Leadership Development Initiative (SLDI) in five African nations. The goal was to evaluate the SLDI program for increasing leadership capacities of 340 women in Kenya, Uganda, Tanzania, Ghana and Nigeria. The purpose of this study was to determine…

Evaluation Criteria for Interactive E-Books for Open and Distance Learning

ERIC Educational Resources Information Center

Bozkurt, Aras; Bozkaya, Mujgan

2015-01-01

The aim of this mixed method study is to identify evaluation criteria for interactive e-books. To find answers for the research questions of the study, both quantitative and qualitative data were collected through a four-round Delphi study with a panel consisting of 30 experts. After that, a total of 20 interactive e-books were examined with…

Implementation Evaluation Study: Flipped Classroom Professional Development with Faculty Members to Enhance Students' Engagement in Higher Education

ERIC Educational Resources Information Center

Alebrahim, Fatimah Hussain

2016-01-01

The purpose of this qualitative study was to explore student engagement in higher education by evaluating training provided by experienced faculty members for those faculty desiring to implement a flipped classroom. A case study was utilized; data were collected in the form of online observation, in-class observation, student focus group…

Using new media to build social capital for health: a qualitative process evaluation study of participation in the CityNet project.

PubMed

Bolam, Bruce; McLean, Carl; Pennington, Andrew; Gillies, Pamela

2006-03-01

The present article presents an exploratory qualitative process evaluation study of 'Ambassador' participation in CityNet, an innovative information-communication technology-based (ICT) project that aims to build aspects of social capital and improve access to information and services among disadvantaged groups in Nottingham, UK. A purposive sample of 40 'Ambassadors' interviewees was gathered in three waves of data collection. The two emergent analytic themes highlighted how improvements in confidence, self-esteem and social networks produced via participation were mitigated by structural problems in devolving power within the project. This illustrates how concepts of power are important for understanding the process of health promotion interventions using new media.

Design of a study evaluating the effects, health economics, and stakeholder perspectives of a multi-component occupational rehabilitation program with an added workplace intervention - a  study protocol.

PubMed

Rise, Marit B; Skagseth, Martin; Klevanger, Nina E; Aasdahl, Lene; Borchgrevink, Petter; Jensen, Chris; Tenggren, Hanne; Halsteinli, Vidar; Jacobsen, Trym N; Løland, Svein B; Johnsen, Roar; Fimland, Marius S

2018-02-05

Recent research has suggested that interventions at the workplace might be the most potent ingredient in return to work interventions, but few studies have investigated the different effects of workplace interventions as part of occupational rehabilitation programs. The comprehensive design described in this article includes effect (on return to work and health outcomes), and health economic evaluations of a workplace intervention added to a multicomponent rehabilitation program. Qualitative and mixed method studies will investigate sick-listed persons', rehabilitation therapists' and employers' perspectives on the usability and outcomes of the rehabilitation program and the workplace intervention. The program and intervention are provided to patients with musculoskeletal, psychological or general and unspecified diagnoses. The program is multi-component and includes Acceptance and Commitment Therapy, physical exercise, patient education and creating a plan for increased work participation. Persons who are employed, aged from 18 to 60 years, with a current sick leave status of 50% or more and a diagnosis within the musculoskeletal, psychological or general and unspecified chapters of International Classification of Primary Care-2 (ICPC-2) will be recruited to a researcher-blinded parallel-group randomized controlled trial. All participants take part in an in-patient occupational rehabilitation program, while the intervention group also takes part in an intervention at the workplace. The effect and economic evaluation will investigate the effect of the added workplace intervention. The primary outcome measures will be time until full sustainable return to work and total number of sickness absence days in the 12 months after inclusion. Health economic evaluations will investigate the cost-effectiveness and cost-utility. Qualitative studies will investigate rehabilitation therapists' experiences with working towards return to work within an ACT-approach and stakeholders' experiences with the workplace intervention. A mixed methods study will combine quantitative and qualitative findings on the participants' expectations and motivation for return to work. The outline of this comprehensive study could represent an important addition to the standard designs of return to work evaluation. The mixed methods design, with qualitative approaches as well as a rigorous randomized controlled trial, might prove useful to shed light on contextual factors. ClinicalTrials.gov : NCT02541890 . September 4, 2015.

A General Survey of Qualitative Research Methodology.

ERIC Educational Resources Information Center

Cary, Rick

Current definitions and philosophical foundations of qualitative research are presented; and designs, evaluation methods, and issues in application of qualitative research to education are discussed. The effects of positivism and the post-positivist era on qualitative research are outlined, and naturalist and positivist approaches are contrasted.…

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Medical Students' and Tutors' Experiences of Directed and Self-Directed Learning Programs in Evidence-Based Medicine: A Qualitative Evaluation Accompanying a Randomized Controlled Trial

ERIC Educational Resources Information Center

Bradley, Peter; Oterholt, Christina; Nordheim, Lena; Bjorndal, Arild

2005-01-01

This qualitative study aims to interpret the results of a randomized controlled trial comparing two educational programs (directed learning and self-directed learning) in evidence-based medicine (EBM) for medical students at the University of Oslo from 2002 to 2003. There is currently very little comparative educational research in this field. In…

Searching for qualitative research for inclusion in systematic reviews: a structured methodological review.

PubMed

Booth, Andrew

2016-05-04

Qualitative systematic reviews or qualitative evidence syntheses (QES) are increasingly recognised as a way to enhance the value of systematic reviews (SRs) of clinical trials. They can explain the mechanisms by which interventions, evaluated within trials, might achieve their effect. They can investigate differences in effects between different population groups. They can identify which outcomes are most important to patients, carers, health professionals and other stakeholders. QES can explore the impact of acceptance, feasibility, meaningfulness and implementation-related factors within a real world setting and thus contribute to the design and further refinement of future interventions. To produce valid, reliable and meaningful QES requires systematic identification of relevant qualitative evidence. Although the methodologies of QES, including methods for information retrieval, are well-documented, little empirical evidence exists to inform their conduct and reporting. This structured methodological overview examines papers on searching for qualitative research identified from the Cochrane Qualitative and Implementation Methods Group Methodology Register and from citation searches of 15 key papers. A single reviewer reviewed 1299 references. Papers reporting methodological guidance, use of innovative methodologies or empirical studies of retrieval methods were categorised under eight topical headings: overviews and methodological guidance, sampling, sources, structured questions, search procedures, search strategies and filters, supplementary strategies and standards. This structured overview presents a contemporaneous view of information retrieval for qualitative research and identifies a future research agenda. This review concludes that poor empirical evidence underpins current information practice in information retrieval of qualitative research. A trend towards improved transparency of search methods and further evaluation of key search procedures offers the prospect of rapid development of search methods.

Building for the Future: Community College Leadership Development Program Evaluation

ERIC Educational Resources Information Center

Bresso, Michele

2012-01-01

This qualitative descriptive study examines and evaluates an internal, grow-your-own, community college leadership development program. Participants in a community college leadership development program self-reported their leadership knowledge, attitudes, and practices (KAP) before, during, and after participation in the program. Study…

A Synthesis Of Knowledge About Caregiver Decision Making Finds Gaps In Support For Those Who Care For Aging Loved Ones.

PubMed

Garvelink, Mirjam M; Ngangue, Patrice A G; Adekpedjou, Rheda; Diouf, Ndeye T; Goh, Larissa; Blair, Louisa; Légaré, France

2016-04-01

We conducted a mixed-methods knowledge synthesis to assess the effectiveness of interventions to improve caregivers' involvement in decision making with seniors, and to describe caregivers' experiences of decision making in the absence of interventions. We analyzed forty-nine qualitative, fourteen quantitative, and three mixed-methods studies. The qualitative studies indicated that caregivers had unmet needs for information, discussions of values and needs, and decision support, which led to negative sentiments after decision making. Our results indicate that there have been insufficient quantitative evaluations of interventions to involve caregivers in decision making with seniors and that the evaluations that do exist found few clinically significant effects. Elements of usual care that received positive evaluations were the availability of a decision coach and a supportive decision-making environment. Additional rigorously evaluated interventions are needed to help caregivers be more involved in decision making with seniors. Project HOPE—The People-to-People Health Foundation, Inc.

Finding Qualitative Research Evidence for Health Technology Assessment.

PubMed

DeJean, Deirdre; Giacomini, Mita; Simeonov, Dorina; Smith, Andrea

2016-08-01

Health technology assessment (HTA) agencies increasingly use reviews of qualitative research as evidence for evaluating social, experiential, and ethical aspects of health technologies. We systematically searched three bibliographic databases (MEDLINE, CINAHL, and Social Science Citation Index [SSCI]) using published search filters or "hedges" and our hybrid filter to identify qualitative research studies pertaining to chronic obstructive pulmonary disease and early breast cancer. The search filters were compared in terms of sensitivity, specificity, and precision. Our screening by title and abstract revealed that qualitative research constituted only slightly more than 1% of all published research on each health topic. The performance of the published search filters varied greatly across topics and databases. Compared with existing search filters, our hybrid filter demonstrated a consistently high sensitivity across databases and topics, and minimized the resource-intensive process of sifting through false positives. We identify opportunities for qualitative health researchers to improve the uptake of qualitative research into evidence-informed policy making. © The Author(s) 2016.

Comparative study of contrast-enhanced ultrasound qualitative and quantitative analysis for identifying benign and malignant breast tumor lumps.

PubMed

Liu, Jian; Gao, Yun-Hua; Li, Ding-Dong; Gao, Yan-Chun; Hou, Ling-Mi; Xie, Ting

2014-01-01

To compare the value of contrast-enhanced ultrasound (CEUS) qualitative and quantitative analysis in the identification of breast tumor lumps. Qualitative and quantitative indicators of CEUS for 73 cases of breast tumor lumps were retrospectively analyzed by univariate and multivariate approaches. Logistic regression was applied and ROC curves were drawn for evaluation and comparison. The CEUS qualitative indicator-generated regression equation contained three indicators, namely enhanced homogeneity, diameter line expansion and peak intensity grading, which demonstrated prediction accuracy for benign and malignant breast tumor lumps of 91.8%; the quantitative indicator-generated regression equation only contained one indicator, namely the relative peak intensity, and its prediction accuracy was 61.5%. The corresponding areas under the ROC curve for qualitative and quantitative analyses were 91.3% and 75.7%, respectively, which exhibited a statistically significant difference by the Z test (P<0.05). The ability of CEUS qualitative analysis to identify breast tumor lumps is better than with quantitative analysis.

Qualitative evaluation of maternal milk and commercial infant formulas via LIBS.

PubMed

Abdel-Salam, Z; Al Sharnoubi, J; Harith, M A

2013-10-15

This study focuses on the use of laser-induced breakdown spectroscopy (LIBS) for the evaluation of the nutrients in maternal milk and some commercially available infant formulas. The results of such evaluation are vital for adequate and healthy feeding for babies during lactation period. Laser-induced breakdown spectroscopy offers special advantages in comparison to the other conventional analytical techniques. Specifically, LIBS is a straightforward technique that can be used in situ to provide qualitative analytical information in few minutes for the samples under investigation without preparation processes. The samples studied in the current work were maternal milk samples collected during the first 3 months of lactation (not colostrum milk) and samples from six different types of commercially available infant formulas. The samples' elemental composition has been compared with respect to the relative abundance of the elements of nutrition importance, namely Mg, Ca, Na, and Fe using their spectral emission lines in the relevant LIBS spectra. In addition, CN and C2 molecular emission bands in the same spectra have been studied as indicators of proteins content in the samples. The obtained analytical results demonstrate the higher elemental contents of the maternal milk compared with the commercial formulas samples. Similar results have been obtained as for the proteins content. It has been also shown that calcium and proteins have similar relative concentration trends in the studied samples. This work demonstrates the feasibility of adopting LIBS as a fast, safe, less costly technique evaluating qualitatively the nutrients content of both maternal and commercial milk samples. Copyright © 2013 Elsevier B.V. All rights reserved.

Interdisciplinary Studies and the Real World: A Practical Rationale for and Guide to Postgraduation Evaluation and Assessment

ERIC Educational Resources Information Center

Brooks, Benjamin; Widders, Evan

2012-01-01

This article is an outgrowth of the evaluation and assessment process in a large interdisciplinary studies (IDS) program at West Virginia University. We argue for the importance of collecting and assessing quantitative and qualitative data concerning learning outcomes, student satisfaction, career choice and development, and graduate education…

Design, Implementation and Evaluation of School-Based Sexual Health Education in Sub-Saharan Africa: A Qualitative Study of Researchers' Perspectives

ERIC Educational Resources Information Center

Sani, A. Sadiq; Abraham, Charles; Denford, Sarah; Mathews, Catherine

2018-01-01

This study investigated facilitators and challenges to designing, implementing and evaluating school-based sexual health education in sub-Saharan Africa, using interviews with intervention designers and researchers. At the pre-planning and planning stages, participants reported that facilitating factors included addressing the reproductive health…

Elementary Teachers' Formative Evaluation Practices in an Era of Curricular Reform in Quebec, Canada

ERIC Educational Resources Information Center

Thomas, Lynn; Deaudelin, Colette; Desjardins, Julie; Dezutter, Olivier

2011-01-01

This study examines the formative evaluation practices of 13 experienced elementary school teachers in Quebec, Canada at the level of teacher-student interaction. The qualitative study is based on both semi-structured and stimulated recall interviews as well as videotapes of classroom activities. The participating teachers were found to be using…

What Students Think and Do in Classroom Teams When Peer Evaluations Are Highly Consequential: A Two-Stage Study

ERIC Educational Resources Information Center

Jassawalla, Avan R.; Sashittal, Hemant C.

2017-01-01

The article presents findings from a two-stage study that examined student perceptions of peer evaluations (PEs) conducted in undergraduate business classroom teams. In stage 1, we used qualitative research to identify constructs focal in students' PE-related cognitive schemas and developed grounded measurement scales and hypotheses about their…

An Evaluative Case Study of Project-Based Learning in High School Vocational Education

ERIC Educational Resources Information Center

Tanner, Andrea P.

2012-01-01

There is growing apprehension among business people, educators, and government policy makers regarding the gap between the skills and knowledge needed for success in the workforce and those provided in school. The purpose of this qualitative evaluative case study was to investigate the effectiveness of project-based learning (PBL) in the…

Testimony in Narrative Educational Research: A Qualitative Interview, Narrative Analysis and Epistemological Evaluation

ERIC Educational Resources Information Center

Christopher, Justin

2017-01-01

The purpose of this study is to assess issues that arise in the context of epistemological claims in narrative educational research by means of narrative analysis and epistemological evaluation. The research questions which guided the study were: 1) To what extent is epistemology considered by narrative educational researchers?; 2) What issues do…

Gender Differences in Motor Skills of the Overarm Throw

PubMed Central

Gromeier, Michael; Koester, Dirk; Schack, Thomas

2017-01-01

In this cross-sectional study, the qualitative and quantitative throwing performance of male and female athletes (6 to 16 years of age) was analyzed. The goal of this study was to assess whether there were gender based qualitative and quantitative differences in throwing performance of young athletes, throughout three different age bands (childhood, pubescence, and adolescence). Furthermore, we explored whether all components of the throwing movement are equally affected by gender differences. Focus was placed on five essential components of action: trunk, forearm, humerus, stepping, and backswing. Therefore, children and adolescents (N = 96) were invited to throw three times from three different distances, while aiming at a target placed at shoulder height. The participants were aspiring athletes, competitive in the sport handball. For analyzing the quality of movement the component approach of Halverson and Roberton (1984) was used. The throwing accuracy was noted and used to evaluate the quantitative performance of the throwing movement. Throughout three different age bands, no statistically significant difference was found between genders in throwing accuracy, i.e., quantitative performance. Regarding the qualitative evaluation of the throwing movement, male and female athletes differed significantly. The component approach yielded higher scores for male than for female participants. As expected, with increasing age qualitative and quantitative performance of male and female athletes improved. These results suggest that there are gender-specific differences in qualitative throwing performance, but not necessarily in quantitative throwing performance. Exploration shows that differences in the qualitative throwing performance were seen in specific components of action. Male and female athletes demonstrated similar movement patterns in humerus and forearm actions, but differed in trunk, stepping, and backswing actions. PMID:28261142

Priority-setting and hospital strategic planning: a qualitative case study.

PubMed

Martin, Douglas; Shulman, Ken; Santiago-Sorrell, Patricia; Singer, Peter

2003-10-01

To describe and evaluate the priority-setting element of a hospital's strategic planning process. Qualitative case study and evaluation against the conditions of 'accountability for reasonableness' of a strategic planning process at a large urban university-affiliated hospital. The hospital's strategic planning process met the conditions of 'accountability for reasonableness' in large part. Specifically: the hospital based its decisions on reasons (both information and criteria) that the participants felt were relevant to the hospital; the number and type of participants were very extensive; the process, decisions and reasons were well communicated throughout the organization, using multiple communication vehicles; and the process included an ethical framework linked to an effort to evaluate and improve the process. However, there were opportunities to improve the process, particularly by giving participants more time to absorb the information relevant to priority-setting decisions, more time to take difficult decisions and some means to appeal or revise decisions. A case study linked to an evaluation using 'accountability for reasonableness' can serve to improve priority-setting in the context of hospital strategic planning.

Impact of the 5As Team study on clinical practice in primary care obesity management: a qualitative study

PubMed Central

Asselin, Jodie; Salami, Eniola; Osunlana, Adedayo M.; Ogunleye, Ayodele A.; Cave, Andrew; Johnson, Jeffrey A.; Sharma, Arya M.; Campbell-Scherer, Denise L.

2017-01-01

Background: The 5As [Ask, Assess, Advise, Agree, Assist] of Obesity Management Team study was a randomized controlled trial of an intervention that was implemented and evaluated to help primary care providers improve clinical practice for obesity management. This paper presents health care provider perspectives of the impacts of the intervention on individual provider and team practices. Methods: This study reports a thematic network analysis of qualitative data collected during the 5As Team study, which involved 24 chronic disease teams affiliated with family practices in a Primary Care Network in Alberta. Qualitative data from 28 primary care providers (registered nurses/nurse practitioners [n = 14], dietitians [n = 7] and mental health workers [n = 7]) in the intervention arm were collected through semistructured interviews, field notes, practice facilitator diaries and 2 evaluation workshop questionnaires. Results: Providers internalized 5As Team intervention concepts, deepening self-evaluation and changing clinical reasoning around obesity. Providers perceived that this internalization changed the provider-patient relationship positively. The intervention changed relations between providers, increasing interdisciplinary understanding, collaboration and discovery of areas for improvement. This personal and interpersonal evolution effected change to the entire Primary Care Network. Interpretation: The 5As Team intervention had multiple impacts on providers and teams to improve obesity management in primary care. Improved provider confidence and capability is a precondition of developing effective patient interventions. Trial registration: ClinicalTrials.gov, no.: NCT01967797. PMID:28450428

Participative Evaluation and the Quality of Community Empowerment Training of "Program Keluarga Harapan" (PKH) Companions

ERIC Educational Resources Information Center

Rasyad, Ach.

2016-01-01

This research is aiming at describing: (1) the implementation of community empowerment training of PKH companions, (2) types of participative evaluation used in the PKH companion training, and (3) obstacles and supporting factors in PKH companion training using the participative evaluation. The study employed qualitative approach with case study…

Investigating Criteria That Seventh Graders Use to Evaluate the Quality of Online Information

ERIC Educational Resources Information Center

Coiro, Julie; Coscarelli, Carla; Maykel, Cheryl; Forzani, Elena

2015-01-01

This article presents qualitative findings from a study that examined the types of criteria that middle school students use to evaluate the quality of online information and sources for a Web-based research assignment. Open-constructed responses from four critical evaluation items were compiled from diverse seventh graders in a representative,…

Applying a Framework to Evaluate Assignment Marking Software: A Case Study on Lightwork

ERIC Educational Resources Information Center

Heinrich, Eva; Milne, John

2012-01-01

This article presents the findings of a qualitative evaluation on the effect of a specialised software tool on the efficiency and quality of assignment marking. The software, Lightwork, combines with the Moodle learning management system and provides support through marking rubrics and marker allocations. To enable the evaluation a framework has…

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

PubMed

Noyes, Jane; Booth, Andrew; Flemming, Kate; Garside, Ruth; Harden, Angela; Lewin, Simon; Pantoja, Tomas; Hannes, Karin; Cargo, Margaret; Thomas, James

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example.

PubMed

O'Donnell, Catherine A; Mair, Frances S; Dowrick, Christopher; Brún, Mary O'Reilly-de; Brún, Tomas de; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; Muijsenbergh, Maria van den; Weel-Baumgarten, Evelyn van; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-08-21

To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Participatory research approach using qualitative methods. Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE's methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork.Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Advancing student nurse knowledge of the biomedical sciences: A mixed methods study.

PubMed

Craft, Judy; Christensen, Martin; Bakon, Shannon; Wirihana, Lisa

2017-01-01

Nursing students' ability to learn, integrate and apply bioscience knowledge to their clinical practice remains a concern. To evaluate the implementation, influence, and student perspective of a team-teaching workshop to integrate bioscience theory with clinical nursing practice. The team-teaching workshop was offered prior to commencement of the university semester as a refresher course at an Australian university. This study employed a sequential explanatory mixed methods design incorporating both quantitative and qualitative items. An evaluation survey with quantitative and qualitative items and a focus group were employed. The qualitative data were analysed using a thematic approach. The quantitative data was combined with the emergent themes in the qualitative data. Participants were final year nursing students. Nine students attended the workshop. All students completed the evaluation (N=9) and 44.4% (N=4) attended the focus group. The results revealed six themes: (1) lectures are an inadequate teaching strategy for bioscience; (2) teaching strategies which incorporate active learning engage students; (3) the team-teaching workshop provides an effective learning environment; (4) the workshop content should be expanded; (5) pharmacology should relate to bioscience, and bioscience should relate to nursing; and (6) team-teaching was effective in integrating pharmacology with bioscience, and then translating this into nursing practice. Students had felt there was disjointedness between pharmacology and bioscience, and between bioscience and nursing care within their undergraduate studies. The workshop that was based on team-teaching bridged those gaps, utilised active learning strategies and provided an effective learning environment. Team-teaching that employs active learning strategies is an effective approach to assist nursing students to integrate bioscience knowledge into their nursing practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

Qualitative research in rehabilitation science: opportunities, challenges, and future directions.

PubMed

VanderKaay, Sandra; Moll, Sandra E; Gewurtz, Rebecca E; Jindal, Pranay; Loyola-Sanchez, Adalberto; Packham, Tara L; Lim, Chun Y

2018-03-01

Qualitative research has had a significant impact within rehabilitation science over time. During the past 20 years the number of qualitative studies published per year in Disability and Rehabilitation has markedly increased (from 1 to 54). In addition, during this period there have been significant changes in how qualitative research is conceptualized, conducted, and utilized to advance the field of rehabilitation. The purpose of this article is to reflect upon the progress of qualitative research within rehabilitation to date, to explicate current opportunities and challenges, and to suggest future directions to continue to strengthen the contribution of qualitative research in this field. Relevant literature searches were conducted in electronic data bases and reference lists. Pertinent literature was examined to identify current opportunities and challenges for qualitative research use in rehabilitation and to identify future directions. Six key areas of opportunity and challenge were identified: (a) paradigm shifts, (b) advancements in methodology, (c) emerging technology, (d) advances in quality evaluation, (e) increasing popularity of mixed methods approaches, and (f) evolving approaches to knowledge translation. Two important future directions for rehabilitation are posited: (1) advanced training in qualitative methods and (2) engaging qualitative communities of research. Qualitative research is well established in rehabilitation and has an important place in the continued growth of this field. Ongoing development of qualitative researchers and methods are essential. Implications for Rehabilitation Qualitative research has the potential to improve rehabilitation practice by addressing some of the most pervasive concerns in the field such as practitioner-client interaction, the subjective and lived experience of disability, and clinical reasoning and decision making. This will serve to better inform those providing rehabilitation services thereby benefiting patients that are utilizing these services. Changes over time in how qualitative research is conceptualized, conducted, and utilized to advance rehabilitation science have resulted in a number of unique opportunities and challenges in using qualitative research that must be considered within this field. Advances in methodology and increased expectations for evaluation must be considered to ensure quality and credibility of qualitative rehabilitation research within rehabilitation. Improved quality and credibility may increase likelihood of research dissemination and use by clinicians intervening within the rehabilitation process in order to improve clinical practice. In order to maximize opportunities and mitigate challenges there are two principal future directions for rehabilitation scientists to consider: (1) advancing training in qualitative methods to adequately prepare future rehabilitation scientists and (2) engaging qualitative communities of research.

A Systematic Quantitative-Qualitative Model: How To Evaluate Professional Services

ERIC Educational Resources Information Center

Yoda, Koji

1973-01-01

The proposed evaluation model provides for the assignment of relative weights to each criterion, and establishes a weighting system for calculating a quantitative-qualitative raw score for each service activity of a faculty member being reviewed. (Author)

Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review.

PubMed

Williams, Nefyn H; Hendry, Maggie; France, Barbara; Lewis, Ruth; Wilkinson, Clare

2007-12-01

Despite the health benefits of physical activity, most adults do not take the recommended amount of exercise. To assess whether exercise-referral schemes are effective in improving exercise participation in sedentary adults. Systematic review. Studies were identified by searching MEDLINE, CINAHL, EMBASE, AMED, PsycINFO, SPORTDiscus, The Cochrane Library and SIGLE until March 2007. Randomised controlled trials (RCTs), observational studies, process evaluations and qualitative studies of exercise-referral schemes, defined as referral by a primary care clinician to a programme that encouraged physical activity or exercise were included. RCT results were combined in a meta-analysis where there was sufficient homogeneity. Eighteen studies were included in the review. These comprised six RCTs, one non-randomised controlled study, four observational studies, six process evaluations and one qualitative study. In addition, two of the RCTs and two of the process evaluations incorporated a qualitative component. Results from five RCTs were combined in a meta-analysis. There was a statistically significant increase in the numbers of participants doing moderate exercise with a combined relative risk of 1.20 (95% confidence intervals = 1.06 to 1.35). This means that 17 sedentary adults would need to be referred for one to become moderately active. This small effect may be at least partly due to poor rates of uptake and adherence to the exercise schemes. Exercise-referral schemes have a small effect on increasing physical activity in sedentary people. The key challenge, if future exercise-referral schemes are to be commissioned by the NHS, is to increase uptake and improve adherence by addressing the barriers described in these studies.

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

Non-auditory factors affecting urban soundscape evaluation.

PubMed

Jeon, Jin Yong; Lee, Pyoung Jik; Hong, Joo Young; Cabrera, Densil

2011-12-01

The aim of this study is to characterize urban spaces, which combine landscape, acoustics, and lighting, and to investigate people's perceptions of urban soundscapes through quantitative and qualitative analyses. A general questionnaire survey and soundwalk were performed to investigate soundscape perception in urban spaces. Non-auditory factors (visual image, day lighting, and olfactory perceptions), as well as acoustic comfort, were selected as the main contexts that affect soundscape perception, and context preferences and overall impressions were evaluated using an 11-point numerical scale. For qualitative analysis, a semantic differential test was performed in the form of a social survey, and subjects were also asked to describe their impressions during a soundwalk. The results showed that urban soundscapes can be characterized by soundmarks, and soundscape perceptions are dominated by acoustic comfort, visual images, and day lighting, whereas reverberance in urban spaces does not yield consistent preference judgments. It is posited that the subjective evaluation of reverberance can be replaced by physical measurements. The categories extracted from the qualitative analysis revealed that spatial impressions such as openness and density emerged as some of the contexts of soundscape perception. © 2011 Acoustical Society of America

[Clinical research XXIII. From clinical judgment to meta-analyses].

PubMed

Rivas-Ruiz, Rodolfo; Castelán-Martínez, Osvaldo D; Pérez-Rodríguez, Marcela; Palacios-Cruz, Lino; Noyola-Castillo, Maura E; Talavera, Juan O

2014-01-01

Systematic reviews (SR) are studies made in order to ask clinical questions based on original articles. Meta-analysis (MTA) is the mathematical analysis of SR. These analyses are divided in two groups, those which evaluate the measured results of quantitative variables (for example, the body mass index -BMI-) and those which evaluate qualitative variables (for example, if a patient is alive or dead, or if he is healing or not). Quantitative variables generally use the mean difference analysis and qualitative variables can be performed using several calculations: odds ratio (OR), relative risk (RR), absolute risk reduction (ARR) and hazard ratio (HR). These analyses are represented through forest plots which allow the evaluation of each individual study, as well as the heterogeneity between studies and the overall effect of the intervention. These analyses are mainly based on Student's t test and chi-squared. To take appropriate decisions based on the MTA, it is important to understand the characteristics of statistical methods in order to avoid misinterpretations.

[Advantages and disadvantages of incorporating qualitative methodology in the evaluation of health services. A practical case: evaluation of a high-resolution clinic].

PubMed

Alvarez Del Arco, D; Rodríguez Rieiro, C; Sanchidrián De Blás, C; Alejos, B; Plá Mestre, R

2012-01-01

We examined the usefulness of incorporating a qualitative phase in the evaluation of the quality of care in a high-resolution medical service carried out with quantitative methods. A quantitative research was performed using a structured questionnaire and selecting interviewees by systematic randomized sampling methods (n=320). In addition, a qualitative research was carried on through semi-structured interviews with patients selected by convenience criteria (n=11), observations in the care assistance circuit, and a group interview with health professionals working in the service. A multidisciplinary research team conducted an individual analysis of the information collected in both quantitative and qualitative phases. Subsequently, three meetings based on group brainstorming techniques were held to identify the diverse contributions of each of the methodologies employed to the research, using affinity graphs to analyse the different results obtained in both phases and evaluate possible bias arising from the use of qualitative methods. Qualitative research allowed examining specific aspects of the health care service that had been collected in the quantitative phase, harmonizing the results obtained in the previous phase, giving in-depth data on the reasons for patient dissatisfaction with specific aspects, such as waiting times and available infrastructures, and identifying emerging issues of the service which had not been previously assessed. Overall, the qualitative phase enriched the results of the research. It is appropriate and recommendable to incorporate this methodological approach in research aimed at evaluating the quality of the service in specific health care settings, since it is provided first hand, by the voice of the customer. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Built environment interventions aimed at improving physical activity levels in rural Ontario health units: a descriptive qualitative study.

PubMed

Coghill, Cara-Lee; Valaitis, Ruta K; Eyles, John D

2015-05-03

Few studies to date have explored the relationship between the built environment and physical activity specifically in rural settings. The Ontario Public Health Standards policies mandate that health units in Ontario address the built environment; however, it is unclear how public health practitioners are integrating the built environment into public health interventions aimed at improving physical activity in chronic disease prevention programs. This descriptive qualitative study explored interventions that have or are being implemented which address the built environment specifically related to physical activity in rural Ontario health units, and the impact of these interventions. Data were collected through twelve in-depth semi-structured interviews with rural public health practitioners and managers representing 12 of 13 health units serving rural communities. Key themes were identified using qualitative content analysis. Themes that emerged regarding the types of interventions that health units are employing included: Engagement with policy work at a municipal level; building and working with community partners, committees and coalitions; gathering and providing evidence; developing and implementing programs; and social marketing and awareness raising. Evaluation of interventions to date has been limited. Public health interventions, and their evaluations, are complex. Health units who serve large rural populations in Ontario are engaging in numerous activities to address physical activity levels. There is a need to further evaluate the impact of these interventions on population health.

A Computational Approach to Qualitative Analysis in Large Textual Datasets

PubMed Central

Evans, Michael S.

2014-01-01

In this paper I introduce computational techniques to extend qualitative analysis into the study of large textual datasets. I demonstrate these techniques by using probabilistic topic modeling to analyze a broad sample of 14,952 documents published in major American newspapers from 1980 through 2012. I show how computational data mining techniques can identify and evaluate the significance of qualitatively distinct subjects of discussion across a wide range of public discourse. I also show how examining large textual datasets with computational methods can overcome methodological limitations of conventional qualitative methods, such as how to measure the impact of particular cases on broader discourse, how to validate substantive inferences from small samples of textual data, and how to determine if identified cases are part of a consistent temporal pattern. PMID:24498398

40 CFR 227.21 - Uses considered.

Code of Federal Regulations, 2012 CFR

2012-07-01

... be affected by the proposed dumping, and a quantitative and qualitative evaluation made, where... development and offshore marine terminal or other structure development; and (l) Scientific research and study. ...

40 CFR 227.21 - Uses considered.

Code of Federal Regulations, 2011 CFR

2011-07-01

... be affected by the proposed dumping, and a quantitative and qualitative evaluation made, where... development and offshore marine terminal or other structure development; and (l) Scientific research and study. ...

40 CFR 227.21 - Uses considered.

Code of Federal Regulations, 2010 CFR

2010-07-01

... be affected by the proposed dumping, and a quantitative and qualitative evaluation made, where... development and offshore marine terminal or other structure development; and (l) Scientific research and study. ...

40 CFR 227.21 - Uses considered.

Code of Federal Regulations, 2014 CFR

2014-07-01

... be affected by the proposed dumping, and a quantitative and qualitative evaluation made, where... development and offshore marine terminal or other structure development; and (l) Scientific research and study. ...

40 CFR 227.21 - Uses considered.

Code of Federal Regulations, 2013 CFR

2013-07-01

... be affected by the proposed dumping, and a quantitative and qualitative evaluation made, where... development and offshore marine terminal or other structure development; and (l) Scientific research and study. ...

Evaluating the Efficacy of the Complete College Tennessee Act of 2010: A Qualitative Analysis of Leadership and Student Persistence among Colleges and Universities in Tennessee

ERIC Educational Resources Information Center

Brown, Celeste M.

2013-01-01

The Complete College Tennessee Act of 2010 (CCTA) changed the funding formula from enrollment-based to outcomes-based in order to increase the number of college graduates in Tennessee and as a result altered the landscape of public higher education in the state. The purpose of this qualitative study was to ascertain the impact of the CCTA on…

The Contribution of Qualitative CEUS to the Determination of Malignancy in Adnexal Masses, Indeterminate on Conventional US – A Multicenter Study

PubMed Central

Zhang, Xinling; Mao, Yongjiang; Zheng, Rongqin; Zheng, Zhijuan; Huang, Zeping; Huang, Dongmei; Zhang, Jing; Dai, Qing; Zhou, Xiaodong; Wen, Yanling

2014-01-01

The aim of this study is to evaluate the efficacy of qualitative analysis of contrast-enhanced ultrasound (CEUS) in discrimination of adnexal masses which were undetermined by conventional ultrasound (US). A total of 120 patients underwent transabdominal CEUS. The initial enhancement time and intensity compared with the uterine myometrium, contrast agent distribution patterns and dynamic changes of enhancement were assessed. The sensitivity (Sen), specificity (Spe), positive predictive value (PPV), negative predictive value (NPV), accuracy (ACC) and Youden’s index were calculated for contrast variables. The gold standard was the histological diagnosis. There were 48 malignant tumors and 72 benign tumors. The enhancement features of malignant masses were different from benign ones. Earlier or simultaneous enhancement with inhomogeneous enhancement yielded the highest capability in differential diagnosis, and Sen, Spe, PPV, NPV, ACC, Youden’s index was 89.6%, 97.2%, 93.2%, 95.6%, 93.3%, and 0.88, respectively. The qualitative evaluation of CEUS is useful in the differential diagnosis of adnexal masses where conventional US is indeterminate. PMID:24736589

The contribution of qualitative CEUS to the determination of malignancy in adnexal masses, indeterminate on conventional US - a multicenter study.

PubMed

Zhang, Xinling; Mao, Yongjiang; Zheng, Rongqin; Zheng, Zhijuan; Huang, Zeping; Huang, Dongmei; Zhang, Jing; Dai, Qing; Zhou, Xiaodong; Wen, Yanling

2014-01-01

The aim of this study is to evaluate the efficacy of qualitative analysis of contrast-enhanced ultrasound (CEUS) in discrimination of adnexal masses which were undetermined by conventional ultrasound (US). A total of 120 patients underwent transabdominal CEUS. The initial enhancement time and intensity compared with the uterine myometrium, contrast agent distribution patterns and dynamic changes of enhancement were assessed. The sensitivity (Sen), specificity (Spe), positive predictive value (PPV), negative predictive value (NPV), accuracy (ACC) and Youden's index were calculated for contrast variables. The gold standard was the histological diagnosis. There were 48 malignant tumors and 72 benign tumors. The enhancement features of malignant masses were different from benign ones. Earlier or simultaneous enhancement with inhomogeneous enhancement yielded the highest capability in differential diagnosis, and Sen, Spe, PPV, NPV, ACC, Youden's index was 89.6%, 97.2%, 93.2%, 95.6%, 93.3%, and 0.88, respectively. The qualitative evaluation of CEUS is useful in the differential diagnosis of adnexal masses where conventional US is indeterminate.

Procedure versus process: ethical paradigms and the conduct of qualitative research.

PubMed

Pollock, Kristian

2012-09-27

Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic 'procedural' resolution. This is not to say that qualitative studies are 'unethical' but that their ethical nature can only be safeguarded through the practice of 'micro-ethics' based on the judgement and integrity of researchers in the field. This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of 'empirical ethics' as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Barriers and facilitators to physical activity in people with hip or knee osteoarthritis: protocol for a systematic review of qualitative evidence

PubMed Central

Kanavaki, Archontissa M; Rushton, Alison; Klocke, Rainer; Abhishek, Abhishek; Duda, Joan L

2016-01-01

Introduction This protocol aims to describe the objective and methods to be followed in a systematic review of qualitative studies on barriers and facilitators to physical activity (PA) in people with hip or knee osteoarthritis (OA). Methods and analysis MEDLINE, EMBASE, PhychINFO, Web of Science, CINAHL, SPORTDiscus, Scopus and grey literature sources will be electronically searched. Hand search of qualitative research-centred journals, reference screening of relevant reviews and inquiries to researchers active in the field will complement the search. Studies will be selected if they apply qualitative or mixed-methods designs to directly explore factors that correspond to engagement in PA/exercise or, the perceptions regarding PA/exercise in people with hip or knee OA. The Critical Appraisal Skills Programme Qualitative Checklist and the evaluative criteria of credibility, transferability, dependability and confirmability will be applied for the study appraisal. 2 independent reviewers will perform the search, study selection and study appraisal. Thematic synthesis will be used for synthesising the findings of the primary studies and the process and product of the synthesis will be checked by a second researcher. ConQual approach will be used for assessing the confidence in the qualitative findings. Ethics and dissemination This systematic review will inform our understanding of the PA determinants and how to optimise behaviour change in people living with hip or knee OA. The review findings will be reported in a peer-reviewed journal and presented at national or international conferences. The study raises no ethical issues. Trial registration number CRD42016030024. PMID:27810971

Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors.

PubMed

Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin

2016-09-01

The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

Developing Recruitment Methods for Vulnerable, Traumatized Adolescents: A Feminist Evaluation Approach

ERIC Educational Resources Information Center

Campbell, Rebecca; Greeson, Megan R.; Fehler-Cabral, Giannina

2014-01-01

This article describes the process by which we created a recruitment protocol for engaging adolescent sexual assault victims in a qualitative evaluation study. Working in collaboration with forensic nurses, rape victim advocates, adolescent rape survivors, and our institutional review board (IRB), we created a prospective recruitment method…

Evaluation of the National FFA Nominating Committee Training

ERIC Educational Resources Information Center

Bruce, Jacklyn; Ricketts, Kristina

2007-01-01

The purpose of this qualitative study was to evaluate if the environment of the National FFA Organization's Nominating Committee training fosters transfer of training to the job they are required to perform, selecting National FFA Officers. Nominating Committee members, advisors, National FFA staff, and National Officer candidates participated in…

Tools of Individual Evaluation and Prestige Recognition in Spain: How Sexenio 'Mints the Golden Coin of Authority'

ERIC Educational Resources Information Center

Marini, Giulio

2018-01-01

Individual experiences in dealing with individual evaluations are studied through a national documental analysis and qualitative interviews. The analysis considers three main individual assessments designed to measure individual credentials or performance: "sexenio" (research and third mission), "quinquenio" (teaching) and…

Principals' Sensemaking and Enactment of Teacher Evaluation

ERIC Educational Resources Information Center

Rigby, Jessica G.

2015-01-01

Purpose: The purpose of this paper is to look across six first-year principals to investigate their engagement with and sensemaking of specific messages of instructional leadership around teacher evaluation. Design/methodology/approach: This research project, a cross-case study, was carried out using in-depth qualitative observations and…

Teacher Evaluation Initial Policy Implementation: Superintendent and Principal Perceptions

ERIC Educational Resources Information Center

Derrington, Mary Lynne

2014-01-01

This multi-site qualitative study examined the perspectives of K-12 superintendents and principals in four districts of a Southeastern state during the implementation of a new teacher evaluation system required by the Race to the Top federal grant. Specifically, these educators' viewpoints regarding this two-year implementation's impact are…

Impact of Attendance Policy on Adult College Learners

ERIC Educational Resources Information Center

Carr, Tracinal S.

2014-01-01

This qualitative evaluation focused on the problem of student attrition at a northern California college, its attendance policy, the policy's impact on previous students' decisions to persist in school, and on administrators' attempts to increase retention. The purpose for this study was to evaluate the participants' perceptions about their…

Impartiality and Hierarchical Evaluations in the Japanese Development Aid Community

ERIC Educational Resources Information Center

Maemura, Yu

2016-01-01

This article presents a discourse analytic study of how the concept of impartiality is socially constructed by members of the development aid community through an examination of linguistic traits and patterns within (a) inter- and intraorganizational interactions and (b) relevant aid evaluation policy documents. A qualitative analysis of…

The Interpretation of Student Performance on Evaluative Tests.

ERIC Educational Resources Information Center

Aikenhead, Glen S.

Reported is a study on the use of quantitative data in evaluating a science course for the purpose of introducing an alternative form of information presentation capable of supplying qualitative feedback valuable to students, teachers, and curriculum developers. Fifty-five teachers, randomly selected during the 1967-68 Project Physics (PP)…

The Making of the Ordinary Child in Preschool

ERIC Educational Resources Information Center

Alasuutari, Maarit; Markstrom, Ann-Marie

2011-01-01

The article examines parent-teacher conferences in Finnish and Swedish preschools. Previous research has shown that the conferences are mostly about the evaluation of the child. Based on qualitative data, the article studies how this evaluation is done. It asks how the institutional order regarding children is constructed in parent-teacher…

Do Different Training Conditions Facilitate Team Implementation? A Quasi-Experimental Mixed Methods Study

ERIC Educational Resources Information Center

Nielsen, Karina; Randall, Raymond; Christensen, Karl B.

2017-01-01

A mixed methods approach was applied to examine the effects of a naturally occurring teamwork intervention supported with training. The first objective was to integrate qualitative process evaluation and quantitative effect evaluation to examine "how" and "why" the training influence intervention outcomes. The intervention (N =…

An integrative review of the impact of mobile technologies used by healthcare professionals to support education and practice.

PubMed

Guo, Ping; Watts, Kim; Wharrad, Heather

2016-04-01

The aim of this study was to provide evidence of the impact of mobile technologies among healthcare professionals in education and practice settings. Integrative literature review. Electronic databases including MEDLINE, CINAHL, PsycINFO, EMBASE, ERIC and Web of Science were searched for papers published between 2002-2012. Quantitative studies were critically evaluated based on Thomas et al .'s framework, while the consolidated criteria for reporting qualitative research was used to appraise the rigour of the qualitative studies. Seventeen quantitative and three qualitative studies were included. The findings suggest a largely positive influence of mobile technologies on various clinical practice and educational outcomes. However, robust evidence was limited. Use of mobile technologies in health care are associated with improvements in access to information, accuracy and efficiency, evidence-based decision making at the point of care and enhancement in performance, confidence and engagement in different contexts.

South Korean Family Caregiver Involvement in Delirium Care: A Qualitative Descriptive Study.

PubMed

Kang, Yun; Moyle, Wendy; Cooke, Marie; O'Dwyer, Siobhan

2017-12-01

The current study aimed to describe the effect of an educational program on RN-initiated efforts to involve family caregivers in delirium care. A descriptive qualitative study was performed. A purposive sample of 12 RNs who participated in a one group, pre-post evaluation of a delirium educational program, and a nominated sample of six family caregivers of patients who had been cared for by RNs in the program participated in individual, in-depth interviews. The qualitative findings indicated that the inclusion of a delirium brochure in ward orientation on admission, with reinforcement during shift changes, and RN-initiated engagement with family caregivers promoted family caregiver involvement in delirium prevention. Further studies in South Korea are needed to determine which family-centered nursing care interventions are culturally appropriate and most effective for RNs and family caregivers in delirium care. [Journal of Gerontological Nursing, 43(12), 44-51.]. Copyright 2017, SLACK Incorporated.

An Investigation of Teacher, Principal, and Superintendent Perceptions on the Ability of the National Framework for Principal Evaluations to Measure Principals' Leadership Competencies

ERIC Educational Resources Information Center

Lamb, Lori D.

2014-01-01

The purpose of this qualitative study was to investigate the perceptions of effective principals' leadership competencies; determine if the perceptions of teachers, principals, and superintendents aligned with the proposed National Framework for Principal Evaluations initiative. This study examined the six domains of leadership outlined by the…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

What Do We Expect of School Principals? Congruence between Principal Evaluation and Performance Standards

ERIC Educational Resources Information Center

Catano, Nancy; Stronge, James H.

2007-01-01

This study used both quantitative and qualitative methods of content analysis to examine principal evaluation instruments and state and professional standards for principals in school districts located in a mid-Atlantic state in the USA. The purposes of this study were to (a) determine the degrees of emphasis that are placed upon leadership and…

Review of health information technology usability study methodologies

PubMed Central

Bakken, Suzanne

2011-01-01

Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user–task interaction, n=42; stage 2, system–task interaction, n=310; stage 3, user–task–system interaction, n=69; stage 4, user–task–system–environment interaction, n=54; and stage 5, user–task–system–environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation. PMID:21828224

Why do local authorities undertake controlled evaluations of health impact? A qualitative case study of interventions in housing.

PubMed

Milton, S; Petticrew, M; Green, J

2014-12-01

A significant amount of literature documents the challenges of undertaking evaluative research on the public health impacts of interventions in the non-health sector. However, few studies have investigated why such studies are undertaken despite the undoubted challenges. Taking housing as a case study, the authors aimed to identify the factors contributing to successful evaluative research in the non-health sector. Qualitative interview study. Semi-structured interviews with 16 investigators involved in seven successful experimental studies of housing interventions across the UK, analysed using thematic content analysis. Intervention studies were undertaken when existing collaborative links enabled 'windows of opportunity' to be exploited. Although different 'cultures of evidence' were reported across the collaborating teams, these did not necessarily map onto the public health research/non-academic divide, and did not undermine collaborative work when all parties could gain from taking part in the research. Focussing on success, rather than failure, suggests that to encourage the uptake of evaluative evidence in the non-health sector, efforts might be better directed at fostering opportunities for partnership building rather than simply on educating non-health partners in the principles of academic research. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

PubMed

Badran, Hani; Pluye, Pierre; Grad, Roland

2017-03-14

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. ©Hani Badran, Pierre Pluye, Roland Grad. Originally published in JMIR Medical Education (http://mededu.jmir.org), 14.03.2017.

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis

PubMed Central

2014-01-01

Background Caring for a young person experiencing first-episode psychosis is challenging and can affect carers’ well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers’ beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. Methods A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Results Three themes were abstracted from the data, reflecting carers’ beliefs about the usefulness of the manual: promoting carers’ well-being, increasing carers’ understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. Conclusion This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. Trial registration ACTRN12609000064202 PMID:24906392

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis.

PubMed

McCann, Terence V; Lubman, Dan I

2014-06-06

Caring for a young person experiencing first-episode psychosis is challenging and can affect carers' well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers' beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Three themes were abstracted from the data, reflecting carers' beliefs about the usefulness of the manual: promoting carers' well-being, increasing carers' understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. ACTRN12609000064202.

Standards for reporting qualitative research: a synthesis of recommendations.

PubMed

O'Brien, Bridget C; Harris, Ilene B; Beckman, Thomas J; Reed, Darcy A; Cook, David A

2014-09-01

Standards for reporting exist for many types of quantitative research, but currently none exist for the broad spectrum of qualitative research. The purpose of the present study was to formulate and define standards for reporting qualitative research while preserving the requisite flexibility to accommodate various paradigms, approaches, and methods. The authors identified guidelines, reporting standards, and critical appraisal criteria for qualitative research by searching PubMed, Web of Science, and Google through July 2013; reviewing the reference lists of retrieved sources; and contacting experts. Specifically, two authors reviewed a sample of sources to generate an initial set of items that were potentially important in reporting qualitative research. Through an iterative process of reviewing sources, modifying the set of items, and coding all sources for items, the authors prepared a near-final list of items and descriptions and sent this list to five external reviewers for feedback. The final items and descriptions included in the reporting standards reflect this feedback. The Standards for Reporting Qualitative Research (SRQR) consists of 21 items. The authors define and explain key elements of each item and provide examples from recently published articles to illustrate ways in which the standards can be met. The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear standards for reporting qualitative research. These standards will assist authors during manuscript preparation, editors and reviewers in evaluating a manuscript for potential publication, and readers when critically appraising, applying, and synthesizing study findings.

Qualitative Evaluation of Emotional Intelligence In-Service Program for Secondary School Teachers

ERIC Educational Resources Information Center

Fer, Seval

2004-01-01

This paper is an attempt to evaluate the Emotional Intelligence (EQ) In-Service Program on the basis of experiences of 20 secondary school teachers who attended the program in a private school in Turkey. A phenomenological approach, with a focus group method was used. The first objective of this study was to evaluate EQ program on the basis of…

Evaluating the patient experience after implantation of a 0.4 mg sustained release dexamethasone intracanalicular insert (Dextenza™): results of a qualitative survey.

PubMed

Gira, Joseph P; Sampson, Reginald; Silverstein, Steven M; Walters, Thomas R; Metzinger, Jamie Lynne; Talamo, Jonathan H

2017-01-01

The purpose of this study is to evaluate the patient experience of sustained release dexamethasone intracanalicular insert (Dextenza™) following cataract surgery as part of a Phase III clinical trial program. This cross-sectional, qualitative evaluation involved individual interviews lasting approximately 45 minutes. Patients from four US investigational study sites who had previously received an insert were enrolled. There were no predesignated end points; this was a qualitative survey seeking a deeper understanding of patient experience. Twenty-five patients were interviewed. Most patients (92%) reported the highest level of satisfaction grade with regard to overall product satisfaction. All patients described the insert as comfortable. Most patients (96%) described their overall experience with the insert as very convenient or extremely convenient. Twenty-two of 23 (96%) participants rated their experience with the insert as "very" or "extremely convenient", compared to previous topical therapy, and 88% of patients stated that if they were to undergo cataract surgery again, they would request the insert. When asked if they would recommend the insert to family members or friends, 92% stated they would. The survey found that 84% of participants would be willing to pay more for the insert than for eye drop therapy. The dexamethasone insert was found by patients to be highly favorable with regard to overall satisfaction, convenience, and comfort. The insert was well received and largely preferred over topical therapy alternatives following surgery. More extensive evaluation of the patient experience is warranted, and future studies should help inform design of the next generation of sustained release drug delivery systems.

The role of empathy and emotional intelligence in nurses' communication attitudes using regression models and fuzzy-set qualitative comparative analysis models.

PubMed

Giménez-Espert, María Del Carmen; Prado-Gascó, Vicente Javier

2018-03-01

To analyse link between empathy and emotional intelligence as a predictor of nurses' attitudes towards communication while comparing the contribution of emotional aspects and attitudinal elements on potential behaviour. Nurses' attitudes towards communication, empathy and emotional intelligence are key skills for nurses involved in patient care. There are currently no studies analysing this link, and its investigation is needed because attitudes may influence communication behaviours. Correlational study. To attain this goal, self-reported instruments (attitudes towards communication of nurses, trait emotional intelligence (Trait Emotional Meta-Mood Scale) and Jefferson Scale of Nursing Empathy (Jefferson Scale Nursing Empathy) were collected from 460 nurses between September 2015-February 2016. Two different analytical methodologies were used: traditional regression models and fuzzy-set qualitative comparative analysis models. The results of the regression model suggest that cognitive dimensions of attitude are a significant and positive predictor of the behavioural dimension. The perspective-taking dimension of empathy and the emotional-clarity dimension of emotional intelligence were significant positive predictors of the dimensions of attitudes towards communication, except for the affective dimension (for which the association was negative). The results of the fuzzy-set qualitative comparative analysis models confirm that the combination of high levels of cognitive dimension of attitudes, perspective-taking and emotional clarity explained high levels of the behavioural dimension of attitude. Empathy and emotional intelligence are predictors of nurses' attitudes towards communication, and the cognitive dimension of attitude is a good predictor of the behavioural dimension of attitudes towards communication of nurses in both regression models and fuzzy-set qualitative comparative analysis. In general, the fuzzy-set qualitative comparative analysis models appear to be better predictors than the regression models are. To evaluate current practices, establish intervention strategies and evaluate their effectiveness. The evaluation of these variables and their relationships are important in creating a satisfied and sustainable workforce and improving quality of care and patient health. © 2018 John Wiley & Sons Ltd.

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

Comparison of qualitative and quantitative evaluation of diffusion-weighted MRI and chemical-shift imaging in the differentiation of benign and malignant vertebral body fractures.

PubMed

Geith, Tobias; Schmidt, Gerwin; Biffar, Andreas; Dietrich, Olaf; Dürr, Hans Roland; Reiser, Maximilian; Baur-Melnyk, Andrea

2012-11-01

The objective of our study was to compare the diagnostic value of qualitative diffusion-weighted imaging (DWI), quantitative DWI, and chemical-shift imaging in a single prospective cohort of patients with acute osteoporotic and malignant vertebral fractures. The study group was composed of patients with 26 osteoporotic vertebral fractures (18 women, eight men; mean age, 69 years; age range, 31 years 6 months to 86 years 2 months) and 20 malignant vertebral fractures (nine women, 11 men; mean age, 63.4 years; age range, 24 years 8 months to 86 years 4 months). T1-weighted, STIR, and T2-weighted sequences were acquired at 1.5 T. A DW reverse fast imaging with steady-state free precession (PSIF) sequence at different delta values was evaluated qualitatively. A DW echo-planar imaging (EPI) sequence and a DW single-shot turbo spin-echo (TSE) sequence at different b values were evaluated qualitatively and quantitatively using the apparent diffusion coefficient. Opposed-phase sequences were used to assess signal intensity qualitatively. The signal loss between in- and opposed-phase images was determined quantitatively. Two-tailed Fisher exact test, Mann-Whitney test, and receiver operating characteristic analysis were performed. Sensitivities, specificities, and accuracies were determined. Qualitative DW-PSIF imaging (delta = 3 ms) showed the best performance for distinguishing between benign and malignant fractures (sensitivity, 100%; specificity, 88.5%; accuracy, 93.5%). Qualitative DW-EPI (b = 50 s/mm(2) [p = 1.00]; b = 250 s/mm(2) [p = 0.50]) and DW single-shot TSE imaging (b = 100 s/mm(2) [p = 1.00]; b = 250 s/mm(2) [p = 0.18]; b = 400 s/mm(2) [p = 0.18]; b = 600 s/mm(2) [p = 0.39]) did not indicate significant differences between benign and malignant fractures. DW-EPI using a b value of 500 s/mm(2) (p = 0.01) indicated significant differences between benign and malignant vertebral fractures. Quantitative DW-EPI (p = 0.09) and qualitative opposed-phase imaging (p = 0.06) did not exhibit significant differences, quantitative DW single-shot TSE imaging (p = 0.002) and quantitative chemical-shift imaging (p = 0.01) showed significant differences between benign and malignant fractures. The DW-PSIF sequence (delta = 3 ms) had the highest accuracy in differentiating benign from malignant vertebral fractures. Quantitative chemical-shift imaging and quantitative DW single-shot TSE imaging had a lower accuracy than DW-PSIF imaging because of a large overlap. Qualitative assessment of opposed-phase, DW-EPI, and DW single-shot TSE sequences and quantitative assessment of the DW-EPI sequence were not suitable for distinguishing between benign and malignant vertebral fractures.

Developing a Tool to Evaluate Differences in Beliefs about Science Teaching and Learning among Freshman Science Student Teachers from Different Science Teaching Domains: A Case Study

ERIC Educational Resources Information Center

Markic, Silvija; Eilks, Ingo; Valanides, Nicos

2008-01-01

This paper presents a pilot case study on developing a qualitative tool to evaluate science student teachers' beliefs concerning science teaching and learning. The study is based on student teachers' drawings of themselves in a typical classroom situation and four open questions. Data was collected from 104 freshman science student teachers, and…

Teacher Educator's and Guidance Teachers' Evaluation of Student Teachers' Teaching Practice: A Qualitative Study = Procjena nastavne prakse studenata--buducih ucitelja--od mentora i savjetnika (kvalitativna studija)

ERIC Educational Resources Information Center

Göçer, Ali

2013-01-01

The aim of this study was to determine whether student teachers are sufficiently prepared for teaching practice in primary schools. In this study, student teachers' teaching practice in real classrooms was evaluated by using observation and interview methods. For this purpose, interviews were conducted with seven guidance teachers, and each…

'Stories' or 'snapshots'? A study directed at comparing qualitative and quantitative approaches to curriculum evaluation.

PubMed

Pateman, B; Jinks, A M

1999-01-01

The focus of this paper is a study designed to explore the validity of quantitative approaches of student evaluation in a pre-registration degree programme. As managers of the students' education we were concerned that the quantitative method, which used lecturer criteria, may not fully represent students' views. The approach taken is that of a process-type strategy for curriculum evaluation as described by Parlett and Hamilton (1972). The aim of the study is to produce illuminative data, or students' 'stories' of their educational experiences through use of semi-structured interviews. The results are then compared to the current quantitative measurement tools designed to obtain 'snapshots' of the educational effectiveness of the curriculum. The quantitative measurement tools use Likert scale measurements of teacher-devised criterion statements. The results of the study give a rich source of qualitative data which can be used to inform future curriculum development. However, complete validation of the current quantitative instruments used was not achieved in this study. Student and teacher agendas in respect of important issues pertaining to the course programme were found to differ. Limitations of the study are given. There is discussion of the options open to the management team with regard to future development of curriculum evaluation systems.

Simulated Patients in Physical Therapy Education: Systematic Review and Meta-Analysis.

PubMed

Pritchard, Shane A; Blackstock, Felicity C; Nestel, Debra; Keating, Jenny L

2016-09-01

Traditional models of physical therapy clinical education are experiencing unprecedented pressures. Simulation-based education with simulated (standardized) patients (SPs) is one alternative that has significant potential value, and implementation is increasing globally. However, no review evaluating the effects of SPs on professional (entry-level) physical therapy education is available. The purpose of this study was to synthesize and critically appraise the findings of empirical studies evaluating the contribution of SPs to entry-level physical therapy education, compared with no SP interaction or an alternative education strategy, on any outcome relevant to learning. A systematic search was conducted of Ovid MEDLINE, PubMed, AMED, ERIC, and CINAHL Plus databases and reference lists of included articles, relevant reviews, and gray literature up to May 2015. Articles reporting quantitative or qualitative data evaluating the contribution of SPs to entry-level physical therapy education were included. Two reviewers independently extracted study characteristics, intervention details, and quantitative and qualitative evaluation data from the 14 articles that met the eligibility criteria. Pooled random-effects meta-analysis indicated that replacing up to 25% of authentic patient-based physical therapist practice with SP-based education results in comparable competency (mean difference=1.55/100; 95% confidence interval=-1.08, 4.18; P=.25). Thematic analysis of qualitative data indicated that students value learning with SPs. Assumptions were made to enable pooling of data, and the search strategy was limited to English. Simulated patients appear to have an effect comparable to that of alternative educational strategies on development of physical therapy clinical practice competencies and serve a valuable role in entry-level physical therapy education. However, available research lacks the rigor required for confidence in findings. Given the potential advantages for students, high-quality studies that include an economic analysis should be conducted. © 2016 American Physical Therapy Association.

Qualitative studies. Their role in medical research.

PubMed Central

Huston, P.; Rowan, M.

1998-01-01

OBJECTIVE: To define qualitative research in terms of its philosophical roots, the questions it addresses, its methods and analyses, and the type of results it can offer. DATA SOURCES: MEDLINE and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases were searched for the years January 1985 to April 1998. The search strategy consisted of "textword" terms that searched in the "title" field of both databases. Qualitative research and evaluation textbooks in health and the social sciences were also used. QUALITY OF EVIDENCE: The information on qualitative research is based on the most recent and valid evidence from the health and social science fields. MAIN MESSAGE: Qualitative research seeks to understand and interpret personal experience to explain social phenomena, including those related to health. It can address questions that quantitative research cannot, such as why people do not adhere to a treatment regimen or why a certain health care intervention is successful. It uses many methods of data collection, including participant observation, case studies, and interviews, and numerous approaches to data analysis that range from the quasistatistical to the intuitive and inductive. CONCLUSIONS: Qualitative research, a form of research completely different from quantitative research, can provide important insights into health-related phenomena and can enrich further research inquiries. PMID:9839063

New integrated information system for pusan national university hospital.

PubMed

Kim, Hyung Hoi; Cho, Kyung-Won; Kim, Hye Sook; Kim, Ju-Sim; Kim, Jung Hyun; Han, Sang Pil; Park, Chun Bok; Kim, Seok; Chae, Young Moon

2011-03-01

This study presents the information system for Pusan National University Hospital (PNUH), evaluates its performance qualitatively, and conducts economic analysis. Information system for PNUH was designed by component-based development and developed by internet technologies. Order Communication System, Electronic Medical Record, and Clinical Decision Support System were newly developed. The performance of the hospital information system was qualitatively evaluated based on the performance reference model in order to identify problem areas for the old system. The Information Economics approach was used to analyze the economic feasibility of hospital information system in order to account for the intangible benefits. Average performance scores were 3.16 for input layer, 3.35 for process layer, and 3.57 for business layer. In addition, the cumulative benefit to cost ratio was 0.50 in 2011, 1.73 in 2012, 1.76 in 2013, 1.71 in 2014, and 1.71 in 2015. The B/C ratios steadily increase as value items are added. While overall performance scores were reasonably high, doctors were less satisfied with the system, perhaps due to the weak clinical function in the systems. The information economics analysis demonstrated the economic profitability of the information systems if all intangible benefits were included. The second qualitative evaluation survey and economic analysis were proposed to evaluate the changes in performance of the new system.

A bibliometric analysis of evaluative medical education studies: characteristics and indexing accuracy.

PubMed

Sampson, Margaret; Horsley, Tanya; Doja, Asif

2013-03-01

To determine the characteristics of medical education studies published in general and internal medicine (GIM) and medical education journals, and to analyze the accuracy of their indexing. The authors identified the five GIM and five medical education journals that published the most articles indexed in MEDLINE as medical education during January 2001 to January 2010. They searched Ovid MEDLINE for evaluative medical education studies published in these journals during this period and classified them as quantitative or qualitative studies according to MEDLINE indexing. They also examined themes and learner levels targeted. Using a random sample of records, they assessed the accuracy of study-type indexing. Of 4,418 records retrieved, 3,853 (87.2%) were from medical education journals and 565 (12.3%) were from GIM journals. Qualitative studies and program evaluations were more prevalent within medical education journals, whereas GIM journals published a higher proportion of clinical trials and systematic reviews (χ=74.28, df=3, P<.001). Medical education journals had a concentration of studies targeting medical students, whereas GIM journals had a concentration targeting residents; themes were similar. The authors confirmed that 170 (56.7%) of the 300 sampled articles were correctly classified in MEDLINE as evaluative studies. The majority of the identified evaluative studies were published in medical education journals, confirming the integrity of medical education as a specialty. Findings concerning the study types published in medical education versus GIM journals are important for medical education researchers who seek to publish outside the field's specialty journals.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

[Criteria of scientific validity in research].

PubMed

Pelletier, Céline; Pagé, Ginette

2002-03-01

The purpose of this article is to present the evaluative criteria of qualitative and quantitative research. Philosophical foundations of positivism, postpositivism and constructivism are explored. Triangulation and crystallization expose the controversies about them. Finally, Lincoln and Guba criteria are retained for the evaluation of qualitative and quantitative research.

Investigating the role of Fuzzy as confirmatory tool for service quality assessment (Case study: Comparison of Fuzzy SERVQUAL and SERVQUAL in hotel service evaluation)

NASA Astrophysics Data System (ADS)

Wahyudi, R. D.

2017-11-01

The problem was because of some indicators qualitatively assessed had been discussed in engineering field. Whereas, qualitative assessment was presently used in certain occasion including in engineering field, for instance, the assessment of service satisfaction. Probably, understanding of satisfaction definition caused bias if customers had their own definition of satisfactory level of service. Therefore, the use of fuzzy logic in SERVQUAL as service satisfaction measurement tool would probably be useful. This paper aimed to investigate the role of fuzzy in SERVQUAL by comparing result measurement of SERVQUAL and fuzzy SERVQUAL for study case of hotel service evaluation. Based on data processing, initial result showed that there was no significant different between them. Thus, either implementation of fuzzy SERVQUAL in different case or study about the role of fuzzy logic in SERVQUAL would be interesting further discussed topic.

Fuzzy-Set Case Studies

ERIC Educational Resources Information Center

Mikkelsen, Kim Sass

2017-01-01

Contemporary case studies rely on verbal arguments and set theory to build or evaluate theoretical claims. While existing procedures excel in the use of qualitative information (information about kind), they ignore quantitative information (information about degree) at central points of the analysis. Effectively, contemporary case studies rely on…

Are we ready to accept the challenge? Addressing the shortcomings of contemporary qualitative health research.

PubMed

Lau, Sofie Rosenlund; Traulsen, Janine M

Qualitative approaches represent an important contributor to health care research. However, several researchers argue that contemporary qualitative research does not live up to its full potential. By presenting a snapshot of contemporary qualitative research in the field of social and administrative pharmacy, this study challenges contributors to the field by asking: Are we ready to accept the challenge and take qualitative research one step further? The purpose of this study was to initiate a constructive dialogue on the need for increased transparency in qualitative data analysis, including explicitly reflecting upon theoretical perspectives affecting the research process. Content analysis was used to evaluate levels of theoretical visibility and analysis transparency in selected qualitative research articles published in Research in Social and Administrative Pharmacy between January 2014 and January 2015. In 14 out of 21 assessed papers, the use of theory was found to be Seemingly Absent (lowest level of theory use), and the data analyses did not include any interpretive endeavors. Only two papers consistently applied theory throughout the entire study and clearly took the data analyses from a descriptive to an interpretive level. It was found that the aim of the majority of assessed papers was to change or modify a given practice, which however, resulted in a lack of both theoretical underpinnings and analysis transparency. This study takes the standpoint that theory and high-quality analysis go hand-in-hand. Based on the content analysis, articles that were deemed to be high in quality were explicit about the theoretical framework of their study and transparent in how they analyzed their data. It was found that theory contributed to the transparency of how the data were analyzed and interpreted. Two ways of improving contemporary qualitative research in the field of social and administrative pharmacy are discussed: engaging with social theory and establishing close collaboration with social scientists. Copyright © 2016 Elsevier Inc. All rights reserved.

Qualitative research within trials: developing a standard operating procedure for a clinical trials unit

PubMed Central

2013-01-01

Background Qualitative research methods are increasingly used within clinical trials to address broader research questions than can be addressed by quantitative methods alone. These methods enable health professionals, service users, and other stakeholders to contribute their views and experiences to evaluation of healthcare treatments, interventions, or policies, and influence the design of trials. Qualitative data often contribute information that is better able to reform policy or influence design. Methods Health services researchers, including trialists, clinicians, and qualitative researchers, worked collaboratively to develop a comprehensive portfolio of standard operating procedures (SOPs) for the West Wales Organisation for Rigorous Trials in Health (WWORTH), a clinical trials unit (CTU) at Swansea University, which has recently achieved registration with the UK Clinical Research Collaboration (UKCRC). Although the UKCRC requires a total of 25 SOPs from registered CTUs, WWORTH chose to add an additional qualitative-methods SOP (QM-SOP). Results The qualitative methods SOP (QM-SOP) defines good practice in designing and implementing qualitative components of trials, while allowing flexibility of approach and method. Its basic principles are that: qualitative researchers should be contributors from the start of trials with qualitative potential; the qualitative component should have clear aims; and the main study publication should report on the qualitative component. Conclusions We recommend that CTUs consider developing a QM-SOP to enhance the conduct of quantitative trials by adding qualitative data and analysis. We judge that this improves the value of quantitative trials, and contributes to the future development of multi-method trials. PMID:23433341

Pre-Service Teachers' Evaluations of Practices in Teaching English to Young Learners in Terms of 21st Century Teacher Qualifications

ERIC Educational Resources Information Center

Çakir, Abdulvahit; Güngör, Müzeyyen Nazli

2017-01-01

This study investigates the 3rd year and 4th year pre-service teachers' evaluations of the practices in teaching English to young learners in terms of 21st century teacher qualifications. Employing a mixed methods design, this study includes the qualitative data that come from semi-structured interviewed questions administered to pre-service…

Curriculum Evaluation in Online Education: The Case of Teacher Candidates Preparing Online for Public Personnel Selection Examination

ERIC Educational Resources Information Center

Karacaoglu, Ömer Cem

2018-01-01

The aim of the present study is to evaluate the efficiency of an online curriculum based on the views of lecturers and students enrolled in the program. The study is mainly based on survey method. In order to collect qualitative data, interviews forms developed by the researcher were used. The reliability and validity of the interview forms were…

The Influence of Words Categories on Translating Postgraduate Abstracts in the Field of Evaluation and Measurement at Mu'tah University

ERIC Educational Resources Information Center

Al Khotaba, Eissa; Al Magarbeh, Bassam

2015-01-01

The goal of this study is to investigate the influence of words categories on translating postgraduate students abstracts doing their M.A in Evaluation and Measurement at Mutah university in Jordan for the academic year 2014/2015. This qualitative and quantitative study includes 15 postgraduate students' abstracts in the field of Evaluation…

Addressing Substandard Teaching in Schools: An Assessment of Principals' Enabling Behavior

ERIC Educational Resources Information Center

Gluck, Arlene

2013-01-01

Researchers estimate that 5-15% of American teachers do not produce the desired student performance. Nevertheless, 99% of U.S. teachers receive satisfactory evaluations annually. Guided by literature on obstacles to effective evaluation, this qualitative case study sought to understand the reasons why principals hesitate to confront substandard…

A Strengths-Based Group Intervention for Women Who Experienced Child Sexual Abuse

ERIC Educational Resources Information Center

Walker-Williams, Hayley J.; Fouché, Ansie

2017-01-01

Purpose: This study evaluated the benefits of a ''survivor to thriver'' strengths-based group intervention program to facilitate posttraumatic growth in women survivors of child sexual abuse. Method: A quasi-experimental, one group, pretest, posttest, time-delay design was employed using qualitative methods to evaluate the benefits of the…

Structured Play and Student Learning in Kindergarten: An Outcome Evaluation

ERIC Educational Resources Information Center

Rodgers, Moira Smith

2012-01-01

This qualitative research study was an outcome evaluation of an alternative kindergarten curriculum to those currently used in most public schools. Tools of the Mind, a Vygotskian, play-based curriculum was implemented during the 2010-2011 school year in four kindergarten classrooms, involving data from approximately 50 students, within a public…

Innovations in Doctoral Education: Distance Education Methodology Applied

ERIC Educational Resources Information Center

Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan

2009-01-01

This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…

Passionate Pedagogy and Emotional Labor: Students' Responses to Learning Diversity from Diverse Instructors

ERIC Educational Resources Information Center

Schueths, April M.; Gladney, Tanya; Crawford, Devan M.; Bass, Katherine L.; Moore, Helen A.

2013-01-01

This qualitative study examines emotion themes reflected in student evaluations from required diversity courses at a predominantly white, US public university. We analyze two years of student evaluations for 29 instructors. Situated by the work of Acker, Jaggar, and Hochschild, we find contradictory themes of perceived instructional bias and the…

Relationship between Teacher Self-Efficacy and the Teacher Evaluation Process

ERIC Educational Resources Information Center

Pisciotta, Summer

2014-01-01

Changes in state laws led the education system personnel in Arizona to reconsider how they assess students, teachers, and administrators. Higher expectations for teacher and student performance and a budget deficit at schools resulted in evaluations being a focal point in teacher contract renewal. The purpose of this qualitative case study was to…

Models Matter--The Final Report of the National Longitudinal Evaluation of Comprehensive School Reform

ERIC Educational Resources Information Center

Aladjem, Daniel K.; LeFloch, Kerstin Carlson; Zhang, Yu; Kurki, Anja; Boyle, Andrea; Taylor, James E.; Herrmann, Suzannah; Uekawa, Kazuaki; Thomsen, Kerri; Fashola, Olatokunbo

2006-01-01

The National Longitudinal Evaluation of Comprehensive School Reform (NLECSR) is a quantitative and qualitative study of behavior, decisions, processes, and outcomes. It employs a quasi-experimental design with matched treatment and comparison schools. NLECSR seeks to determine the effects of CSR models on student achievement in about 650…

Methodology for Evaluating an Adaptation of Evidence-Based Drug Abuse Prevention in Alternative Schools

ERIC Educational Resources Information Center

Hopson, Laura M.; Steiker, Lori K. H.

2008-01-01

The purpose of this article is to set forth an innovative methodological protocol for culturally grounding interventions with high-risk youths in alternative schools. This study used mixed methods to evaluate original and adapted versions of a culturally grounded substance abuse prevention program. The qualitative and quantitative methods…

Assessing the Impact of Planned Social Change. Occasional Paper Series, #8.

ERIC Educational Resources Information Center

Campbell, Donald T.

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

Effectiveness of the Combat Operational Stress Control Training Program: Expectations of the U.S. Marine Corps

ERIC Educational Resources Information Center

Sipko, Marek M.

2010-01-01

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions. The…

Aspiring Principals' Perspectives about Teacher Supervision and Evaluation: Insights for Educational Leadership Preparation Programs

ERIC Educational Resources Information Center

Range, Bret G.; McKim, Courtney; Mette, Ian M.; Hvidston, David J.

2014-01-01

This qualitative study sought to understand the views of aspiring principals about teacher supervision and evaluation issues, including their perceived definitions of each, as well as concerns about performing either duty in their first administrative role. Thirty-­two educational administration graduate students enrolled in an instructional…

Evaluating the Effectiveness of READ 180: A Reading Program for Struggling Middle School Students

ERIC Educational Resources Information Center

Johnson, Latonya R.

2011-01-01

This study was conducted using a qualitative approach to evaluate the effectiveness of READ 180 Program in improving students reading interests and achievement at West Bolivar Middle School (WBMS). A number of interviews and observations were conducted. Two teachers and nine students were interviewed, and nine classroom observations were…

Entertainment Education and Social Change: Evaluating a Children's Soap Opera in Kenya

ERIC Educational Resources Information Center

de Block, Liesbeth

2012-01-01

This article discusses audience responses to a children's soap opera produced and broadcast in Kenya. It examines the evaluation process in relation to qualitative audience research within Cultural Studies. It challenges an Entertainment-Education model of media as vehicles for messages and links strongly with Communication for Social Change…

Qualitative and Quantitative Evaluation of Three Types of Student-Generated Videos as Instructional Support in Organic Chemistry Laboratories

ERIC Educational Resources Information Center

Box, Melinda C.; Dunnagan, Cathi L.; Hirsh, Lauren A. S.; Cherry, Clinton R.; Christianson, Kayla A.; Gibson, Radiance J.; Wolfe, Michael I.; Gallardo-Williams, Maria T.

2017-01-01

This study was designed to evaluate the effectiveness of student-generated videos as a supplement to teaching assistant (TA) instruction in an undergraduate organic chemistry laboratory. Three videos covering different aspects of lab instruction (experimental technique, use of instrumentation, and calculations) were produced using…

Online Extensive Reading for Advanced Foreign Language Learners: An Evaluation Study

ERIC Educational Resources Information Center

Arnold, Nike

2009-01-01

The following article reports the findings of a qualitative evaluation of an online extensive reading program in German as a foreign language. Designed for advanced learners, it differs from traditional extensive reading programs in two important aspects: students read online instead of printed materials, and there was no teacher preselection to…

A health equity critique of social marketing: where interventions have impact but insufficient reach.

PubMed

Langford, Rebecca; Panter-Brick, Catherine

2013-04-01

Health interventions increasingly rely on formative qualitative research and social marketing techniques to effect behavioural change. Few studies, however, incorporate qualitative research into the process of program evaluation to understand both impact and reach: namely, to what extent behaviour change interventions work, for whom, in what contexts, and why. We reflect on the success of a community-based hygiene intervention conducted in the slums of Kathmandu, Nepal, evaluating both maternal behaviour and infant health. We recruited all available mother-infant pairs (n = 88), and allocated them to control and intervention groups. Formative qualitative research on hand-washing practices included structured observations of 75 mothers, 3 focus groups, and 26 in-depth interviews. Our intervention was led by Community Motivators, intensively promoting hand-washing-with-soap at key junctures of food and faeces contamination. The 6-month evaluation period included hand-washing and morbidity rates, participant observation, systematic records of fortnightly community meetings, and follow-up interviews with 12 mothers. While quantitative measures demonstrated improvement in hand-washing rates and a 40% reduction in child diarrhoea, the qualitative data highlighted important equity issues in reaching the ultra-poor. We argue that a social marketing approach is inherently limited: focussing on individual agency, rather than structural conditions constraining behaviour, can unwittingly exacerbate health inequity. This contributes to a prevention paradox whereby those with the greatest need of a health intervention are least likely to benefit, finding hand-washing in the slums to be irrelevant or futile. Thus social marketing is best deployed within a range of interventions that address the structural as well as the behavioural and cognitive drivers of behaviour change. We conclude that critiques of social marketing have not paid sufficient attention to issues of health equity, and demonstrate how this can be addressed with qualitative data, embedded in both the formative and evaluative phases of a health intervention. Copyright © 2013 Elsevier Ltd. All rights reserved.

Enhancing the quality and credibility of qualitative analysis.

PubMed

Patton, M Q

1999-12-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems.

Positive Effects of a Stress Reduction Program Based on Mindfulness Meditation in Brazilian Nursing Professionals: Qualitative and Quantitative Evaluation.

PubMed

dos Santos, Teresa Maria; Kozasa, Elisa Harumi; Carmagnani, Isabel Sampaio; Tanaka, Luiza Hiromi; Lacerda, Shirley Silva; Nogueira-Martins, Luiz Antonio

2016-01-01

Mindfulness meditation has been shown to effectively mitigate the negative effects of stress among nursing professionals, but in countries like Brazil, these practices are relatively unexplored. To evaluate the effects of a Stress Reduction Program (SRP) including mindfulness and loving kindness meditation among nursing professionals working in a Brazilian hospital setting. Pilot study with a mixed model using quantitative and qualitative methods was used to evaluate a group of participants. The quantitative data were analyzed at three different time points: pre-intervention, post-intervention, and follow-up. The qualitative data were analyzed at post-intervention. Hospital São Paulo (Brazil). Sample 13 nursing professionals, including nurses, technicians, and nursing assistants working in a hospital. Participants underwent mindfulness and loving kindness meditation during a period of six weeks. Perceived Stress Scale (PSS), Maslach Burnout Inventory (MBI), Beck Depression Inventory (BDI), State-Trait Anxiety Inventory (STAI), Satisfaction With Life Scale (SWLS), Self-Compassion Scale (SCS), WHOQOL-BREF quality of life assessment, and Work Stress Scale (WSS). Qualitative data were collected via a group interview following six weeks participation in the SRP. The quantitative analyses revealed a significant reduction (P < .05) between pre-intervention and post-intervention scores for perceived stress, burnout, depression, and anxiety (trait). These variables showed no significant differences between post-intervention and follow-up scores. The WHOQOL-BREF revealed significant increase (P < .05) just in the physical and psychological domains at post-intervention scores, which remained at the follow-up. Qualitative results showed improvement in the reactivity to inner experience; a more attentive perception of internal and external experiences; greater attention and awareness of actions and attitudes at every moment; and a positive influence of the SRP in nursing activities. Copyright © 2016 Elsevier Inc. All rights reserved.

Cost and Efficacy Assessment of an Alternative Medication Compliance Urine Drug Testing Strategy.

PubMed

Doyle, Kelly; Strathmann, Frederick G

2017-02-01

This study investigates the frequency at which quantitative results provide additional clinical benefit compared to qualitative results alone. A comparison between alternative urine drug screens and conventional screens including the assessment of cost-to-payer differences, accuracy of prescription compliance or polypharmacy/substance abuse was also included. In a reference laboratory evaluation of urine specimens from across the United States, 213 urine specimens with provided prescription medication information (302 prescriptions) were analyzed by two testing algorithms: 1) conventional immunoassay screen with subsequent reflexive testing of positive results by quantitative mass spectrometry; and 2) a combined immunoassay/qualitative mass-spectrometry screen that substantially reduced the need for subsequent testing. The qualitative screen was superior to immunoassay with reflex to mass spectrometry in confirming compliance per prescription (226/302 vs 205/302), and identifying non-prescription abuse (97 vs 71). Pharmaceutical impurities and inconsistent drug metabolite patterns were detected in only 3.8% of specimens, suggesting that quantitative results have limited benefit. The percentage difference between the conventional testing algorithm and the alternative screen was projected to be 55%, and a 2-year evaluation of test utilization as a measure of test order volume follows an exponential trend for alternative screen test orders over conventional immunoassay screens that require subsequent confirmation testing. Alternative, qualitative urine drug screens provide a less expensive, faster, and more comprehensive evaluation of patient medication compliance and drug abuse. The vast majority of results were interpretable with qualitative results alone indicating a reduced need to automatically reflex to quantitation or provide quantitation for the majority of patients. This strategy highlights a successful approach using an alternative strategy for both the laboratory and physician to align clinical needs while being mindful of costs.

Efficacy and experiences of telephone counselling for informal carers of people with dementia.

PubMed

Lins, Sabine; Hayder-Beichel, Daniela; Rücker, Gerta; Motschall, Edith; Antes, Gerd; Meyer, Gabriele; Langer, Gero

2014-09-01

Informal carers of people with dementia can suffer from depressive symptoms, emotional distress and other physiological, social and financial consequences. This review focuses on three main objectives:To:1) produce a quantitative review of the efficacy of telephone counselling for informal carers of people with dementia;2) synthesize qualitative studies to explore carers' experiences of receiving telephone counselling and counsellors' experiences of conducting telephone counselling; and3) integrate 1) and 2) to identify aspects of the intervention that are valued and work well, and those interventional components that should be improved or redesigned. The Cochrane Dementia and Cognitive Improvement Group's Specialized Register, The Cochrane Library, MEDLINE, MEDLINE in Process, EMBASE, CINAHL, PSYNDEX, PsycINFO, Web of Science, DIMDI databases, Springer database, Science direct and trial registers were searched on 3 May 2011 and updated on 25 February 2013. A Forward Citation search was conducted for included studies in Web of Science and Google Scholar. We used the Related Articles service of PubMed for included studies, contacted experts and hand-searched abstracts of five congresses. Randomised controlled trials (RCTs) or cross-over trials that compared telephone counselling for informal carers of people with dementia against no treatment, usual care or friendly calls for chatting were included evaluation of efficacy. Qualitative studies with qualitative methods of data collection and analysis were also included to address experiences with telephone counselling. Two authors independently screened articles for inclusion criteria, extracted data and assessed the quantitative trials with the Cochrane 'Risk of bias' tool and the qualitative studies with the Critical Appraisal Skills Program (CASP) tool. The authors conducted meta-analyses, but reported some results in narrative form due to clinical heterogeneity. The authors synthesised the qualitative data and integrated quantitative RCT data with the qualitative data. Nine RCTs and two qualitative studies were included. Six studies investigated telephone counselling without additional intervention, one study combined telephone counselling with video sessions, and two studies combined it with video sessions and a workbook. All quantitative studies had a high risk of bias in terms of blinding of participants and outcome assessment. Most studies provided no information about random sequence generation and allocation concealment. The quality of the qualitative studies ('thin descriptions') was assessed as moderate. Meta-analyses indicated a reduction of depressive symptoms for telephone counselling without additional intervention (three trials, 163 participants: standardised mean different (SMD) 0.32, 95% confidence interval (CI) 0.01 to 0.63, P value 0.04; moderate quality evidence). The estimated effects on other outcomes (burden, distress, anxiety, quality of life, self-efficacy, satisfaction and social support) were uncertain and differences could not be excluded (burden: four trials, 165 participants: SMD 0.45, 95% CI -0.01 to 0.90, P value 0.05; moderate quality evidence; support: two trials, 67 participants: SMD 0.25, 95% CI -0.24 to 0.73, P value 0.32; low quality evidence). None of the quantitative studies included reported adverse effects or harm due to telephone counselling. Three analytical themes (barriers and facilitators for successful implementation of telephone counselling, counsellor's emotional attitude and content of telephone counselling) and 16 descriptive themes that present the carers' needs for telephone counselling were identified in the thematic synthesis. Integration of quantitative and qualitative data shows potential for improvement. For example, no RCT reported that the counsellor provided 24-hour availability or that there was debriefing of the counsellor. Also, the qualitative studies covered a limited range of ways of performing telephone counselling. There is evidence that telephone counselling can reduce depressive symptoms for carers of people with dementia and that telephone counselling meets important needs of the carer. This result needs to be confirmed in future studies that evaluate efficacy through robust RCTs and the experience aspect through qualitative studies with rich data.

Leachate generation from landfill in a semi-arid climate: A qualitative and quantitative study from Sousse, Tunisia.

PubMed

Frikha, Youssef; Fellner, Johann; Zairi, Moncef

2017-09-01

Despite initiatives for enhanced recycling and waste utilization, landfill still represents the dominant disposal path for municipal solid waste (MSW). The environmental impacts of landfills depend on several factors, including waste composition, technical barriers, landfill operation and climatic conditions. A profound evaluation of all factors and their impact is necessary in order to evaluate the environmental hazards emanating from landfills. The present paper investigates a sanitary landfill located in a semi-arid climate (Tunisia) and highlights major differences in quantitative and qualitative leachate characteristics compared to landfills situated in moderate climates. Besides the qualitative analysis of leachate samples, a quantitative analysis including the simulation of leachate generation (using the HELP model) has been conducted. The results of the analysis indicate a high load of salts (Cl, Na, inorganic nitrogen) in the leachate compared to other landfills. Furthermore the simulations with HELP model highlight that a major part of the leachate generated originates form the water content of waste.

Contrast medium usage reduction in abdominal computed tomography by using high-iodinated concentration contrast medium

NASA Astrophysics Data System (ADS)

Suwannasri, A.; Kaewlai, R.; Asavaphatiboon, S.

2016-03-01

This study was to determine if administration of a low volume high-concentration iodinated contrast medium can preserve image quality in comparison with regular-concentration intravenous contrast medium in patient undergoing contrast-enhancement abdominal computed tomography (CT). Eighty-four patients were randomly divided into 3 groups of similar iodine delivery rate; A: 1.2 cc/kg of iomeprol-400, B: 1.0 cc/kg of iomeprol-400 and C: 1.5 cc/kg of ioversol-350. Contrast enhancement of the liver parenchyma, pancreas and aorta was quantitatively measured in Hounsfield units and qualitative assessed by a radiologist. T-test was used to evaluate contrast enhancement, and Chi-square test was used to evaluate qualitative image assessment, at significance level of 0.05 with 95% confidence intervals. There were no statistically significant differences in contrast enhancement of liver parenchyma and pancreas between group A and group C in both quantitative and qualitative analyses. Group C showed superior vascular enhancement to group A and B on quantitative analysis.

[Instruments for evaluating oral health knowledge, attitudes and practice for parents /caregivers of small children].

PubMed

Martignon, Stefania; Bautista-Mendoza, Gloria; González-Carrera, María; Lafaurie-Villamil, Gloria; Morales, Veicy; Santamaría, Ruth

2008-01-01

Designing three instruments for evaluating oral health knowledge, attitudes and practice in parents/caregivers of low social-economic status 0-5 year-olds. Evaluating the instruments' reliability in terms of internal consistency and analysing items. Three instruments were constructed for evaluating low social-economic status 0-5 year-olds' parents/caregivers' oral health knowledge, attitudes and practice in the municipality of Usaquén , Bogotá , Colombia . 47 parents/caregivers were given a test establishing the instrument's reliability in terms of internal consistency and the adults' level of knowledge, attitudes and practice. A sub-sample was qualitatively analysed (content verification and understanding). Reliability was evaluated using Cronbach's alpha coefficient. Items were analysed for improving constructing and understanding the questions, taking four criteria into account: corrected homogeneity index (CHI), response trend, correlation between items and qualitative analysis. Cronbach's alpha coefficient for knowledge, attitudes and practice was 0,82, 0,80 and 0,62, respectively. Participants' level of knowledge, attitudes and practice was acceptable (60 %, 55 % and 91 %, respectively). This study found two out of the three evaluated instruments to be reliable (knowledge and attitudes); all three of them were then redesigned. The resulting instruments represent a valuable tool which can be used in future studies for describing and evaluating preventative programmes.

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program

ERIC Educational Resources Information Center

Davis, LaShara A.; Morgan, Susan E.; Mobley, Amy R.

2016-01-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported…

Procedure versus process: ethical paradigms and the conduct of qualitative research

PubMed Central

2012-01-01

Background Research is fundamental to improving the quality of health care. The need for regulation of research is clear. However, the bureaucratic complexity of research governance has raised concerns that the regulatory mechanisms intended to protect participants now threaten to undermine or stifle the research enterprise, especially as this relates to sensitive topics and hard to reach groups. Discussion Much criticism of research governance has focused on long delays in obtaining ethical approvals, restrictions imposed on study conduct, and the inappropriateness of evaluating qualitative studies within the methodological and risk assessment frameworks applied to biomedical and clinical research. Less attention has been given to the different epistemologies underlying biomedical and qualitative investigation. The bioethical framework underpinning current regulatory structures is fundamentally at odds with the practice of emergent, negotiated micro-ethics required in qualitative research. The complex and shifting nature of real world settings delivers unanticipated ethical issues and (occasionally) genuine dilemmas which go beyond easy or formulaic ‘procedural’ resolution. This is not to say that qualitative studies are ‘unethical’ but that their ethical nature can only be safeguarded through the practice of ‘micro-ethics’ based on the judgement and integrity of researchers in the field. Summary This paper considers the implications of contrasting ethical paradigms for the conduct of qualitative research and the value of ‘empirical ethics’ as a means of liberating qualitative (and other) research from an outmoded and unduly restrictive research governance framework based on abstract prinicipalism, divorced from real world contexts and values. PMID:23016663

Approaches to sampling and case selection in qualitative research: examples in the geography of health.

PubMed

Curtis, S; Gesler, W; Smith, G; Washburn, S

2000-04-01

This paper focuses on the question of sampling (or selection of cases) in qualitative research. Although the literature includes some very useful discussions of qualitative sampling strategies, the question of sampling often seems to receive less attention in methodological discussion than questions of how data is collected or is analysed. Decisions about sampling are likely to be important in many qualitative studies (although it may not be an issue in some research). There are varying accounts of the principles applicable to sampling or case selection. Those who espouse 'theoretical sampling', based on a 'grounded theory' approach, are in some ways opposed to those who promote forms of 'purposive sampling' suitable for research informed by an existing body of social theory. Diversity also results from the many different methods for drawing purposive samples which are applicable to qualitative research. We explore the value of a framework suggested by Miles and Huberman [Miles, M., Huberman,, A., 1994. Qualitative Data Analysis, Sage, London.], to evaluate the sampling strategies employed in three examples of research by the authors. Our examples comprise three studies which respectively involve selection of: 'healing places'; rural places which incorporated national anti-malarial policies; young male interviewees, identified as either chronically ill or disabled. The examples are used to show how in these three studies the (sometimes conflicting) requirements of the different criteria were resolved, as well as the potential and constraints placed on the research by the selection decisions which were made. We also consider how far the criteria Miles and Huberman suggest seem helpful for planning 'sample' selection in qualitative research.

The contribution of qualitative research in designing a complex intervention for secondary prevention of coronary heart disease in two different healthcare systems.

PubMed

Corrrigan, Mairead; Cupples, Margaret E; Smith, Susan M; Byrne, Molly; Leathem, Claire S; Clerkin, Pauline; Murphy, Andrew W

2006-07-18

Developing complex interventions for testing in randomised controlled trials is of increasing importance in healthcare planning. There is a need for careful design of interventions for secondary prevention of coronary heart disease (CHD). It has been suggested that integrating qualitative research in the development of a complex intervention may contribute to optimising its design but there is limited evidence of this in practice. This study aims to examine the contribution of qualitative research in developing a complex intervention to improve the provision and uptake of secondary prevention of CHD within primary care in two different healthcare systems. In four general practices, one rural and one urban, in Northern Ireland and the Republic of Ireland, patients with CHD were purposively selected. Four focus groups with patients (N = 23) and four with staff (N = 29) informed the development of the intervention by exploring how it could be tailored and integrated with current secondary prevention activities for CHD in the two healthcare settings. Following an exploratory trial the acceptability and feasibility of the intervention were discussed in four focus groups (17 patients) and 10 interviews (staff). The data were analysed using thematic analysis. Integrating qualitative research into the development of the intervention provided depth of information about the varying impact, between the two healthcare systems, of different funding and administrative arrangements, on their provision of secondary prevention and identified similar barriers of time constraints, training needs and poor patient motivation. The findings also highlighted the importance to patients of stress management, the need for which had been underestimated by the researchers. The qualitative evaluation provided depth of detail not found in evaluation questionnaires. It highlighted how the intervention needed to be more practical by minimising administration, integrating role plays into behaviour change training, providing more practical information about stress management and removing self-monitoring of lifestyle change. Qualitative research is integral to developing the design detail of a complex intervention and tailoring its components to address individuals' needs in different healthcare systems. The findings highlight how qualitative research may be a valuable component of the preparation for complex interventions and their evaluation.

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Generating One Biometric Feature from Another: Faces from Fingerprints

PubMed Central

Ozkaya, Necla; Sagiroglu, Seref

2010-01-01

This study presents a new approach based on artificial neural networks for generating one biometric feature (faces) from another (only fingerprints). An automatic and intelligent system was designed and developed to analyze the relationships among fingerprints and faces and also to model and to improve the existence of the relationships. The new proposed system is the first study that generates all parts of the face including eyebrows, eyes, nose, mouth, ears and face border from only fingerprints. It is also unique and different from similar studies recently presented in the literature with some superior features. The parameter settings of the system were achieved with the help of Taguchi experimental design technique. The performance and accuracy of the system have been evaluated with 10-fold cross validation technique using qualitative evaluation metrics in addition to the expanded quantitative evaluation metrics. Consequently, the results were presented on the basis of the combination of these objective and subjective metrics for illustrating the qualitative properties of the proposed methods as well as a quantitative evaluation of their performances. Experimental results have shown that one biometric feature can be determined from another. These results have once more indicated that there is a strong relationship between fingerprints and faces. PMID:22399877

Barriers and facilitators to physical activity in people with hip or knee osteoarthritis: protocol for a systematic review of qualitative evidence.

PubMed

Kanavaki, Archontissa M; Rushton, Alison; Klocke, Rainer; Abhishek, Abhishek; Duda, Joan L

2016-11-03

This protocol aims to describe the objective and methods to be followed in a systematic review of qualitative studies on barriers and facilitators to physical activity (PA) in people with hip or knee osteoarthritis (OA). MEDLINE, EMBASE, PhychINFO, Web of Science, CINAHL, SPORTDiscus, Scopus and grey literature sources will be electronically searched. Hand search of qualitative research-centred journals, reference screening of relevant reviews and inquiries to researchers active in the field will complement the search. Studies will be selected if they apply qualitative or mixed-methods designs to directly explore factors that correspond to engagement in PA/exercise or, the perceptions regarding PA/exercise in people with hip or knee OA. The Critical Appraisal Skills Programme Qualitative Checklist and the evaluative criteria of credibility, transferability, dependability and confirmability will be applied for the study appraisal. 2 independent reviewers will perform the search, study selection and study appraisal. Thematic synthesis will be used for synthesising the findings of the primary studies and the process and product of the synthesis will be checked by a second researcher. ConQual approach will be used for assessing the confidence in the qualitative findings. This systematic review will inform our understanding of the PA determinants and how to optimise behaviour change in people living with hip or knee OA. The review findings will be reported in a peer-reviewed journal and presented at national or international conferences. The study raises no ethical issues. CRD42016030024. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Literacy, Language and Social Interaction in Special Schools

ERIC Educational Resources Information Center

Reichenberg, Monica

2015-01-01

The present study is a follow up study to a quantitative intervention study where two intervention programs, Reciprocal Teaching and Inference Training, were practiced. This study aims at capturing the potentials benefits and qualitative aspects of one of the programs evaluated, Reciprocal Teaching. More specifically, I have investigated the video…

Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 7: understanding the potential impacts of dissemination bias.

PubMed

Booth, Andrew; Lewin, Simon; Glenton, Claire; Munthe-Kaas, Heather; Toews, Ingrid; Noyes, Jane; Rashidian, Arash; Berg, Rigmor C; Nyakang'o, Brenda; Meerpohl, Joerg J

2018-01-25

The GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) coherence, (3) adequacy of data and (4) relevance. This paper is part of a series providing guidance on how to apply CERQual and focuses on a probable fifth component, dissemination bias. Given its exploratory nature, we are not yet able to provide guidance on applying this potential component of the CERQual approach. Instead, we focus on how dissemination bias might be conceptualised in the context of qualitative research and the potential impact dissemination bias might have on an overall assessment of confidence in a review finding. We also set out a proposed research agenda in this area. We developed this paper by gathering feedback from relevant research communities, searching MEDLINE and Web of Science to identify and characterise the existing literature discussing or assessing dissemination bias in qualitative research and its wider implications, developing consensus through project group meetings, and conducting an online survey of the extent, awareness and perceptions of dissemination bias in qualitative research. We have defined dissemination bias in qualitative research as a systematic distortion of the phenomenon of interest due to selective dissemination of studies or individual study findings. Dissemination bias is important for qualitative evidence syntheses as the selective dissemination of qualitative studies and/or study findings may distort our understanding of the phenomena that these syntheses aim to explore and thereby undermine our confidence in these findings. Dissemination bias has been extensively examined in the context of randomised controlled trials and systematic reviews of such studies. The effects of potential dissemination bias are formally considered, as publication bias, within the GRADE approach. However, the issue has received almost no attention in the context of qualitative research. Because of very limited understanding of dissemination bias and its potential impact on review findings in the context of qualitative evidence syntheses, this component is currently not included in the GRADE-CERQual approach. Further research is needed to establish the extent and impacts of dissemination bias in qualitative research and the extent to which dissemination bias needs to be taken into account when we assess how much confidence we have in findings from qualitative evidence syntheses.

A Phase 2 Study of 16α-[18F]-fluoro-17β-estradiol Positron Emission Tomography (FES-PET) as a Marker of Hormone Sensitivity in Metastatic Breast Cancer (MBC)

PubMed Central

Peterson, Lanell M.; Kurland, Brenda F.; Schubert, Erin K.; Link, Jeanne M.; Gadi, V.K.; Specht, Jennifer M.; Eary, Janet F.; Porter, Peggy; Shankar, Lalitha K.; Mankoff, David A.; Linden, Hannah M.

2014-01-01

Purpose 16α-[18F]-fluoro-17β-estradiol positron emission tomography (FES-PET) quantifies estrogen receptor (ER) expression in tumors and may provide diagnostic benefit. Procedures Women with newly diagnosed metastatic breast cancer (MBC) from an ER-positive primary tumor were imaged before starting endocrine therapy. FES uptake was evaluated qualitatively and quantitatively, and associated with response and with ER expression. Results Nineteen patients underwent FES imaging. Fifteen had a biopsy of a metastasis and 15 were evaluable for response. Five patients had quantitatively low FES uptake, six had at least one site of qualitatively FES-negative disease. All patients with an ER-negative biopsy had both low uptake and at least one site of FES-negative disease. Of response-evaluable patients, 2/2 with low FES standard uptake value tumors had progressive disease within 6 months, as did 2/3 with qualitatively FES-negative tumors. Conclusions Low/absent FES uptake correlates with lack of ER expression. FES-positron emission tomography can help identify patients with endocrine resistant disease and safely measures ER in MBC. PMID:24170452

What does patient feedback reveal about the NHS? A mixed methods study of comments posted to the NHS Choices online service

PubMed Central

Brookes, Gavin; Baker, Paul

2017-01-01

Objective To examine the key themes of positive and negative feedback in patients’ online feedback on NHS (National Health Service) services in England and to understand the specific issues within these themes and how they drive positive and negative evaluation. Design Computer-assisted quantitative and qualitative studies of 228 113 comments (28 971 142 words) of online feedback posted to the NHS Choices website. Comments containing the most frequent positive and negative evaluative words are qualitatively examined to determine the key drivers of positive and negative feedback. Participants Contributors posting comments about the NHS between March 2013 and September 2015. Results Overall, NHS services were evaluated positively approximately three times more often than negatively. The four key areas of focus were: treatment, communication, interpersonal skills and system/organisation. Treatment exhibited the highest proportion of positive evaluative comments (87%), followed by communication (77%), interpersonal skills (44%) and, finally, system/organisation (41%). Qualitative analysis revealed that reference to staff interpersonal skills featured prominently, even in comments relating to treatment and system/organisational issues. Positive feedback was elicited in cases of staff being caring, compassionate and knowing patients’’ names, while rudeness, apathy and not listening were frequent drivers of negative feedback. Conclusions Although technical competence constitutes an undoubtedly fundamental aspect of healthcare provision, staff members were much more likely to be evaluated both positively and negatively according to their interpersonal skills. Therefore, the findings reported in this study highlight the salience of such ‘soft’ skills to patients and emphasise the need for these to be focused upon and developed in staff training programmes, as well as ensuring that decisions around NHS funding do not result in demotivated and rushed staff. The findings also reveal a significant overlap between the four key themes in the ways that care is evaluated by patients. PMID:28450463

A national evaluation of a dissemination and implementation initiative to enhance primary care practice capacity and improve cardiovascular disease care: the ESCALATES study protocol.

PubMed

Cohen, Deborah J; Balasubramanian, Bijal A; Gordon, Leah; Marino, Miguel; Ono, Sarah; Solberg, Leif I; Crabtree, Benjamin F; Stange, Kurt C; Davis, Melinda; Miller, William L; Damschroder, Laura J; McConnell, K John; Creswell, John

2016-06-29

The Agency for Healthcare Research and Quality (AHRQ) launched the EvidenceNOW Initiative to rapidly disseminate and implement evidence-based cardiovascular disease (CVD) preventive care in smaller primary care practices. AHRQ funded eight grantees (seven regional Cooperatives and one independent national evaluation) to participate in EvidenceNOW. The national evaluation examines quality improvement efforts and outcomes for more than 1500 small primary care practices (restricted to those with fewer than ten physicians per clinic). Examples of external support include practice facilitation, expert consultation, performance feedback, and educational materials and activities. This paper describes the study protocol for the EvidenceNOW national evaluation, which is called Evaluating System Change to Advance Learning and Take Evidence to Scale (ESCALATES). This prospective observational study will examine the portfolio of EvidenceNOW Cooperatives using both qualitative and quantitative data. Qualitative data include: online implementation diaries, observation and interviews at Cooperatives and practices, and systematic assessment of context from the perspective of Cooperative team members. Quantitative data include: practice-level performance on clinical quality measures (aspirin prescribing, blood pressure and cholesterol control, and smoking cessation; ABCS) collected by Cooperatives from electronic health records (EHRs); practice and practice member surveys to assess practice capacity and other organizational and structural characteristics; and systematic tracking of intervention delivery. Quantitative, qualitative, and mixed methods analyses will be conducted to examine how Cooperatives organize to provide external support to practices, to compare effectiveness of the dissemination and implementation approaches they implement, and to examine how regional variations and other organization and contextual factors influence implementation and effectiveness. ESCALATES is a national evaluation of an ambitious large-scale dissemination and implementation effort focused on transforming smaller primary care practices. Insights will help to inform the design of national health care practice extension systems aimed at supporting practice transformation efforts in the USA. NCT02560428 (09/21/15).

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

Multidisciplinary Difficult Airway Course: An Essential Educational Component of a Hospital-Wide Difficult Airway Response Program.

PubMed

Leeper, W Robert; Haut, Elliott R; Pandian, Vinciya; Nakka, Sajan; Dodd-O, Jeffrey; Bhatti, Nasir; Hunt, Elizabeth A; Saheed, Mustapha; Dalesio, Nicholas; Schiavi, Adam; Miller, Christina; Kirsch, Thomas D; Berkow, Lauren

2018-04-05

A hospital-wide difficult airway response team was developed in 2008 at The Johns Hopkins Hospital with three central pillars: operations, safety monitoring, and education. The objective of this study was to assess the outcomes of the educational pillar of the difficult airway response team program, known as the multidisciplinary difficult airway course (MDAC). The comprehensive, full-day MDAC involves trainees and staff from all provider groups who participate in airway management. The MDAC occurs within the Johns Hopkins Medicine Simulation Center approximately four times per year and uses a combination of didactic lectures, hands-on sessions, and high-fidelity simulation training. Participation in MDAC is the main intervention being investigated in this study. Data were collected prospectively using course evaluation survey with quantitative and qualitative components, and prepost course knowledge assessment multiple choice questions (MCQ). Outcomes include course evaluation scores and themes derived from qualitative assessments, and prepost course knowledge assessment MCQ scores. Tertiary care academic hospital center PARTICIPANTS: Students, residents, fellows, and practicing physicians from the departments of Surgery, Otolaryngology Head and Neck Surgery, Anesthesiology/Critical Care Medicine, and Emergency Medicine; advanced practice providers (nurse practitioners and physician assistants), nurse anesthetists, nurses, and respiratory therapists. Totally, 23 MDACs have been conducted, including 499 participants. Course evaluations were uniformly positive with mean score of 86.9 of 95 points. Qualitative responses suggest major value from high-fidelity simulation, the hands-on skill stations, and teamwork practice. MCQ scores demonstrated significant improvement: median (interquartile range) pre: 69% (60%-81%) vs post: 81% (72%-89%), p < 0.001. Implementation of a MDAC successfully disseminated principles and protocols to all airway providers. Demonstrable improvement in prepost course knowledge assessment and overwhelmingly positive course evaluations (quantitative and qualitative) suggest a critical and ongoing role for the MDAC course. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Young adult conservation jobs and worker health

Treesearch

Kathleen L. Wolf; Elizabeth Housley

2017-01-01

Decades of research studies demonstrate links between healthy environment, healthy lifestyles, and healthy people. This study evaluated the correlations between young adult conservation workers’ perceived stress, personal effectiveness, and nature experience using quantitative and qualitative social science methods. The study cohort numbered nearly 300 individuals...

A grounded theory of positive youth development through sport based on results from a qualitative meta-study

PubMed Central

Holt, Nicholas L.; Neely, Kacey C.; Slater, Linda G.; Camiré, Martin; Côté, Jean; Fraser-Thomas, Jessica; MacDonald, Dany; Strachan, Leisha; Tamminen, Katherine A.

2017-01-01

ABSTRACT The overall purpose of this study was to create a model of positive youth development (PYD) through sport grounded in the extant qualitative literature. More specifically, the first objective was to review and evaluate qualitative studies of PYD in sport. The second objective was to analyze and synthesize findings from these studies. Following record identification and screening, 63 articles were retained for analysis. Meta-method analysis revealed strengths of studies were the use of multiple data collection and validity techniques, which produced high-quality data. Weaknesses were limited use of ‘named’ methodologies and inadequate reporting of sampling procedures. Philosophical perspectives were rarely reported, and theory was used sparingly. Results of an inductive meta-data analysis produced three categories: PYD climate (adult relationships, peer relationships, and parental involvement), life skills program focus (life skill building activities and transfer activities), and PYD outcomes (in personal, social, and physical domains). A model that distinguishes between implicit and explicit processes to PYD is presented. PMID:27695511

Measuring Core/Facesheet Bond Toughness in Honeycomb Sandwich Structures

NASA Technical Reports Server (NTRS)

Nettles, A. T.

2006-01-01

This study examines two test methods to evaluate the peel toughness of the skin to core debond of sandwich panels. The methods tested were the climbing drum (CD) peel test and the double cantilever beam (DCB) test. While the CD peel test is only intended for qualitative measurements, it is shown in this study that qualitative measurements can be performed and compare well with DCB test data. It is also shown that artificially stiffening the facesheets of a DCB specimen can cause the test to behave more like a flatwise tensile test than a peel test.

Models of care for musculoskeletal health: a cross-sectional qualitative study of Australian stakeholders' perspectives on relevance and standardised evaluation.

PubMed

Briggs, Andrew M; Jordan, Joanne E; Speerin, Robyn; Jennings, Matthew; Bragge, Peter; Chua, Jason; Slater, Helen

2015-11-16

The prevalence and impact of musculoskeletal conditions are predicted to rapidly escalate in the coming decades. Effective strategies are required to minimise 'evidence-practice', 'burden-policy' and 'burden-service' gaps and optimise health system responsiveness for sustainable, best-practice healthcare. One mechanism by which evidence can be translated into practice and policy is through Models of Care (MoCs), which provide a blueprint for health services planning and delivery. While evidence supports the effectiveness of musculoskeletal MoCs for improving health outcomes and system efficiencies, no standardised national approach to evaluation in terms of their 'readiness' for implementation and 'success' after implementation, is yet available. Further, the value assigned to MoCs by end users is uncertain. This qualitative study aimed to explore end users' views on the relevance of musculoskeletal MoCs to their work and value of a standardised evaluation approach. A cross-sectional qualitative study was undertaken. Subject matter experts (SMEs) with health, policy and administration and consumer backgrounds were drawn from three Australian states. A semi-structured interview schedule was developed and piloted to explore perceptions about musculoskeletal MoCs including: i) aspects important to their work (or life, for consumers) ii) usefulness of standardised evaluation frameworks to judge 'readiness' and 'success' and iii) challenges associated with standardised evaluation. Verbatim transcripts were analysed by two researchers using a grounded theory approach to derive key themes. Twenty-seven SMEs (n = 19; 70.4 % female) including five (18.5 %) consumers participated in the study. MoCs were perceived as critical for influencing and initiating changes to best-practice healthcare planning and delivery and providing practical guidance on how to implement and evaluate services. A 'readiness' evaluation framework assessing whether critical components across the health system had been considered prior to implementation was strongly supported, while 'success' was perceived as an already familiar evaluation concept. Perceived challenges associated with standardised evaluation included identifying, defining and measuring key 'readiness' and 'success' indicators; impacts of systems and context changes; cost; meaningful stakeholder consultation and developing a widely applicable framework. A standardised evaluation framework that includes a strong focus on 'readiness' is important to ensure successful and sustainable implementation of musculoskeletal MoCs.

A comparative study of a happiness intervention in medical-surgical nurses.

PubMed

Appel, Linda; Labhart, Lana; Balczo, Pam; McCleary, Nancy; Raley, Mary; Winsett, Rebecca P

2013-01-01

An intervention study evaluating the impact of journaling on nurse happiness was conducted with 91 medical-surgical nurses. No differences in general happiness, percentage of time happy, and gratitude were detected among groups although journaling was qualitatively described as meaningful.

A QUALITATIVE RETROSPECTIVE ANALYSIS OF POSITIVE CONTROL DATA IN DEVELOPMENTAL NEUROTOXICITY STUDIES.

EPA Science Inventory

A manuscript reviews positive control data submitted by registrants in support of Developmental Neurotoxicity (DNT) guideline studies. Adequate positive control data are needed to evaluate laboratory proficiency in detecting changes in the structure and function of the developin...

Anthropology and School Reform: To Catalog or Critique?

ERIC Educational Resources Information Center

Hess, G. Alfred, Jr.

1992-01-01

Discusses anthropology's role in policy-relevant educational research, drawing on experiences in evaluating Chicago (Illinois) city schools' restructuring. Questions raised by case studies in school restructuring include qualitative researchers' role in studying educational policy, issues of objectivity in policy research, and networking…

A Framework for Integrating Qualitative and Quantitative Data in Knowledge, Attitude, and Practice Studies: A Case Study of Pesticide Usage in Eastern Uganda

PubMed Central

Muleme, James; Kankya, Clovice; Ssempebwa, John C.; Mazeri, Stella; Muwonge, Adrian

2017-01-01

Knowledge, attitude, and practice (KAP) studies guide the implementation of public health interventions (PHIs), and they are important tools for political persuasion. The design and implementation of PHIs assumes a linear KAP relationship, i.e., an awareness campaign results in the desirable societal behavioral change. However, there is no robust framework for testing this relationship before and after PHIs. Here, we use qualitative and quantitative data on pesticide usage to test this linear relationship, identify associated context specific factors as well as assemble a framework that could be used to guide and evaluate PHIs. We used data from a cross-sectional mixed methods study on pesticide usage. Quantitative data were collected using a structured questionnaire from 167 households representing 1,002 individuals. Qualitative data were collected from key informants and focus group discussions. Quantitative and qualitative data analysis was done in R 3.2.0 as well as qualitative thematic analysis, respectively. Our framework shows that a KAP linear relationship only existed for households with a low knowledge score, suggesting that an awareness campaign would only be effective for ~37% of the households. Context specific socioeconomic factors explain why this relationship does not hold for households with high knowledge scores. These findings are essential for developing targeted cost-effective and sustainable interventions on pesticide usage and other PHIs with context specific modifications. PMID:29276703

A Framework for Integrating Qualitative and Quantitative Data in Knowledge, Attitude, and Practice Studies: A Case Study of Pesticide Usage in Eastern Uganda.

PubMed

Muleme, James; Kankya, Clovice; Ssempebwa, John C; Mazeri, Stella; Muwonge, Adrian

2017-01-01

Knowledge, attitude, and practice (KAP) studies guide the implementation of public health interventions (PHIs), and they are important tools for political persuasion. The design and implementation of PHIs assumes a linear KAP relationship, i.e., an awareness campaign results in the desirable societal behavioral change. However, there is no robust framework for testing this relationship before and after PHIs. Here, we use qualitative and quantitative data on pesticide usage to test this linear relationship, identify associated context specific factors as well as assemble a framework that could be used to guide and evaluate PHIs. We used data from a cross-sectional mixed methods study on pesticide usage. Quantitative data were collected using a structured questionnaire from 167 households representing 1,002 individuals. Qualitative data were collected from key informants and focus group discussions. Quantitative and qualitative data analysis was done in R 3.2.0 as well as qualitative thematic analysis, respectively. Our framework shows that a KAP linear relationship only existed for households with a low knowledge score, suggesting that an awareness campaign would only be effective for ~37% of the households. Context specific socioeconomic factors explain why this relationship does not hold for households with high knowledge scores. These findings are essential for developing targeted cost-effective and sustainable interventions on pesticide usage and other PHIs with context specific modifications.

Evaluation of bone marrow aspirates in patients with acute myeloid leukemia at day 14 of induction therapy.

PubMed

Souto Filho, João Tadeu D; Loureiro, Monique M; Pulcheri, Wolmar; Morais, José Carlos; Nucci, Marcio; Portugal, Rodrigo D

2015-07-25

Early assessment of response to chemotherapy in acute myeloid leukemia may be performed by examining bone marrow aspirate (BMA) or biopsy (BMB); a hypocellular bone marrow sample indicates adequate anti-leukemic activity. We sought to evaluate the quantitative and qualitative assessment of BMA performed on day 14 (D14) of chemotherapy, to verify the inter-observer agreement, to compare the results of BMA and BMB, and to evaluate the impact of D14 blast clearance on the overall survival (OS). A total of 107 patients who received standard induction chemotherapy and had bone marrow samples were included. BMA evaluation was performed by two observers using two methods: quantitative assessment and a qualitative (Likert) scale. ROC curves were obtained correlating the BMA quantification of blasts and the qualitative scale, by both observers, with BMB result as gold-standard. There was a significant agreement between the two observers in both the qualitative and quantitative assessments (Kw = 0.737, p < 0.001, and rs = 0.798, p < 0.001; ICC = 0.836, p < 0.001, respectively). The areas under the curve (AUC) were 0.924 and 0.946 for observer 1 and 0.867 and 0.870 for observer 2 for assessments of the percentage of blasts and qualitative scale, respectively. The best cutoff for blast percentage in BMA was 6% and 7% for observers 1 and 2, respectively. A similar analysis for the qualitative scale showed the best cutoff as "probably infiltrated". Patients who attained higher grades of cytoreduction on D14 had better OS. Evaluation of D14 BMA using both methods had a significant agreement with BMB and between observers, identifying a population of patients with poor outcome.

Intelligence Analysts at State and Major Urban Area Fusion Centers: An Evaluation of Education and Training Requirements

DTIC Science & Technology

2011-06-10

Sharan Merriam, there are six standard approaches to qualitative research : phenomenology , grounded theory , ethnography , narrative analysis, critical...69Merriam, Qualitative Research , 21-22. 70Grounded Theory Institute, ―What is Grounded Theory ,‖ http...as to the available methods of research , qualitative and quantitative, and why the qualitative methodology was selected. It also provided the reader

FBI fingerprint identification automation study: AIDS 3 evaluation report. Volume 5: Current system evaluation

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The performance, costs, organization and other characteristics of both the manual system and AIDS 2 were used to establish a baseline case. The results of the evaluation are to be used to determine the feasibility of the AIDS 3 System, as well as provide a basis for ranking alternative systems during the second phase of the JPL study. The results of the study were tabulated by subject, scope and methods, providing a descriptive, quantitative and qualitative analysis of the current operating systems employed by the FBI Identification Division.

Clinical orientation program for new medical registrars--a qualitative evaluation.

PubMed

Rosemergy, Ian; Bell, Damon A; Jayathissa, Sisira K

2009-02-01

We present a qualitative evaluation of a clinical orientation program for medical registrars within the Wellington region in New Zealand, designed and implemented by current advanced registrars. This program was intended to improve the transition from house officer to medical registrar. The program was qualitatively evaluated using focus groups comprising participants, presenters and senior nursing staff. Purposive samples were drawn from each of these groups. The most significant finding was the perception of enhanced professional collegiality among medical staff. There were benefits to participants and presenters with improved communication between medical registrars. We believe there are individual, institutional and patient care benefits with a region-specific, clinical orientation for new medical registrars.

Ayurvedic versus conventional dietary and lifestyle counseling for mothers with burnout-syndrome: A randomized controlled pilot study including a qualitative evaluation.

PubMed

Kessler, Christian S; Eisenmann, Clemens; Oberzaucher, Frank; Forster, Martin; Steckhan, Nico; Meier, Larissa; Stapelfeldt, Elmar; Michalsen, Andreas; Jeitler, Michael

2017-10-01

Ayurveda claims to be effective in the treatment of psychosomatic disorders by means of lifestyle and nutritional counseling. In a randomized controlled study mothers with burnout were randomized into two groups: Ayurvedic nutritional counseling (according to tradition), and conventional nutritional counseling (following the recommendations of a family doctor). Patients received five counseling sessions over twelve weeks. Outcomes included levels of burnout, quality of life, sleep, stress, depression/anxiety, and spirituality at three and six months. It also included a qualitative evaluation of the communication processes. We randomized thirty four patients; twenty three participants were included in the per protocol analysis. No significant differences were observed between the groups. However, significant and clinically relevant intra-group mean changes for the primary outcome burnout, and secondary outcomes sleep, stress, depression and mental health were only found in the Ayurveda group. The qualitative part of the study identified different conversational styles and counseling techniques between the two study groups. In conventional consultations questions tended to be category bound, while counseling-advice was predominantly admonitory. The Ayurvedic practitioner used open-ended interrogative forms, devices for displaying understanding, and positive re-evaluation more frequently, leading to an overall less asymmetrical interaction. We found positive effects for both groups, which however were more pronounced in the Ayurvedic group. The conversational and counseling techniques in the Ayurvedic group offered more opportunities for problem description by patients as well as patient-centered practice and resource-oriented recommendations by the physician. NCT01797887. Copyright © 2017 Elsevier Ltd. All rights reserved.

Service impact of a national clinical leadership development programme: findings from a qualitative study.

PubMed

Fealy, Gerard M; McNamara, Martin S; Casey, Mary; O'Connor, Tom; Patton, Declan; Doyle, Louise; Quinlan, Christina

2015-04-01

The study reported here was part of a larger study, which evaluated a national clinical leadership development programme with reference to resources, participant experiences, participant outcomes and service impact. The aim of the present study was to evaluate the programme's service impact. Clinical leadership development develops competencies that are expressed in context. The outcomes of clinical leadership development occur at individual, departmental and organisational levels. The methods used to evaluate the service impact were focus groups, group interviews and individual interviews. Seventy participants provided data in 18 separate qualitative data collection events. The data contained numerous accounts of service development activities, initiated by programme participants, which improved service and/or improved the culture of the work setting. Clinical leadership development programmes that incorporate a deliberate service impact element can result in identifiable positive service outcomes. The nuanced relationship between leader development and service development warrants further investigation. This study demonstrates that clinical leadership development can impact on service in distinct and identifiable ways. Clinical leadership development programmes should focus on the setting in which the leadership competencies will be demonstrated. © 2013 John Wiley & Sons Ltd.

Defining Leadership: Collegiate Women's Learning Circles: A Qualitative Approach

ERIC Educational Resources Information Center

Preston-Cunningham, Tammie; Elbert, Chanda D.; Dooley, Kim E.

2017-01-01

The researchers employed qualitative methods to evaluate first-year female students' definition of "leadership" through involvement in the Women's Learning Circle. The findings revealed that students defined leadership in two dimensions: traits and behaviors. The qualitative findings explore a multidimensional approach to the voices of…

[Qualitative evaluation of blood products records in a hospital].

PubMed

Lartigue, B; Catillon, E

2012-02-01

This study aimed at evaluating the qualitative performance of blood products traceability from paper and electronic medical records in a hospital. Quality of date/time documentation was assessed by detection, for 20minutes or more, of chronological errors and inter-source inconsistencies, in a random sample of 168 blood products transfused during 2009. A receipt date/time was confirmed in 52% of paper records; a data entry error was attested in 25% of paper records, and 21% of electronic records. A transfusion date/time was notified in 93% of paper records, with a data entry error in 26% of paper records and 25% of electronic records. The patient medical record held at least one date/time error in 18% and 17%, for receipt and transfusion respectively. Environmental factors (clinical setting, urgency, blood product category) did not contributed to data error rates. Although blood products traceability has good quantitative results, the recorded documentation is not qualitative. In our study, data entry errors are similar in electronic or paper records, but the global failure rate is lesser in electronic records because omissions are controlled. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

Qualitative and quantitative aspects of pain in lateral posterior thoracotomy patients.

PubMed

Xavier, Thaiza Teixeira; Torres, Gilson de Vasconcelos; da Rocha, Vera Maria

2006-01-01

Descriptive study that proposed to compare the qualitative and quantitative behavior of the pain in lateral posterior thoracotomy patients. The sample was consisted of 18 individuals with an average age of 44 years. The instruments used were physiotherapy evaluation form, numerical pain scale and McGill questionnaire for pain. The pain on the numerical pain scale was considered moderate(5) for both sexes. The descriptors of the McGill questionnaire choosen by the patients with higher frequency were: in the sensorial component, beat4, pointed1, shock2, final and pull2; in the afetive component, tired1, bored1, punishald1 and miserable1 and in the evaluative component was flat. The characteristics of pain in the sensorial group were more evidents on male group. No significant statistical difeferences were observed between quantitative answers concerning pain between the men and women. On the qualitative aspects , was observed an predominancy of the same descriptors of pain in afetive component for both sexes. Pain intensity was categorized as moderate. No significant statistical difference were observed between the pain on the post-operatory lateral posterior thoracotomy. These data demonstrate a necessity for an analysis with a larger study group.

The role of service-learning in college students' environmental literacy: Content knowledge, attitudes, and behaviors

NASA Astrophysics Data System (ADS)

Singletary, Joanna Lynn Bush

This study evaluated the relationship of environmental service-learning on environmental literacy in undergraduates. The subjects were 36 undergraduates at a small liberal arts university enrolled in an environmental biology course. To determine the role of environmental service-learning on college students' environmental knowledge, attitudes, behaviors, and environmental literacy, this study utilized concurrent mixed methods approach for qualitative and quantitative analysis. A quasi-experimental repeated measures approach was the design of the quantitative component of the study. Data were collected on attitude, behavior, and content knowledge aspects of environmental literacy as measured by the Environmental Literacy Survey (Kibert, 2000). Hypotheses were tested by independent samples ttests and repeated measures ANOVA. Repeated measures ANOVA conducted on participants' three subscales scores for the Environmental Literacy Survey (attitude, behavior, and knowledge) indicated that students who participated in environmental service-learning scored statistically significantly higher than those that did not initially participate in service-learning. Qualitative data collected in the form of journal reflections and portfolios were evaluated for themes of environmental attitudes or affective statements, environmentally positive behaviors and skills, and ecological content. Quantitative and qualitative data support the positive role of environmental service-learning in the development of environmental literacy in undergraduate students.

Evaluating the patient experience after implantation of a 0.4 mg sustained release dexamethasone intracanalicular insert (Dextenza™): results of a qualitative survey

PubMed Central

Gira, Joseph P; Sampson, Reginald; Silverstein, Steven M; Walters, Thomas R; Metzinger, Jamie Lynne; Talamo, Jonathan H

2017-01-01

Purpose The purpose of this study is to evaluate the patient experience of sustained release dexamethasone intracanalicular insert (Dextenza™) following cataract surgery as part of a Phase III clinical trial program. Methods This cross-sectional, qualitative evaluation involved individual interviews lasting approximately 45 minutes. Patients from four US investigational study sites who had previously received an insert were enrolled. There were no predesignated end points; this was a qualitative survey seeking a deeper understanding of patient experience. Results Twenty-five patients were interviewed. Most patients (92%) reported the highest level of satisfaction grade with regard to overall product satisfaction. All patients described the insert as comfortable. Most patients (96%) described their overall experience with the insert as very convenient or extremely convenient. Twenty-two of 23 (96%) participants rated their experience with the insert as “very” or “extremely convenient”, compared to previous topical therapy, and 88% of patients stated that if they were to undergo cataract surgery again, they would request the insert. When asked if they would recommend the insert to family members or friends, 92% stated they would. The survey found that 84% of participants would be willing to pay more for the insert than for eye drop therapy. Conclusion The dexamethasone insert was found by patients to be highly favorable with regard to overall satisfaction, convenience, and comfort. The insert was well received and largely preferred over topical therapy alternatives following surgery. More extensive evaluation of the patient experience is warranted, and future studies should help inform design of the next generation of sustained release drug delivery systems. PMID:28331295

[Implementation of the new clinical practice training model in Andalusia: a qualitative evaluation of the Nursing and Physiotherapy degrees].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Márquez-Membrive, Josefa; Aguilera-Manrique, Gabriel; Castro-Sánchez, Adelaida M

2014-01-01

The design of new Bachelor degree courses, together with the agreement reached between the Regional Government of Andalusia and Andalusian universities shape the new clinical training model for Health Science students. The aim of this project is to present a qualitative evaluation of the implementation of the new model in Nursing and Physiotherapy degrees at the University of Almeria and the Andalusian Public Health System. An exploratory qualitative study using document content analysis techniques, by analyzing 12 reports from teachers and those responsible for Practicum in Nursing and Physiotherapy degrees at the University of Almeria. The reports included opinions and proposals from university and clinical placement teachers, healthcare professionals or clinical placement tutors, students, and those in positions of responsibility as regards clinical placements. Three categories emerged in the data analysis: Health system organization, with sub-categories of disparity between shifts, difficulties with supervisor coordination, feelings of a lack of control, disparities in evaluation criteria and geographic distribution; academic organization, with sub-categories of short rotations, a lack of information received by the clinical placement tutor, and carrying out placements without studying the theory; and management of the work agreement, with sub-categories of being discouraged by what is received in return, extra work for those in charge, and delays in evaluations. The study suggests a need to support and guide clinical tutors, to increase coordination between the university and health services, to organize the students' theoretical and practical training and to provide the management of the model with flexibility and transparency. Copyright © 2013 Elsevier España, S.L. All rights reserved.

Evaluating the Quality of Education at Dentistry School of Tehran University of Medical Sciences

PubMed Central

Farzianpour, Fereshteh; Monzavi, Abbas; Yassini, Esmaeil

2011-01-01

Background: Educational evaluation is a process which deals with data collection and assessment of academic activities’ progress. In this research, educational evaluation of Dentistry School of Tehran University of Medical Sciences, which trains students in undergraduate and residency courses, was studied. Methods: This descriptive study was done with a model of educational evaluation in ten steps and 13 fields including purposes and mission objectives, management and organization, academic board members, students, human resources and support, educational, research, health and treatment spaces, educational, diagnostic, research and laboratory tools, educational, research, health and treatment programs and courses, process of teaching and learning, evaluation and assessment, alumni, and patients satisfaction. Data were collected using observation, interviews, questionnaires, and checklists. Results: Results of the study were mainly qualitative and in some cases quantitative, based on defined optimal situation. The total mean of qualitative results of educational evaluation of dentistry school in all 13 fields was 55.98% which is relatively desirable. In the case of quantitative ones, results of some fields such as treatment quality of patients and education and learning of the students were relatively desirable (61.32% and 60.16% respectively). Conclusion: According to the results, educational goals and missions, educational and research facilities and spaces which were identified as the weakest areas need to be considered and paid more serious attention. PMID:22013466

Dyadic Interviews as a Tool for Qualitative Evaluation

ERIC Educational Resources Information Center

Morgan, David L.; Eliot, Susan; Lowe, Robert A.; Gorman, Paul

2016-01-01

Although evaluation researchers frequently make use of focus groups and individual interviews as sources of qualitative data, there has been far less attention to dyadic interviews that create a conversation between two research participants. This article describes dyadic interviews as a format that shares many of the advantages of focus groups,…

Using Computational Text Classification for Qualitative Research and Evaluation in Extension

ERIC Educational Resources Information Center

Smith, Justin G.; Tissing, Reid

2018-01-01

This article introduces a process for computational text classification that can be used in a variety of qualitative research and evaluation settings. The process leverages supervised machine learning based on an implementation of a multinomial Bayesian classifier. Applied to a community of inquiry framework, the algorithm was used to identify…

Using Radar Charts with Qualitative Evaluation: Techniques to Assess Change in Blended Learning

ERIC Educational Resources Information Center

Kaczynski, Dan; Wood, Leigh; Harding, Ansie

2008-01-01

When university academics implement changes in learning, such as introducing blended learning, it is conventional practice to examine and evaluate the impact of the resulting curriculum reform. Judging the worth and impact of an educational development is a complex task involving subtle differences in learning. Qualitative methods to explore these…

Clinician, patient and general public beliefs about diagnostic imaging for low back pain: protocol for a qualitative evidence synthesis.

PubMed

Traeger, Adrian C; Reed, Benjamin J; O'Connor, Denise A; Hoffmann, Tammy C; Machado, Gustavo C; Bonner, Carissa; Maher, Chris G; Buchbinder, Rachelle

2018-02-10

Little is known about how to reduce unnecessary imaging for low back pain. Understanding clinician, patient and general public beliefs about imaging is critical to developing strategies to reduce overuse. To synthesise qualitative research that has explored clinician, patient or general public beliefs about diagnostic imaging for low back pain. We will perform a qualitative evidence synthesis of relevant qualitative research exploring clinician, patient and general public beliefs about diagnostic imaging for low back pain. Exclusions will be studies not using qualitative methods and studies not published in English. Studies will be identified using sensitive search strategies in MEDLINE, EMBASE, CINAHL, AMED and PsycINFO. Two reviewers will independently apply inclusion and exclusion criteria, extract data, and use the Critical Appraisal Skills Programme quality assessment tool to assess the quality of included studies. To synthesise the data we will use a narrative synthesis approach that involves developing a theoretical model, conducting a preliminary synthesis, exploring relations in the data, and providing a structured summary. We will code the data using NVivo. At least two reviewers will independently apply the thematic framework to extracted data. Confidence in synthesis findings will be evaluated using the GRADE Confidence in the Evidence from Reviews of Qualitative Research tool. Ethical approval is not required to conduct this review. We will publish the results in a peer-reviewed journal. CRD42017076047. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The evaluator as technical assistant: A model for systemic reform support

NASA Astrophysics Data System (ADS)

Century, Jeanne Rose

This study explored evaluation of systemic reform. Specifically, it focused on the evaluation of a systemic effort to improve K-8 science, mathematics and technology education. The evaluation was of particular interest because it used both technical assistance and evaluation strategies. Through studying the combination of these roles, this investigation set out to increase understanding of potentially new evaluator roles, distinguish important characteristics of the evaluator/project participant relationship, and identify how these roles and characteristics contribute to effective evaluation of systemic science education reform. This qualitative study used interview, document analysis, and participant observation as methods of data collection. Interviews were conducted with project leaders, project participants, and evaluators and focused on the evaluation strategies and process, the use of the evaluation, and technical assistance. Documents analyzed included transcripts of evaluation team meetings and reports, memoranda and other print materials generated by the project leaders and the evaluators. Data analysis consisted of analytic and interpretive procedures consistent with the qualitative data collected and entailed a combined process of coding transcripts of interviews and meetings, field notes, and other documents; analyzing and organizing findings; writing of reflective and analytic memos; and designing and diagramming conceptual relationships. The data analysis resulted in the development of the Multi-Function Model for Systemic Reform Support. This model organizes systemic reform support into three functions: evaluation, technical assistance, and a third, named here as "systemic perspective." These functions work together to support the project's educational goals as well as a larger goal--building capacity in project participants. This model can now serve as an informed starting point or "blueprint" for strategically supporting systemic reform.

The Impact of E-Portfolio Development on the Employability of Adults Aged 45 and over

ERIC Educational Resources Information Center

Stevens, Hilary

2008-01-01

Purpose: The purpose of this paper is to present the findings of an evaluative case study that used an electronic portfolio to enhance the employability of older adults. The evaluation sought to identify programme effects and highlight the factors that were instrumental in generating them. Design/methodology/approach: Qualitative inquiry methods…

An Experiential Approach to Clinical Supervision Training: A Mixed Methods Evaluation of Effectiveness

ERIC Educational Resources Information Center

Fisher, Amy Killen; Simmons, Christopher; Allen, Susan C.

2016-01-01

This study evaluates an intensive experiential exercise designed to facilitate the provision of high-quality supervision in social work. Data from 46 BSW and MSW students suggest that the exercise can be an effective learning tool. Both quantitative and qualitative findings indicated that the students formed a supervisory working alliance; BSW…

Teacher and Principal Perceptions of How Principal Transformational and Instructional Leadership Behaviors Relate to Student Achievement

ERIC Educational Resources Information Center

Steele, Gayle

2012-01-01

Because of public concern over the effectiveness of our schools, a new evaluation system was put in place to hold principals and teachers directly accountable for student academic achievement. Part of this evaluation included student performance on state assessments. The purpose of this qualitative study sought to examine how the transformation…

Attracting Mature Students into Higher Education: The Impact of Approaches to Learning and Social Identity

ERIC Educational Resources Information Center

Howard, Chris; Davies, Peter

2013-01-01

This paper reports on data collected during an evaluation of two higher education courses designed to attract mature entrants aged between 21 and 60 to undergraduate degree programmes. Employing an evaluation design informed by a critical realist approach, the study utilised a mix of quantitative and qualitative methods to investigate the outcomes…

Qualitative Secondary Analysis: A Case Exemplar.

PubMed

Tate, Judith Ann; Happ, Mary Beth

Qualitative secondary analysis (QSA) is the use of qualitative data that was collected by someone else or was collected to answer a different research question. Secondary analysis of qualitative data provides an opportunity to maximize data utility, particularly with difficult-to-reach patient populations. However, qualitative secondary analysis methods require careful consideration and explicit description to best understand, contextualize, and evaluate the research results. In this article, we describe methodologic considerations using a case exemplar to illustrate challenges specific to qualitative secondary analysis and strategies to overcome them. Copyright © 2017 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Harnessing health information to foster disadvantaged teens' community engagement, leadership skills, and career plans: a qualitative evaluation of the Teen Health Leadership Program.

PubMed

Keselman, Alla; Ahmed, Einas A; Williamson, Deborah C; Kelly, Janice E; Dutcher, Gale A

2015-04-01

This paper describes a qualitative evaluation of a small-scale program aiming to improve health information literacy, leadership skills, and interest in health careers among high school students in a low-income, primarily minority community. Graduates participated in semi-structured interviews, transcripts of which were coded with a combination of objectives-driven and data-driven categories. The program had a positive impact on the participants' health information competency, leadership skills, academic orientation, and interest in health careers. Program enablers included a supportive network of adults, novel experiences, and strong mentorship. The study suggests that health information can provide a powerful context for enabling disadvantaged students' community engagement and academic success.

Understanding of evaluation capacity building in practice: a case study of a national medical education organization.

PubMed

Sarti, Aimee J; Sutherland, Stephanie; Landriault, Angele; DesRosier, Kirk; Brien, Susan; Cardinal, Pierre

2017-01-01

Evaluation capacity building (ECB) is a topic of great interest to many organizations as they face increasing demands for accountability and evidence-based practices. ECB is about building the knowledge, skills, and attitudes of organizational members, the sustainability of rigorous evaluative practices, and providing the resources and motivations to engage in ongoing evaluative work. There exists a solid foundation of theoretical research on ECB, however, understanding what ECB looks like in practice is relatively thin. Our purpose was to investigate what ECB looks like firsthand within a national medical educational organization. The context for this study was the Acute Critical Events Simulation (ACES) organization in Canada, which has successfully evolved into a national educational program, driven by physicians. We conducted an exploratory qualitative study to better understand and describe ECB in practice. In doing so, interviews were conducted with program leaders and instructors so as to gain a richer understanding of evaluative processes and practices. A total of 21 individuals participated in the semistructured interviews. Themes from our qualitative data analysis included the following: evaluation knowledge, skills, and attitudes, use of evaluation findings, shared evaluation beliefs and commitment, evaluation frameworks and processes, and resources dedicated to evaluation. The national ACES organization was a useful case study to explore ECB in practice. The ECB literature provided a solid foundation to understand the purpose and nuances of ECB. This study added to the paucity of studies focused on examining ECB in practice. The most important lesson learned was that the organization must have leadership who are intrinsically motivated to employ and use evaluation data to drive ongoing improvements within the organization. Leaders who are intrinsically motivated will employ risk taking when evaluation practices and processes may be somewhat unfamiliar. Creating and maintaining a culture of data use and ongoing inquiry have enabled national ACES to achieve a sustainable evaluation practice.

Computing in Qualitative Analysis: A Healthy Development?

ERIC Educational Resources Information Center

Richards, Lyn; Richards, Tom

1991-01-01

Discusses the potential impact of computers in qualitative health research. Describes the original goals, design, and implementation of NUDIST, a qualitative computing software. Argues for evaluation of the impact of computer techniques and for an opening of debate among program developers and users to address the purposes and power of computing…

Emerging Uses of Computer Technology in Qualitative Research.

ERIC Educational Resources Information Center

Parker, D. Randall

The application of computer technology in qualitative research and evaluation ranges from simple word processing to doing sophisticated data sorting and retrieval. How computer software can be used for qualitative research is discussed. Researchers should consider the use of computers in data analysis in light of their own familiarity and comfort…

Nurturing the Imagination: Creativity Processes and Innovative Qualitative Research Projects

ERIC Educational Resources Information Center

Mulvihill, Thalia M.; Swaminathan, Raji

2012-01-01

This article explores the creativity processes involved in designing and analyzing innovative qualitative research projects and evaluates examples of recent models and typologies that illustrate a variety of ways to approach qualitative inquiry. Using Gardner's Five Minds (2006) typology, Boyer's Model of Scholarship (1997) and Bloom's Taxonomy of…

How do health service professionals consider human factors when purchasing interactive medical devices? A qualitative interview study.

PubMed

Vincent, Christopher James; Blandford, Ann

2017-03-01

We present findings of a UK study into how those involved in purchasing interactive medical devices go about evaluating usability, the challenges that arise, and opportunities for improvement. The study focused on procurement of infusion devices because these are used by various professionals across healthcare. A semi-structured interview study was carried out involving a range of stakeholders (20 in total) involved in or impacted by medical device procurement. Data was analysed using thematic analysis, a qualitative method designed to support the identification, analysis and reporting of patterns. In principle, health service purchasing was found to accommodate consideration of equipment usability. In practice, the evaluation process was driven primarily by engineering standards; assessment of local needs did not accommodate substantive assessment of usability; and choice was limited by the availability of equipment on the marketplace. We discuss ways in which purchasing could be improved through techniques that account for social circumstances. Copyright © 2016 Elsevier Ltd. All rights reserved.

Patient outcomes after critical illness: a systematic review of qualitative studies following hospital discharge.

PubMed

Hashem, Mohamed D; Nallagangula, Aparna; Nalamalapu, Swaroopa; Nunna, Krishidhar; Nausran, Utkarsh; Robinson, Karen A; Dinglas, Victor D; Needham, Dale M; Eakin, Michelle N

2016-10-26

There is growing interest in patient outcomes following critical illness, with an increasing number and different types of studies conducted, and a need for synthesis of existing findings to help inform the field. For this purpose we conducted a systematic review of qualitative studies evaluating patient outcomes after hospital discharge for survivors of critical illness. We searched the PubMed, EMBASE, CINAHL, PsycINFO, and CENTRAL databases from inception to June 2015. Studies were eligible for inclusion if the study population was >50 % adults discharged from the ICU, with qualitative evaluation of patient outcomes. Studies were excluded if they focused on specific ICU patient populations or specialty ICUs. Citations were screened in duplicate, and two reviewers extracted data sequentially for each eligible article. Themes related to patient outcome domains were coded and categorized based on the main domains of the Patient Reported Outcomes Measurement Information System (PROMIS) framework. A total of 2735 citations were screened, and 22 full-text articles were eligible, with year of publication ranging from 1995 to 2015. All of the qualitative themes were extracted from eligible studies and then categorized using PROMIS descriptors: satisfaction with life (16 studies), including positive outlook, acceptance, gratitude, independence, boredom, loneliness, and wishing they had not lived; mental health (15 articles), including symptoms of post-traumatic stress disorder, anxiety, depression, and irritability/anger; physical health (14 articles), including mobility, activities of daily living, fatigue, appetite, sensory changes, muscle weakness, and sleep disturbances; social health (seven articles), including changes in friends/family relationships; and ability to participate in social roles and activities (six articles), including hobbies and disability. ICU survivors may experience positive emotions and life satisfaction; however, a wide range of mental, physical, social, and functional sequelae occur after hospital discharge. These findings are important for understanding patient-centered outcomes in critical care and providing focus for future interventional studies aimed at improving outcomes of importance to ICU survivors.

Challenges, coping strategies, and recommendations related to the HIV services field in the HAART era: a systematic literature review of qualitative studies from the United States and Canada.

PubMed

Kerr, Zachary Y; Miller, Katye R; Galos, Dylan; Love, Randi; Poole, Charles

2013-02-01

Qualitative research methods have been utilized to study the nature of work in the HIV services field. Yet current literature lacks a Highly Active Anti-Retroviral Treatment (HAART) era compendium of qualitative research studying challenges and coping strategies in the field. This study systematically reviewed challenges and coping strategies that qualitative researchers observed in the HIV services field during the HAART era, and their recommendations to organizations. Four online databases were searched for peer-reviewed research that utilized qualitative methods, were published from January 1998 to February 2012, utilized samples of individuals in the HIV services field; occurred in the U.S. or Canada, and contained information related to challenges and/or coping strategies. Abstracts were identified (n=846) and independently read and coded for inclusion by at least two of the four first authors. Identified articles (n=26) were independently read by at least two of the four first authors who recorded the study methodology, participant demographics, challenges and coping strategies, and recommendations. A number of challenges affecting those in the HIV services field were noted, particularly interpersonal and organizational issues. Coping strategies were problem- and emotion-focused. Summarized research recommendations called for increased support, capacity-building, and structural changes. Future research on challenges and coping strategies must provide up-to-date information to the HIV services field while creating, implementing, and evaluating interventions to manage current challenges and reduce the risk of burnout.

Enhancing the quality and credibility of qualitative analysis.

PubMed Central

Patton, M Q

1999-01-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems. PMID:10591279

Effectiveness of Solution-Focused Brief Therapy: A Systematic Qualitative Review of Controlled Outcome Studies

ERIC Educational Resources Information Center

Gingerich, Wallace J.; Peterson, Lance T.

2013-01-01

Objective: We review all available controlled outcome studies of solution-focused brief therapy (SFBT) to evaluate evidence of its effectiveness. Method: Forty-three studies were located and key data abstracted on problem, setting, SFBT intervention, design characteristics, and outcomes. Results: Thirty-two (74%) of the studies reported…

An Evaluation of the Teaching Activities Implemented in the Elementary Science and Technology Courses in Terms of Multiple Intelligence Theory: A Sample from Adana

ERIC Educational Resources Information Center

Iflazoglu Saban, Ayten

2011-01-01

The aim of this study was to evaluate to what extent class activities at the Elementary Science and Technology course address intelligence areas. The research was both a quantitative and a qualitative study. The sample of the study consisted of 102 4th grade elementary teachers, 97 5th grade elementary teachers, and 55 6th, 7th, and 8th grade…

Qualitative issues in the evolution of the Andersen Lighthouse

DOE Office of Scientific and Technical Information (OSTI.GOV)

De Keyser, D.; Gratz, S.; Barton, S.A.

1995-11-01

This paper reports on the continuing product development of the Andersen Lighthouse. Refer to ``Development of the Andersen Lighthouse for the Wal-Mart Environmental Demonstration Store`` in the Solar `94 Conference Proceedings for a description of the Andersen Lighthouse. The goals for this project were to evaluate the following qualitative issues surrounding daylighting: color rendition, quality of light, view to the sky, and human perception. In order to evaluate the effects of the Andersen Lighthouse the authors compared it to a high transmission translucent (acrylic bubble) skylight and an ordinary translucent (acrylic bubble) skylight. In addition to the above comparison, amore » test installation of Andersen Lighthouses in a manufacturing space was analyzed. This case study covers the affect the introduction of natural light and view had on the comfort and productivity of the employees. Visual observations, illumination readings, and employee questionnaires were used for evaluation.« less

Noninvasive method for assessing the human circadian clock using hair follicle cells

PubMed Central

Akashi, Makoto; Soma, Haruhiko; Yamamoto, Takuro; Tsugitomi, Asuka; Yamashita, Shiko; Yamamoto, Takuya; Nishida, Eisuke; Yasuda, Akio; Liao, James K.; Node, Koichi

2010-01-01

A thorough understanding of the circadian clock requires qualitative evaluation of circadian clock gene expression. Thus far, no simple and effective method for detecting human clock gene expression has become available. This limitation has greatly hampered our understanding of human circadian rhythm. Here we report a convenient, reliable, and less invasive method for detecting human clock gene expression using biopsy samples of hair follicle cells from the head or chin. We show that the circadian phase of clock gene expression in hair follicle cells accurately reflects that of individual behavioral rhythms, demonstrating that this strategy is appropriate for evaluating the human peripheral circadian clock. Furthermore, using this method, we indicate that rotating shift workers suffer from a serious time lag between circadian gene expression rhythms and lifestyle. Qualitative evaluation of clock gene expression in hair follicle cells, therefore, may be an effective approach for studying the human circadian clock in the clinical setting. PMID:20798039

Evaluation of two CD-ROMs from a series on cell biology.

PubMed

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation.

Evaluation of Two CD-ROMs from a Series on Cell Biology

PubMed Central

Sander, Uwe; Kerlen, Gertraude; Steinke, Mattias; Huk, Thomas; Floto, Christian

2003-01-01

Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation. PMID:14673491

Resistance to extinction of human evaluative conditioning using a between-subjects design.

PubMed

Baeyens, F; Díaz, E; Ruiz, G

2005-02-01

Two experiments were conducted to examine whether the resistance to extinction obtained in evaluative conditioning (EC) studies implies that EC is a qualitatively distinct form of classical conditioning (Baeyens, Eelen, & Crombez, 1995 a) or whether it is the result of an nonassociative artefact ( Field & Davey, 1997 , 1998 , 1999 ). Both experiments included between-subjects control groups in addition to standard within-subjects control conditions. In Experiment 1, only verbal ratings were measured in order to evaluate the effect of postacquisition CS-only exposures on EC whereas in Experiment 2, verbal ratings and postextinction priming effects were measured. The results showed that the EC effects are demonstrable in a between-subjects design and that the extinction procedure did not have any influence on the acquired evaluative value of CSs regardless of whether the verbal ratings or the priming effects were used as dependent variables. The present results provide evidence that EC is resistant to extinction and suggest an interpretation of EC as a qualitatively distinct form of associative learning.

The impact of qualitative research on gynaecologic oncology guidelines.

PubMed

How, Jeffrey Andrew; Abitbol, Jeremie; Lau, Susie; Gotlieb, Walter Henri; Abenhaim, Haim Arie

2015-02-01

Inherent in the care provided to patients with cancer is an important psychosocial element which has been explored scientifically through qualitative research. The purpose of our study was to evaluate the availability of qualitative research in gynaecologic oncology and to measure its integration in gynaecologic oncology practice guidelines. We searched Medline, CINHAL, Scopus, and Web of Science databases to identify the availability of qualitative research conducted in the past 20 years on the three most prevalent gynaecologic cancers: endometrial, ovarian, and cervical cancer. National and international practice guidelines on management of gynaecologic cancers were selected using the National Guideline Clearinghouse website, the Society of Obstetricians and Gynaecologists of Canada website, and the Standards and Guidelines Evidence directory of cancer guidelines. Bibliometric analysis was used to determine the frequency of qualitative references cited in these guidelines. One hundred thirteen qualitative research papers on gynaecologic cancers were identified focusing on psychological impacts, social dynamics, and doctor-patient interactions during cancer treatment and recovery. Among the 15 national and international clinical practice guidelines identified on management of gynaecologic cancer, there were a total of 2272 references, and of these only three references citing qualitative research were identified (0.1%) in only one of the 15 practice guidelines. Although qualitative research is being carried out in gynaecologic oncology, its integration into clinical practice guidelines is essentially absent. Efforts to narrow the gap between qualitative research and clinical practice are essential in ensuring a comprehensive approach to the treatment of patients with gynaecologic cancer.

Comparison study on qualitative and quantitative risk assessment methods for urban natural gas pipeline network.

PubMed

Han, Z Y; Weng, W G

2011-05-15

In this paper, a qualitative and a quantitative risk assessment methods for urban natural gas pipeline network are proposed. The qualitative method is comprised of an index system, which includes a causation index, an inherent risk index, a consequence index and their corresponding weights. The quantitative method consists of a probability assessment, a consequences analysis and a risk evaluation. The outcome of the qualitative method is a qualitative risk value, and for quantitative method the outcomes are individual risk and social risk. In comparison with previous research, the qualitative method proposed in this paper is particularly suitable for urban natural gas pipeline network, and the quantitative method takes different consequences of accidents into consideration, such as toxic gas diffusion, jet flame, fire ball combustion and UVCE. Two sample urban natural gas pipeline networks are used to demonstrate these two methods. It is indicated that both of the two methods can be applied to practical application, and the choice of the methods depends on the actual basic data of the gas pipelines and the precision requirements of risk assessment. Crown Copyright © 2011. Published by Elsevier B.V. All rights reserved.

[Economic effects of integrated RIS-PACS solution in the university environment].

PubMed

Kröger, M; Nissen-Meyer, S; Wetekam, V; Reiser, M

1999-04-01

The goal of the current article is to demonstrate how qualitative and monetary effects resulting from an integrated RIS/PACS installation can be evaluated. First of all, the system concept of a RIS/PACS solution for a university hospital is defined and described. Based on this example, a generic method for the evaluation of qualitative and monetary effects as well as associated risks is depicted and demonstrated. To this end, qualitative analyses, investment calculations and risk analysis are employed. The sample analysis of a RIS/PACS solution specially designed for a university hospital demonstrates positive qualitative and monetary effects of the system. Under ideal conditions the payoff time of the investments is reached after 4 years of an assumed 8 years effective life of the system. Furthermore, under conservative assumptions, the risk analysis shows a probability of 0% for realising a negative net present value at the end of the payoff time period. It should be pointed out that the positive result of this sample analysis will not necessarily apply to other clinics or hospitals. However, the same methods may be used for the individual evaluation of the qualitative and monetary effects of a RIS/PACS installation in any clinic.

Differentiation of Uterine Leiomyosarcoma from Atypical Leiomyoma: Diagnostic Accuracy of Qualitative MR Imaging Features and Feasibility of Texture Analysis.

PubMed

Lakhman, Yulia; Veeraraghavan, Harini; Chaim, Joshua; Feier, Diana; Goldman, Debra A; Moskowitz, Chaya S; Nougaret, Stephanie; Sosa, Ramon E; Vargas, Hebert Alberto; Soslow, Robert A; Abu-Rustum, Nadeem R; Hricak, Hedvig; Sala, Evis

2017-07-01

To investigate whether qualitative magnetic resonance (MR) features can distinguish leiomyosarcoma (LMS) from atypical leiomyoma (ALM) and assess the feasibility of texture analysis (TA). This retrospective study included 41 women (ALM = 22, LMS = 19) imaged with MRI prior to surgery. Two readers (R1, R2) evaluated each lesion for qualitative MR features. Associations between MR features and LMS were evaluated with Fisher's exact test. Accuracy measures were calculated for the four most significant features. TA was performed for 24 patients (ALM = 14, LMS = 10) with uniform imaging following lesion segmentation on axial T2-weighted images. Texture features were pre-selected using Wilcoxon signed-rank test with Bonferroni correction and analyzed with unsupervised clustering to separate LMS from ALM. Four qualitative MR features most strongly associated with LMS were nodular borders, haemorrhage, "T2 dark" area(s), and central unenhanced area(s) (p ≤ 0.0001 each feature/reader). The highest sensitivity [1.00 (95%CI:0.82-1.00)/0.95 (95%CI: 0.74-1.00)] and specificity [0.95 (95%CI:0.77-1.00)/1.00 (95%CI:0.85-1.00)] were achieved for R1/R2, respectively, when a lesion had ≥3 of these four features. Sixteen texture features differed significantly between LMS and ALM (p-values: <0.001-0.036). Unsupervised clustering achieved accuracy of 0.75 (sensitivity: 0.70; specificity: 0.79). Combination of ≥3 qualitative MR features accurately distinguished LMS from ALM. TA was feasible. • Four qualitative MR features demonstrated the strongest statistical association with LMS. • Combination of ≥3 these features could accurately differentiate LMS from ALM. • Texture analysis was a feasible semi-automated approach for lesion categorization.

Musical Ways of Knowing: A Personal Approach to Qualitative Inquiry in Education

ERIC Educational Resources Information Center

McMillan, Christine

2005-01-01

In this comparative essay, I examine how musical ways of knowing inform my educational research. To understand this question, I employ dual perspectives as a musician and qualitative researcher. I use Eisner's concept of the art of educational evaluation (1985a, 1985b, 1997)--particularly as educational evaluation relates to connoisseurship and…

Whatever Happened to the Silent Scientific Revolution?--Research, Theory and Practice in Distance Education.

ERIC Educational Resources Information Center

Morgan, Alistair

The point of departure for this article is the title of a book edited by David Fetterman, "Qualitative Approaches to Educational Evaluation--The Silent Scientific Revolution." This article addresses the question of how the shift to a qualitative, phenomenological approach has impinged on research and evaluation in distance education.…

Factors Influencing Household Uptake of Improved Solid Fuel Stoves in Low- and Middle-Income Countries: A Qualitative Systematic Review

PubMed Central

Debbi, Stanistreet; Elisa, Puzzolo; Nigel, Bruce; Dan, Pope; Eva, Rehfuess

2014-01-01

Household burning of solid fuels in traditional stoves is detrimental to health, the environment and development. A range of improved solid fuel stoves (IS) are available but little is known about successful approaches to dissemination. This qualitative systematic review aimed to identify factors that influence household uptake of IS in low- and middle-income countries. Extensive searches were carried out and studies were screened and extracted using established systematic review methods. Fourteen qualitative studies from Asia, Africa and Latin-America met the inclusion criteria. Thematic synthesis was used to synthesise data and findings are presented under seven framework domains. Findings relate to user and stakeholder perceptions and highlight the importance of cost, good stove design, fuel and time savings, health benefits, being able to cook traditional dishes and cleanliness in relation to uptake. Creating demand, appropriate approaches to business, and community involvement, are also discussed. Achieving and sustaining uptake is complex and requires consideration of a broad range of factors, which operate at household, community, regional and national levels. Initiatives aimed at IS scale up should include quantitative evaluations of effectiveness, supplemented with qualitative studies to assess factors affecting uptake, with an equity focus. PMID:25123070

Factors influencing household uptake of improved solid fuel stoves in low- and middle-income countries: a qualitative systematic review.

PubMed

Debbi, Stanistreet; Elisa, Puzzolo; Nigel, Bruce; Dan, Pope; Eva, Rehfuess

2014-08-13

Household burning of solid fuels in traditional stoves is detrimental to health, the environment and development. A range of improved solid fuel stoves (IS) are available but little is known about successful approaches to dissemination. This qualitative systematic review aimed to identify factors that influence household uptake of IS in low- and middle-income countries. Extensive searches were carried out and studies were screened and extracted using established systematic review methods. Fourteen qualitative studies from Asia, Africa and Latin-America met the inclusion criteria. Thematic synthesis was used to synthesise data and findings are presented under seven framework domains. Findings relate to user and stakeholder perceptions and highlight the importance of cost, good stove design, fuel and time savings, health benefits, being able to cook traditional dishes and cleanliness in relation to uptake. Creating demand, appropriate approaches to business, and community involvement, are also discussed. Achieving and sustaining uptake is complex and requires consideration of a broad range of factors, which operate at household, community, regional and national levels. Initiatives aimed at IS scale up should include quantitative evaluations of effectiveness, supplemented with qualitative studies to assess factors affecting uptake, with an equity focus.

Tools for the Task? Perspectives on Assistive Technology in Educational Settings.

ERIC Educational Resources Information Center

Todis, Bonnie

1996-01-01

A two-year qualitative study evaluated use of assistive technology by 13 students. Excerpts from case studies illustrate the perspectives of parents, specialists (physical therapists and speech language pathologists), special and regular education teachers, instructional assistants, student users, and peers. Results demonstrate the complex…

Inter-observer agreement improves with PERCIST 1.0 as opposed to qualitative evaluation in non-small cell lung cancer patients evaluated with F-18-FDG PET/CT early in the course of chemo-radiotherapy.

PubMed

Fledelius, Joan; Khalil, Azza; Hjorthaug, Karin; Frøkiær, Jørgen

2016-12-01

The purpose of this study is to determine whether a qualitative approach or a semi-quantitative approach provides the most robust method for early response evaluation with 2'-deoxy-2'-[(18)F]fluoro-D-glucose (F-18-FDG) positron emission tomography combined with whole body computed tomography (PET/CT) in non-small cell lung cancer (NSCLC). In this study eight Nuclear Medicine consultants analyzed F-18-FDG PET/CT scans from 35 patients with locally advanced NSCLC. Scans were performed at baseline and after 2 cycles of chemotherapy. Each observer used two different methods for evaluation: (1) PET response criteria in solid tumors (PERCIST) 1.0 and (2) a qualitative approach. Both methods allocate patients into one of four response categories (complete and partial metabolic response (CMR and PMR) and stable and progressive metabolic disease (SMD and PMD)). The inter-observer agreement was evaluated using Fleiss' kappa for multiple raters, Cohens kappa for comparison of the two methods, and intraclass correlation coefficients (ICC) for comparison of lean body mass corrected standardized uptake value (SUL) peak measurements. The agreement between observers when determining the percentage change in SULpeak was "almost perfect", with ICC = 0.959. There was a strong agreement among observers allocating patients to the different response categories with a Fleiss kappa of 0.76 (0.71-0.81). In 22 of the 35 patients, complete agreement was observed with PERCIST 1.0. The agreement was lower when using the qualitative method, moderate, having a Fleiss kappa of 0.60 (0.55-0.64). Complete agreement was achieved in only 10 of the 35 patients. The difference between the two methods was statistically significant (p < 0.005) (chi-squared). Comparing the two methods for each individual observer showed Cohen's kappa values ranging from 0.64 to 0.79, translating into a strong agreement between the two methods. PERCIST 1.0 provides a higher overall agreement between observers than the qualitative approach in categorizing early treatment response in NSCLC patients. The inter-observer agreement is in fact strong when using PERCIST 1.0 even when the level of instruction is purposely kept to a minimum in order to mimic the everyday situation. The variability is largely owing to the subjective elements of the method.

Evaluating and Using Observational Evidence: The Contrasting Views of Policy Makers and Epidemiologists.

PubMed

O'Donoughue Jenkins, Lily; Kelly, Paul M; Cherbuin, Nicolas; Anstey, Kaarin J

2016-01-01

Currently, little is known about the types of evidence used by policy makers. This study aimed to investigate how policy makers in the health domain use and evaluate evidence and how this differs from academic epidemiologists. By having a better understanding of how policy makers select, evaluate, and use evidence, academics can tailor the way in which that evidence is produced, potentially leading to more effective knowledge translation. An exploratory mixed-methods study design was used. Quantitative measures were collected via an anonymous online survey ( n  = 28), with sampling from three health-related government and non-government organizations. Semi-structured interviews with policy makers ( n  = 20) and epidemiologists ( n  = 6) were conducted to gather qualitative data. Policy makers indicated systematic reviews were the preferred research resource (19%), followed closely by qualitative research (16%). Neither policy makers nor epidemiologists used grading instruments to evaluate evidence. In the web survey, policy makers reported that consistency and strength of evidence (93%), the quality of data (93%), bias in the evidence (79%), and recency of evidence (79%) were the most important factors taken into consideration when evaluating the available evidence. The same results were found in the qualitative interviews. Epidemiologists focused on the methodology used in the study. The most cited barriers to using robust evidence, according to policy makers, were political considerations (60%), time limitations (55%), funding (50%), and research not being applicable to current policies (50%). The policy maker's investigation did not report a systematic approach to evaluating evidence. Although there was some overlap between what policy makers and epidemiologists identified as high-quality evidence, there was also some important differences. This suggests that the best scientific evidence may not routinely be used in the development of policy. In essence, the policy-making process relied on other jurisdictions' policies and the opinions of internal staff members as primary evidence sources to inform policy decisions. Findings of this study suggest that efforts should be directed toward making scientific information more systematically available to policy makers.

The Issue of Quality in Qualitative Research

ERIC Educational Resources Information Center

Hammersley, Martyn

2007-01-01

This article addresses the perennial issue of the criteria by which qualitative research should be evaluated. At the present time, there is a sharp conflict between demands for explicit criteria, for example in order to serve systematic reviewing and evidence-based practice, and arguments on the part of some qualitative researchers that such…

[The study of establishment of the " Chinese provincial Blindness prevention technical guidance group performance evaluation system"].

PubMed

Lu, L N; He, X G; Zhu, J F; Xu, X; Zhang, R; Hu, X; Zou, H D

2016-11-11

Objective: To establish an assessment system, including indexes and scoring methods, that can be used for performance evaluation of the provincial blindness prevention technical guidance group properly and effectively . Methods: The indexes and scoring methods were set based on the core content of The " National Plan of Prevention and Treatment of Blindness (2012-2015)" , the specific requirement and target of the World Health Organization (WHO) "For the General Eye Health: Global plan of Action (2014-2019)" , and the current situation of the China's provinces and autonomous regions. These indexes should be of effectiveness, feasibility, comparability, guidance and advancing. Formed by a literature review of candidate indicators, the framework of the system is built by qualitative assessment. With the Delphi method, the system was further revised and improved. Empirical pilot study was then used to prove the feasibility, followed by the final qualitative analysis that establish the " Chinese provincial Blindness prevention technical guidance group performance evaluation system" . Results: Through the literature review and qualitative assessment, a six dimensional system framework was built, including 6 first-level indicators, 16 second-level indicators, and 29 third-level indicators through Delphi method evaluation. With the variation coefficient method, the coeffiences of the first-level index weight were calculated as: Organization and management 0.15, Development and implementation of blindness prevention plans 0.15, Implementation of blindness prevention projects 0.14, Training 0.17, Health education 0.18, and Cooperation and exchanges 0.21. The specific scoring method for this system is confirmed as: data and files check, field interview, and record interview, sampling investigation. Empirical pilot study was conducted in the Jilin, Guizhou and Gansu provinces, and the self-assessment results from local experts were consistent with the scores from the systems. Conclusion: This system established is appropriate at current time, and it can effectively evaluate the performance of the Chinese provincial Blindness prevention technical guidance group. (Chin J Ophthalmol, 2016, 52:814-824) .

'To be honest, I haven't even thought about it' - recruitment in small-scale, qualitative research in primary care.

PubMed

Jessiman, Wendy C

2013-11-01

To review strategies for successful recruitment in small-scale, qualitative research in primary care by exploring those used in a variety of settings and providing a reflective analysis of the strategies used in one such study. Recruitment of participants in small-scale, qualitative research in primary care is problematic. Researchers need to be more aware of the issues involved, but there is little practical guidance available to help them devise efficient strategies for maximising recruitment. This paper draws on a study conducted in the Highlands of Scotland examining the emotional wellbeing of pregnant and non-pregnant women. This was a qualitative study using diaries and interviews over a period of nine months. Ten women were recruited over a period of more than two years. The author reviews the strategies for successful recruitment based on both a review of the available literature as well as the experience of one study. Recruitment of subjects to a study is one of the major elements of a research proposal and requires significant effort, yet there is little to guide researchers through this difficult process. The challenge of recruitment is seldom debated and studies rarely report problems encountered or outline approaches that proved particularly successful. The importance of successful recruitment is discussed and the arguably typical recruitment difficulties encountered by researchers conducting a study in the Highlands of Scotland are outlined. The elements that comprised successful recruitment in this and other studies are appraised. Although focused specifically on recruitment in small-scale, qualitative studies in primary care, this paper raises broader issues about the recruitment of participants in all types of research. Recruitment has implications for the trustworthiness and dependability of the data and hence the findings of research. Despite this, there remains a lack of evidence about what enhances research recruitment, leaving researchers to rely on guesswork and anecdotes. In a climate of evidence-based practice, researchers should be encouraged to include a formal evaluation of recruitment strategies in their studies and to report their findings. As recruitment has implications for the trustworthiness and dependability of research, researchers need to consider a wide range of recruitment strategies and include a formal evaluation of their recruitment strategies when reporting on their research.

[Qualitative techniques for public health research and the development of health care services: more than just another technique].

PubMed

March Cerdà, J C; Prieto Rodríguez, M A; Hernán García, M; Solas Gaspar, O

1999-01-01

Regarding the debate on the existence of two current focuses on health science research (qualitative and quantitative), the paper states the need for complementing the techniques which contribute to a better knowledge of populations and communities, and the need for offering effective solutions to different problems. The article analyses the usefulness of qualitative methods, describes the techniques and procedures more frequently used to guarantee the validity and reliability of research findings and ends bringing up the need for using qualitative and quantitative approaches. This way of working together or learning from each other will enrich research and interventions on public heath and health management fields. Qualitative methods are useful for sound understanding of a given issue that is being investigated or evaluated taking into account the point of view of the participants under research. Key techniques, listed from the most structured to the less structured are among others: structured interview, Delphi, nominal group, case study, semistructured interview, focal group, brainstorming, discussion group, in depth interview, life story and participant observation.

Further assessment of a method to estimate reliability and validity of qualitative research findings.

PubMed

Hinds, P S; Scandrett-Hibden, S; McAulay, L S

1990-04-01

The reliability and validity of qualitative research findings are viewed with scepticism by some scientists. This scepticism is derived from the belief that qualitative researchers give insufficient attention to estimating reliability and validity of data, and the differences between quantitative and qualitative methods in assessing data. The danger of this scepticism is that relevant and applicable research findings will not be used. Our purpose is to describe an evaluative strategy for use with qualitative data, a strategy that is a synthesis of quantitative and qualitative assessment methods. Results of the strategy and factors that influence its use are also described.

Evaluating Management Strategies for Automated Test Systems/Equipment (ATS/E): An F-15 Case Study

DTIC Science & Technology

2005-03-01

ethnography , grounded theory , case study , phenomenological research , and narrative research (also known as bibliography from...Creswell, 2003:183). Example inquiry strategies identified by Creswell are: narrative , phenomenology , ethnography , case study , and grounded theory ...other managed systems. Methodology The researcher chose a qualitative research methodology and

Objectivity and reliability in qualitative analysis: realist, contextualist and radical constructionist epistemologies.

PubMed

Madill, A; Jordan, A; Shirley, C

2000-02-01

The effect of the individual analyst on research findings can create a credibility problem for qualitative approaches from the perspective of evaluative criteria utilized in quantitative psychology. This paper explicates the ways in which objectivity and reliability are understood in qualitative analysis conducted from within three distinct epistemological frameworks: realism, contextual constructionism, and radical constructionism. It is argued that quality criteria utilized in quantitative psychology are appropriate to the evaluation of qualitative analysis only to the extent that it is conducted within a naive or scientific realist framework. The discussion is illustrated with reference to the comparison of two independent grounded theory analyses of identical material. An implication of this illustration is to identify the potential to develop a radical constructionist strand of grounded theory.

A Framework for Evaluating Qualitative Changes in Learners' Experience and Engagement: Developing Communicative English Teaching and Learning in Bangladesh

ERIC Educational Resources Information Center

Kirkwood, Adrian Terence; Rae, Jan

2011-01-01

This article presents the context and framework for evaluation studies of educational transformations associated with the English in Action Project, Bangladesh (EIA) as it progresses over a nine-year period. EIA was launched in May 2008 with the intention of developing communicative English language learning and teaching in Bangladesh. Through a…

A Quantitative and Qualitative Evaluation of an Automatic Occlusion Device for Tracheoesophageal Speech: The Provox FreeHands HME

ERIC Educational Resources Information Center

Hamade, Rachel; Hewlett, Nigel; Scanlon, Emer

2006-01-01

This study aimed to evaluate a new automatic tracheostoma valve: the Provox FreeHands HME (manufactured by Atos Medical AB, Sweden). Data from four laryngectomee participants using automatic and also manual occlusion were subjected to acoustic and perceptual analysis. The main results were a significant decrease, from the manual to automatic…

How Service Works. Summary of the W. K. Kellogg Foundation's "Service Works": A Retrospective Evaluation of Higher Education Service Programs.

ERIC Educational Resources Information Center

Kellogg Foundation, Battle Creek, MI.

Service learning is an undergraduate education strategy found across four program areas funded by the W. K. Kellogg Foundation (WKKF). This cross-foundation, retrospective evaluation examines 35 projects of $100,000 or more funded between 1985-95. Study information was based on qualitative data and approaches, with the majority of project…

An Evaluation of Two Approaches for Teaching Reading Comprehension Strategies in the Primary Years Using Science Information Texts

ERIC Educational Resources Information Center

Reutzel, D. Ray; Smith, John A.; Fawson, Parker C.

2005-01-01

There are few research studies on the effects of teaching comprehension strategies to young children in the primary grades. Using a Dominant-Less Dominant Mixed Model design employing both qualitative and quantitative data collection, we evaluated two approaches for teaching comprehension strategies to 7- and 8-year-old children in four…

A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors

ERIC Educational Resources Information Center

Plough, India C.; Briggs, Sarah L.; Van Bonn, Sarah

2010-01-01

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Australian health promotion practitioners' perceptions on evaluation of empowerment and participation.

PubMed

Brandstetter, Susanne; McCool, Megan; Wise, Marilyn; Loss, Julika

2014-03-01

Although participation and empowerment are hallmarks of the WHO vision of health promotion, it is acknowledged that they are difficult to evaluate. Devising adequate study designs, indicators and methods for the assessment of participation and empowerment should consider the experiences, concerns and constraints of health promotion practitioners. The aim of this study was to investigate health promotion practitioners' perspectives on general and methodological aspects of evaluation of empowerment and participation. Semi-structured interviews were conducted with 17 experienced practitioners in community-based health promotion in New South Wales, Australia. The interviews covered benefits of and barriers to the evaluation of participation and empowerment, key indicators and methodological aspects. Interview transcripts were examined using thematic content analysis. The idea of evaluating empowerment and participation is supported by health promotion practitioners. Including indicators of empowerment and participation in the evaluation could also emphasise-to practitioners and citizens alike-the value of involving and enabling community members. The interviews highlighted the importance of a receptive environment for evaluation of empowerment and participation to take root. The resistance of health authorities towards empowerment indicators was seen as a challenge for funding evaluations. Community members should be included in the evaluation process, although interviewees found it difficult to do so in a representative way and empowering approach. Qualitative methods might capture best whether empowerment and participation have occurred in a programme. The positive experiences that the interviewees made with innovative qualitative methods encourage further investment in developing new research designs.

Latina food patterns in the United States: a qualitative metasynthesis.

PubMed

Gerchow, Lauren; Tagliaferro, Barbara; Squires, Allison; Nicholson, Joey; Savarimuthu, Stella M; Gutnick, Damara; Jay, Melanie

2014-01-01

Obesity disproportionately affects Latinas living in the United States, and cultural food patterns contribute to this health concern. The aim of this study was to synthesize the qualitative results of research regarding Latina food patterns in order to (a) identify common patterns across Latino culture and within Latino subcultures and (b) inform future research by determining gaps in the literature. A systematic search of three databases produced 13 studies (15 manuscripts) that met the inclusion criteria for review. The Critical Appraisal Skills Program tool and the recommendations of Squires for evaluating translation methods in qualitative research were applied to appraise study quality. Authors coded through directed content analysis and an adaptation of the Joanna Briggs Institute Qualitative Assessment and Review Instrument coding template to extract themes. Coding focused on food patterns, obesity, population breakdown, immigration, acculturation, and barriers and facilitators to healthy eating. Other themes and categories emerged from this process to complement this approach. Major findings included the following: (a) Immigration driven changes in scheduling, food choice, socioeconomic status, and family dynamics shape the complex psychology behind healthy food choices for Latina women; (b) in Latina populations, barriers and facilitators to healthy lifestyle choices around food are complex; and (c) there is a clear need to differentiate Latino populations by country of origin in future qualitative studies on eating behavior. Healthcare providers need to recognize the complex influences behind eating behaviors among immigrant Latinas in order to design effective behavior change and goal-setting programs to support healthy lifestyles.

Relevant patient perceptions and experiences for evaluating quality of interaction with physiotherapists during outpatient rehabilitation: a qualitative study.

PubMed

Del Baño-Aledo, M Elena; Medina-Mirapeix, Francesc; Escolar-Reina, Pilar; Montilla-Herrador, Joaquina; Collins, Sean M

2014-03-01

To identify elements of the physiotherapist-patient interaction considered by patients when they evaluate the quality of care in outpatient rehabilitation settings. A qualitative study with nine focus groups, Two researchers conducted the focus groups, and a topic guide with predetermined questions was used. Each group discussion was audiotaped,, transcribed verbatim and analyzed thematically according to a modified grounded theory approach. Three postacute ambulatory centers in Barcelona, Madrid and Seville (Spain). Fifty-seven adults undergoing outpatient rehabilitation for musculoskeletal conditions/injuries. Patients based their evaluations of quality of care on their assessment of physiotherapists' willingness to provide information and education, technical expertise and interpersonal manners (eg. respect, emotional support and sensitivity changes in the patient's status). Both positive and negative aspects of the physiotherapist-patient interaction emerged under all these themes, except for friendly and respectful communication. This study identified which elements of the physiotherapist-patient interaction are considered by patients when evaluating the quality of care in rehabilitation outpatient settings. Further research should work to develop self-report questionnaires about patients' experiences of the physiotherapist-patient interaction in rehabilitation services to provide empirical and quantitative evidence. Copyright © 2013 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

PubMed

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

The PULSAR Specialist Care protocol: a stepped-wedge cluster randomized control trial of a training intervention for community mental health teams in recovery-oriented practice.

PubMed

Shawyer, Frances; Enticott, Joanne C; Brophy, Lisa; Bruxner, Annie; Fossey, Ellie; Inder, Brett; Julian, John; Kakuma, Ritsuko; Weller, Penelope; Wilson-Evered, Elisabeth; Edan, Vrinda; Slade, Mike; Meadows, Graham N

2017-05-08

Recovery features strongly in Australian mental health policy; however, evidence is limited for the efficacy of recovery-oriented practice at the service level. This paper describes the Principles Unite Local Services Assisting Recovery (PULSAR) Specialist Care trial protocol for a recovery-oriented practice training intervention delivered to specialist mental health services staff. The primary aim is to evaluate whether adult consumers accessing services where staff have received the intervention report superior recovery outcomes compared to adult consumers accessing services where staff have not yet received the intervention. A qualitative sub-study aims to examine staff and consumer views on implementing recovery-oriented practice. A process evaluation sub-study aims to articulate important explanatory variables affecting the interventions rollout and outcomes. The mixed methods design incorporates a two-step stepped-wedge cluster randomized controlled trial (cRCT) examining cross-sectional data from three phases, and nested qualitative and process evaluation sub-studies. Participating specialist mental health care services in Melbourne, Victoria are divided into 14 clusters with half randomly allocated to receive the staff training in year one and half in year two. Research participants are consumers aged 18-75 years who attended the cluster within a previous three-month period either at baseline, 12 (step 1) or 24 months (step 2). In the two nested sub-studies, participation extends to cluster staff. The primary outcome is the Questionnaire about the Process of Recovery collected from 756 consumers (252 each at baseline, step 1, step 2). Secondary and other outcomes measuring well-being, service satisfaction and health economic impact are collected from a subset of 252 consumers (63 at baseline; 126 at step 1; 63 at step 2) via interviews. Interview-based longitudinal data are also collected 12 months apart from 88 consumers with a psychotic disorder diagnosis (44 at baseline, step 1; 44 at step 1, step 2). cRCT data will be analyzed using multilevel mixed-effects modelling to account for clustering and some repeated measures, supplemented by thematic analysis of qualitative interview data. The process evaluation will draw on qualitative, quantitative and documentary data. Findings will provide an evidence-base for the continued transformation of Australian mental health service frameworks toward recovery. Australian and New Zealand Clinical Trial Registry: ACTRN12614000957695 . Date registered: 8 September 2014.

Hospice care delivered at home, in nursing homes and in dedicated hospice facilities: A systematic review of quantitative and qualitative evidence.

PubMed

Candy, B; Holman, A; Leurent, B; Davis, S; Jones, L

2011-01-01

Hospice care supports patients and their families physically and emotionally through the dying phase. In many countries a substantial portion of specialised end-of-life care is provided through hospices. Such care has developed outside of general healthcare and is commonly provided in a patient's home or in dedicated facilities. Hospice provision may need to increase in the future due to an ageing population with a greater need for access to end-of-life care. In this systematic review we sought to identify the current evidence on (1) the effectiveness, including cost-effectiveness, of hospices, and hospice care in a patient's home and in nursing homes and (2) the experiences of those who use and of those who provide such services. We included quantitative and qualitative studies on hospice care that was provided in a patient's home, nursing home or hospice. We did not include studies on end-of-life care that was provided as part of general healthcare provision, such as by general practitioners in primary care, community nurses or within general hospitals. For quantitative evaluations we included only those that compared hospice care with usual generalist healthcare. The databases CINAHL, MEDLINE, EMBASE, and The Cochrane Library were searched from 2003 to 2009. Evidence was assessed for quality and data extractions double-checked. For quantitative studies we present the outcome data comparing hospice versus usual care. For qualitative evaluations we organise findings thematically. Eighteen comparative evaluations and four thematic papers were identified. Quantitative evidence, mostly of limited quality in design, showed that hospice care at home reduced general health care use and increased family and patient satisfaction with care. Main themes in the qualitative literature revealed that home hospice services support families to sustain patient care at home and hospice day care services generate for the patient a renewed sense of meaning and purpose. Although studies had methodological limitations, in this review we found much evidence to support the benefits of hospice care. There were limited evaluations found on the impact of hospice care on psychological well-being, such as symptoms of depression, and on inpatient hospice care and non-hospital related costs. Copyright © 2010 Elsevier Ltd. All rights reserved.

Incorporating Cultural Perspectives into Diabetes Self-Management Programs for East Asian Immigrants: A Mixed-Study Review.

PubMed

Park, Chorong; Nam, Soohyun; Whittemore, Robin

2016-04-01

It is important to understand East Asian immigrants (EAIs)' unique perspectives in managing diabetes in order to provide culturally-competent care. However, it is not known whether EAIs' perspectives are addressed in diabetes self-management interventions developed for EAIs. Therefore, a mixed-study review was conducted to identify EAIs' perspective from qualitative research (n = 9 studies) and to evaluate the components of EAI diabetes self-management interventions (n = 7). Themes from the qualitative synthesis demonstrated that EAIs have unique cultural values and traditional health beliefs while struggling with multi-contextual barriers due to immigration. The evaluation of EAI diabetes self-management interventions revealed that there was a lack of consensus on cultural strategies for EAIs' across the interventions. Addressing language barriers was the only factor consistently integrated in the cultural components of intervention by employing bilingual interventionists. EAIs' perspectives and experiences need to be incorporated in the future diabetes self-management interventions to better provide culturally-competent care.

“We Are Now Free to Speak”: Qualitative Evaluation of an Education and Empowerment Training for HIV Patients in Namibia

PubMed Central

MacLachlan, Ellen W.; Potter, Katy; Hamunime, Ndapewa; Shepard-Perry, Mark G.; Uusiku, James; Simwanza, Ricky; Brandt, Laura J.; O’Malley, Gabrielle

2016-01-01

Although numerous studies provide evidence that active patient engagement with health care providers improves critical outcomes such as medication adherence, very few of these have been done in low resource settings. In Namibia, patient education and empowerment trainings were conducted in four antiretroviral (ART) clinics to increase patient engagement during patient-provider interactions. This qualitative study supplements findings from a randomized controlled trial, by analyzing data from 10 in-depth patient interviews and 94 training evaluation forms. A blended approach of deductive and inductive coding was used to understand training impact. Findings indicated the trainings increased patients’ self-efficacy through a combination of improved HIV-related knowledge, greater communication skills and enhanced ability to overcome complex psychosocial barriers, such as fear of speaking up to providers. This study suggests patient empowerment training may be a powerful method to engage HIV patients in their own care and treatment. PMID:27054712

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety

PubMed Central

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative–reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research. PMID:26297629

Peer-led and professional-led group interventions for people with co-occurring disorders: a qualitative study.

PubMed

Pallaveshi, Luljeta; Balachandra, Krishna; Subramanian, Priya; Rudnick, Abraham

2014-05-01

This pilot study evaluated the experience of people with co-occurring disorders (mental illness and addiction) in relation to peer-led and professional-led group interventions. The study used a qualitative (phenomenological) approach to evaluate the experience of a convenience sample of 6 individuals with co-occurring disorders who participated in up to 8 sessions each of both peer-led and professional-led group interventions (with a similar rate of attendance in both groups). The semi-structured interview data were coded and thematically analyzed. We found 5 themes within and across the 2 interventions. In both groups, participants experienced a positive environment and personal growth, and learned, albeit different things. They were more comfortable in the peer-led group and acquired more knowledge and skills in the professional-led group. Offering both peer-led and professional-led group interventions to people with co-occurring disorders may be better than offering either alone.

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety.

PubMed

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative-reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research.

Does Professional Development School Preparation Make a Difference? A Comparison of Three Teacher Candidate Studies

ERIC Educational Resources Information Center

Castle, Sharon; Fox, Rebecca K.; Fuhrman, Caroline

2009-01-01

The article compares three replication studies that explore potential differences between teacher candidates trained in professional development schools and those trained in a traditional program. Data sources included student teaching evaluations (analyzed quantitatively) and portfolio reflections, oral and written (analyzed qualitatively). The…

Investigating Peer Tutoring

ERIC Educational Resources Information Center

Mynard, Jo; Almarzouqi, Iman

2006-01-01

This article gives an overview of a piece of qualitative research conducted at a women's university in the United Arab Emirates. The aim of the study was to evaluate the English language peer tutoring programme in order to highlight benefits and challenges, and to make informed improvements. The study drew particularly on participant perceptions…

Motivating Factors for Philanthropy at a Ministry Preparation Graduate Institution

ERIC Educational Resources Information Center

Reimer, Jay Paul

2013-01-01

A qualitative case study was conducted to determine whether major donors to an institution of higher education that existed to prepare ministers and missionaries were perceived by the institution's leaders as motivated by organizational effectiveness, financial efficiency, or evaluations by donor watchdog agencies. The case study was conducted…

Examining First Grade Teachers' Handwriting Instruction

ERIC Educational Resources Information Center

Arslan, Derya

2012-01-01

The purpose of this study is to examine the first grade teachers' practices of handwriting instructions in terms of teaching, evaluation and handwriting difficulties. From qualitative research patterns, phenomenology was used. The study was applied to the 54 First grade teachers who work at central Burdur and Burdur county centre primary education…

Peer Instruction: An Evaluation of Its Theory, Application, and Contribution

ERIC Educational Resources Information Center

Gok, Tolga; Gok, Ozge

2017-01-01

Many qualitative and quantitative studies performed on peer instruction based on interactive engagement method used in many different disciplines and courses were reviewed in the present study. The researchers examined the effects of peer instruction on students' cognitive skills (conceptual learning, problem solving, reasoning ability, etc.) and…

Elementary General Music Teachers' Reflections on Instruction

ERIC Educational Resources Information Center

Delaney, Diane W.

2011-01-01

A qualitative study was completed to identify and study the content of selected elementary general music teachers' evaluations of their own instruction and the instruction of another elementary general music teacher. Participants represented a variety of educational backgrounds and teaching experience: Teacher A (9 years teaching Grades 4-6 at…

Effective Practice in Inclusive and Special Needs Education

ERIC Educational Resources Information Center

Buli-Holmberg, Jorun; Jeyaprathaban, Sujathamalini

2016-01-01

The present study attempts to evaluate the effective teaching practice for children with special learning needs. The research question framed in the present study for investigation is which practice will be effective in different inclusive classroom settings and what are the factors that contribute for effective practices? Qualitative research was…

Case Study: eCoaching in a Corporate Environment

ERIC Educational Resources Information Center

Warner, Teri L. C.

2012-01-01

This qualitative particularistic case study was an exploration and evaluation of an online, asynchronous, non-human coaching system called an "eCoaching system." Developed by the researcher, the eCoaching system combined performance coaching with the latest technologies in eLearning. The coaching was based on the appreciative inquiry approach, and…

Improving Intelligibility: Guided Reflective Journals in Action

ERIC Educational Resources Information Center

Lear, Emmaline L.

2014-01-01

This study explores the effectiveness of guided reflective journals to improve intelligibility in a Japanese higher educational context. Based on qualitative and quantitative methods, the paper evaluates changes in speech over the duration of one semester. In particular, this study focuses on changes in prosodic features such as stress, intonation…

Educational Innovations as Staff Development: An Evaluative Approach.

ERIC Educational Resources Information Center

Marcelo, Carlos; And Others

1996-01-01

Reports a study that analyzed the processes of educational innovation in seven projects in the Andalusian region of Spain. Using qualitative and quantitative methods, the study determined that the quality of the impact of innovation on students, teachers, schools, and communities was determined by the original source, the relationship to perceived…

Secondary Teachers' Understanding and Use of Reflection: An Exploratory Study

ERIC Educational Resources Information Center

Laverick, Vincent T.

2017-01-01

As teachers are examining methods to improve their practices due to teacher evaluation systems that incorporate student growth, a renewed focus has been placed on teacher effectiveness. Because reflective teachers have been shown to be more effective, this qualitative study examined the understanding of reflection among five secondary school…

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review. PMID:17325406

Strategies for Managing Nursing Students’ Incivility as Experienced by Nursing Educators: a Qualitative Study

PubMed Central

Rad, Mostafa; Karimi Moonaghi, Hossein

2016-01-01

Introduction: Students’ incivility is an impolite and disturbing behavior in education and if ignored could lead to behavioral complexities and eventually violence and aggression in classrooms. This study aimed to reveal the experiences of Iranian educators regarding the management of such behaviors. Methods: In this qualitative study, qualitative content analysis method was used to evaluate the experiences and perceptions of nursing educators and students. A total of 22 persons (14 educators and 8 students) were selected through purposive sampling and individually interviewed. Results: Categories of unification of educators regarding behavioral management, teaching-learning strategy, friendship strategy and training through role playing, authority, appropriative decision-making and freedom, stronger relationships between students, reflection, and interactive educational environment were some strategies used by teachers for management of incivility. Conclusion: Educators suggested some strategies which could be used depending on uniqueness of behaviors and given situation. Educators and managers of medical fields can use these approaches in their classrooms to control uncivil behaviors. PMID:26989663

Barriers and facilitators in health education for adults with intellectual disabilities--a qualitative study.

PubMed

Bergström, H; Elinder, L S; Wihlman, U

2014-04-01

The aim of this study was to explore barriers and facilitators in the implementation of a health course for adults with mild or moderate intellectual disabilities. An inductive qualitative design was used. Data were collected from a health course conducted in 16 study groups with 83 participants in Stockholm, Sweden by unstructured observations in course sessions, a group discussion with course leaders and evaluation notes from the course leaders. The data were analysed by qualitative content analysis. Four categories were identified: (i) 'individual characteristics', implying various needs, (ii) 'pedagogical strategies' used to meet those needs, (iii) 'interaction within the course', dealing with active and less active participation and (iv) 'structures', including learning climate and organizing. The overarching theme 'creating an individualized supportive context' describes the challenge of educating people with intellectual disabilities towards an empowered and well informed decision making regarding their own health. Therefore, there is a need for support not only within the course but also from the social and physical environment as well.

Patient perspective on quality of geriatric care and rehabilitation--development and psychometric testing of a questionnaire.

PubMed

Wressle, Ewa; Eriksson, Lennart; Fahlander, Amie; Rasmusson, Ing-Marie; Tedemalm, Ulla; Tängmark, Karin

2006-06-01

The aim was to develop and test a questionnaire for use in telephone interviews concerning patient evaluation of geriatric care and rehabilitation. Instrument development was performed comprising qualitative interviews, construction of items, content validation, pilot study and data collection for evaluation of care and rehabilitation, clinical utility, reliability and construct validity. Qualitative interviews were performed with 12 elderly participants. The qualitative interviews formed the basis for the construction of 45 items. An expert panel performed a content validation of the questionnaire resulting in a revised version. A pilot study comprised 29 participants recently discharged from geriatric wards and the main data collection comprised 221 participants. Inclusion criteria were being able to perform a telephone interview and willingness to participate. Clinical utility was examined through questions to the interviewers, answered in writing. Cronbach's alpha coefficient was 0.79. According to a factor analysis and the evaluation of clinical utility, the underlying dimensions of the final revised questionnaire concern 'Respect and safety', 'Information and participation' and 'Rehabilitation interventions', scored in 18 items. In addition, one global item concerns satisfaction with care, resulting in 19 items in total. The revised questionnaire was named PaPeR, Patient Perspective on care and Rehabilitation. The questionnaire is considered valid, reliable and judged to have good clinical utility. The time consumption for the telephone interview is about 10-20 minutes. The questionnaire is useful in defining areas for potential quality improvement in geriatric wards.

Exploring the barriers of quitting smoking during pregnancy: a systematic review of qualitative studies.

PubMed

Ingall, Georgina; Cropley, Mark

2010-06-01

Smoking during pregnancy is widely known to increase health risks to the foetus, and understanding the quitting process during pregnancy is essential in order to realise national government targets. Qualitative studies have been used in order to gain a greater understanding of the quitting process and the objective of this systematic review was to examine and evaluate qualitative studies that have investigated the psychological and social factors around women attempting to quit smoking during pregnancy. Electronic databases and journals were searched with seven articles included in this review. The findings demonstrated that women were aware of the health risks to the foetus associated with smoking; however knowledge of potential health risks was not sufficient to motivate them to quit. Several barriers to quitting were identified which included willpower, role, and meaning of smoking, issues with cessation provision, changes in relationship interactions, understanding of facts, changes in smell and taste and influence of family and friends. A further interesting finding was that cessation service provision by health professionals was viewed negatively by women. It was concluded that there is a shortage of qualitative studies that concentrate on the specific difficulties that pregnant women face when trying to quit smoking. 2009 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

An exploratory qualitative analysis of student midwives views of teaching methods that could build their confidence to deliver perinatal bereavement care.

PubMed

Martin, Caroline J Hollins; Robb, Yvonne; Forrest, Eleanor

2016-04-01

Equipping student midwives with confidence to deliver bereavement care to childbearing women is a challenge for midwifery lecturers. To explore qualitative data provided by student midwives who evaluated the workbook Bereavement care for childbearing women and their families (Hollins Martin & Forrest, 2013) to explore their views of potential teaching strategies that could build their confidence to deliver real bereavement care. An exploratory qualitative thematic analysis was used to provide, analyse and report themes identified within data collected in a prior study. Participants were student midwives (n=179) in their second/third year of a midwifery degree program at 1 of 3 universities in the UK were included in the study. Data to evaluate effectiveness of the bereavement workbook as a teaching method was collected using a survey instrument. It was the comments written under questions by participants that were analysed in the present study. Three themes emerged: (1) increasing classroom interaction, (2) the importance of reflecting on emotions, and (3) need for experience. Although this study has addressed delivery of education that relates to midwives, the findings are cross transferable to other healthcare educators, practitioners, and students. Several solutions are proposed that could potentially build student confidence to deliver bereavement care: lecturers should (1) encourage group discussion in the classroom to help build student confidence to emotionally cope during real bereavement events; (2) ensure students gain exposure by encouraging qualified midwives to include them in real bereavement events early on in their training, and (3) develop packages of perinatal bereavement scenarios for simulation and rehearsal in the clinical skills laboratory. Post-implementation, it is recommended that these teaching strategies be evaluated. Copyright © 2016 Elsevier Ltd. All rights reserved.

The evaluation of a healthcare passport to improve quality of care and communication for people living with dementia (EQuIP): a protocol paper for a qualitative, longitudinal study.

PubMed

Leavey, Gerard; Abbott, Aine; Watson, Max; Todd, Stephen; Coates, Vivien; McIlfactrick, Sonja; McCormack, Brendan; Waterhouse-Bradley, Bethany; Curran, Emma

2016-08-09

There is an urgent need for the development of simple communication tools that convey the strengths, assets, and healthcare needs of people living with dementia. A Healthcare Passport may improve communication with range of health and social support services, enhancing quality and continuity of care, and to permit a consideration of the challenges and how these might be managed effectively and compassionately. This study aims to evaluate the acceptability and use of this type of intervention for people living with dementia and their carers. This is a qualitative longitudinal study informed by a critical realist review. The participants will be individuals identified as having mild-moderate dementia and informal carers. The in-depth interviews will occur at three points over the course of 18 months as they use the passport. This will be supplemented by analysis of the content of the passports and information from health and social care providers on the daily practicalities of using the passport in a range of healthcare settings. By using a critical realist review and a qualitative, longitudinal approach, the study allows for the assessment of a complex intervention in a manner which goes beyond evaluating the basic efficacy of the passport, but looking more deeply at how it worked, for whom, and in what context. It has the potential to develop new data on how interventions improve communication across a range of service providers, while encouraging health and social care professionals to respect and encourage the development of self-management and retention of personhood throughout the progression of life-limiting illnesses.

Examination of Social Studies Curriculum and Course Books in the Context of Global Citizenship

ERIC Educational Resources Information Center

Karakus, Mehmet; Türkkan, Buket Turhan; Öztürk, Fikriye

2017-01-01

The document review method, which is a qualitative research method, was used in this study that aims to examine the social studies curriculum and course books in terms of attainments, teaching-learning process and measurement-evaluation process in the context of global citizenship. Furthermore, opinions of social studies teachers on the curriculum…

Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, Enhanced Pearson eText with Loose-Leaf Version--Access Card Package. Fifth Edition

ERIC Educational Resources Information Center

Creswell, John W.

2015-01-01

"Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research" offers a truly balanced, inclusive, and integrated overview of the processes involved in educational research. This text first examines the general steps in the research process and then details the procedures for conducting specific types…

Evaluation of the "Respect Not Risk" firearm safety lesson for 3rd-graders.

PubMed

Liller, Karen D; Perrin, Karen; Nearns, Jodi; Pesce, Karen; Crane, Nancy B; Gonzalez, Robin R

2003-12-01

The purpose of this study was to evaluate the MORE HEALTH "Respect Not Risk" Firearm Safety Lesson for 3rd-graders in Pinellas County, Florida. Six schools representative of various socioeconomic levels were selected as the test sites. Qualitative and quantitative data were collected. A total of 433 matched pretests/posttests were used to determine the effectiveness of the class in increasing student knowledge about firearm safety. The results revealed a significant increase in the mean scores on the posttest compared with the pretest. Qualitative findings showed the lesson was positively received by both students and teachers, and 65% of responding students reported discussing the lesson with family members. School nurses are encouraged to take a leading role in promoting firearm injury prevention to students.

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

A qualitative evaluation of a comprehensive self-management programme for COPD patients: effectiveness from the patients' perspective.

PubMed

Monninkhof, Evelyn; van der Aa, Maaike; van der Valk, Paul; van der Palen, Job; Zielhuis, Gerhard; Koning, Karen; Pieterse, Marcel

2004-11-01

The COPE self-management programme, including a self-management education course, self-treatment of exacerbations and a fitness programme, appeared to have no significant effect on health related quality of life (HRQoL) as measured by the St. George's Respiratory Questionnaire (SGRQ). This is in contrast to our hypothesis and despite expressions of satisfaction of patients to healthcare workers. To understand this discrepancy, a qualitative study was performed. A purposive sample of 20 participants of the COPE self-management programme were interviewed at home using in-depth, semi-structured interviews. Interviews were audio taped and transcribed verbatim and analysed according grounded theory. The fitness programme was most positively evaluated by patients due to the perceived increase of exercise capacity and the social aspect of the group training. Major effects gained by the self-management education course reported by patients were the skills to evenly distribute their energy and to listen to their body signals. Most patients thought favourable about self-treatment of exacerbations. The possibility to start early, not having to call a doctor and autonomy were raised as important advantages. Furthermore, several patients reported increased self-confidence and coping behaviour as important effects of the COPE programme. Finally, many patients reported feeling safe due to the frequent follow-up visits and 24h access to the hospital, and this aspect elicited to be very important. In this study, the qualitative interviews suggest that the SGRQ and possibly other existing HRQoL instruments might fail to capture the full experience of patients in self-management studies. The need for more elaborate qualitative research on this subject is indicated.

The effect and importance of physical activity on behavioural and psychological symptoms in people with dementia: A systematic mixed studies review.

PubMed

Junge, Tina; Ahler, Jonas; Knudsen, Hans K; Kristensen, Hanne K

2018-01-01

Background People with dementia may benefit from the effect of physical activity on behavioural and psychological symptoms of dementia. Qualitative synthesis of the importance of physical activity might complement and help clarify quantitative findings on this topic. The purpose of this systematic mixed studies review was to evaluate findings from both quantitative and qualitative methods about the effect and importance of physical activity on behavioural and psychological symptoms of dementia in people with dementia. Methods The systematic literature search was conducted in EMBASE, CINAHL, PubMed, PEDro and PsycINFO. Inclusion criteria were: people with a light to moderate degree of dementia, interventions including physical activity and outcomes focusing on behavioural and psychological symptoms of dementia or quality of life. To assess the methodological quality of the studies, the AMSTAR and GRADE checklists were applied for the quantitative studies and the CASP qualitative checklist for the qualitative studies. Results A small reduction in depression level and improved mood were seen in some quantitative studies of multi-component physical activity interventions, including walking. Due to high heterogeneity in the quantitative studies, a single summary of the effect of physical activity on behavioural and psychological symptoms of dementia should be interpreted with some caution. Across the qualitative studies, the common themes about the importance of physical activity were its 'socially rewarding' nature, the 'benefits of walking outdoors' and its contribution to 'maintaining self-hood'. Conclusion For people with dementia, there was a small, quantitative effect of multi-component physical activity including walking, on depression level and mood. People with dementia reported the importance of walking outdoors, experiencing the social rewards of physical activity in groups, as well as physical activity were a means toward maintaining self-hood.

Nurses' shift reports: a systematic literature search and critical review of qualitative field studies.

PubMed

Buus, Niels; Hoeck, Bente; Hamilton, Bridget Elizabeth

2017-10-01

To identify reporting practices that feature in studies of nurses' shift reports across diverse nursing specialities. The objectives were to perform an exhaustive systematic literature search and to critically review the quality and findings of qualitative field studies of nurses' shift reports. Nurses' shift reports are routine occurrences in healthcare organisations that are viewed as crucial for patient outcomes, patient safety and continuity of care. Studies of communication between nurses attend primarily to 1:1 communication and analyse the adequacy and accuracy of patient information and feature handovers at the bedside. Still, verbal reports between groups of nurses about patients are commonplace. Shift reports are obvious sites for studying the situated accomplishment of professional nursing at the group level. This review is focused exclusively on qualitative field research for nuanced and contextualised insights into nurses' everyday shift reporting practices. The study is a systematic literature search and critical review of qualitative field analyses of nurses' shift reports. We searched in the databases CIHAHL, PubMed and PsycINFO and identified and reviewed 19 articles published 1992-2014. Data were systematically extracted using criteria for the evaluation of qualitative research reports. The studies described shift report practices and identified several factors contributing to distribution of clinical knowledge. Shift report practices were described as highly conventionalised and locally situated, but with occasional opportunities for improvisation and negotiation between nurses. Finally, shift reports were described as multifunctional meetings, with individual and social effects for nurses and teams. Innovations in between-shift communications can benefit from this analysis, by providing for the many functions of handovers that are revealed in field studies. Leaders and practising nurses may consider what are the best opportunities for nurses to work up clinical knowledge and negotiate care. © 2016 John Wiley & Sons Ltd.

Big fish in a big pond: a study of academic self concept in first year medical students.

PubMed

Jackman, Kirsty; Wilson, Ian G; Seaton, Marjorie; Craven, Rhonda G

2011-07-27

Big-fish-little-pond effect (BFLPE) research has demonstrated that students in high-ability environments have lower academic self-concepts than equally able students in low-ability settings. Research has shown low academic self-concepts to be associated with negative educational outcomes. Social comparison processes have been implicated as fundamental to the BFLPE. Twenty first-year students in an Australian medical school completed a survey that included academic self-concept and social comparison measures, before and after their first written assessments. Focus groups were also conducted with a separate group of students to explore students' perceptions of competence, the medical school environment, and social comparison processes. The quantitative study did not reveal any changes in academic self-concept or self-evaluation. The qualitative study suggested that the attributions that students used when discussing performance were those that have been demonstrated to negatively affect self-concept. Students reported that the environment was slightly competitive and they used social comparison to evaluate their performance. Although the BFLPE was not evident in the quantitative study, results from the qualitative study suggest that the BFLPE might be operating In that students were using attributions that are associated with lower self-concepts, the environment was slightly competitive, and social comparisons were used for evaluation.

Land Mobile Satellite Service (LMSS) channel simulator: An end-to-end hardware simulation and study of the LMSS communications links

NASA Technical Reports Server (NTRS)

Salmasi, A. B. (Editor); Springett, J. C.; Sumida, J. T.; Richter, P. H.

1984-01-01

The design and implementation of the Land Mobile Satellite Service (LMSS) channel simulator as a facility for an end to end hardware simulation of the LMSS communications links, primarily with the mobile terminal is described. A number of studies are reported which show the applications of the channel simulator as a facility for validation and assessment of the LMSS design requirements and capabilities by performing quantitative measurements and qualitative audio evaluations for various link design parameters and channel impairments under simulated LMSS operating conditions. As a first application, the LMSS channel simulator was used in the evaluation of a system based on the voice processing and modulation (e.g., NBFM with 30 kHz of channel spacing and a 2 kHz rms frequency deviation for average talkers) selected for the Bell System's Advanced Mobile Phone Service (AMPS). The various details of the hardware design, qualitative audio evaluation techniques, signal to channel impairment measurement techniques, the justifications for criteria of different parameter selection in regards to the voice processing and modulation methods, and the results of a number of parametric studies are further described.

Experiences of disability consumer-directed care users in Australia: results from a longitudinal qualitative study.

PubMed

Ottmann, Goetz; Laragy, Carmel; Haddon, Michelle

2009-09-01

The rapidly growing body of literature suggests that Consumer-directed Care (CDC) has the potential to empower consumers and improve the flexibility and quality of care. However, reports highlighting quality and risk concerns associated with CDC focusing on a longer time frame have been few. This paper presents the findings from a qualitative longitudinal evaluation of an Australian CDC programme. Focusing on the period between 2003 and 2008, it reports on the experiences of 12 families caring for a dependent family member. It is based on two external evaluations completed 6 and 36 months after enrollment, and one internal evaluation completed 48 months after enrollment. The findings were triangulated with internal memos, reports and minutes of meetings, as well as with the theoretical literature. The study demonstrates that CDC harbours considerable benefits for people with disabilities and their carers. However, the study also suggests that, over time, carers may experience an increased sense of isolation and lack of support as a result of their involvement in the CDC programme. The paper argues that the development of safeguards addressing these weaknesses is crucial for the sustainability of CDC programmes in contexts where risk cannot be simply transferred onto consumers.

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

Which learning activities enhance physiotherapy practice? A systematic review protocol of quantitative and qualitative studies.

PubMed

Leahy, Edmund; Chipchase, Lucy; Blackstock, Felicity

2017-04-17

Learning activities are fundamental for the development of expertise in physiotherapy practice. Continuing professional development (CPD) encompasses formal and informal learning activities undertaken by physiotherapists. Identifying the most efficient and effective learning activities is essential to enable the profession to assimilate research findings and improve clinical skills to ensure the most efficacious care for clients. To date, systematic reviews on the effectiveness of CPD provide limited guidance on the most efficacious models of professional development for physiotherapists. The aim of this systematic review is to evaluate which learning activities enhance physiotherapy practice. A search of Ovid MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO (Psychological Abstracts), PEDro, Cochrane Library, AMED and Educational Resources and Information Center (ERIC) will be completed. Citation searching and reference list searching will be undertaken to locate additional studies. Quantitative and qualitative studies will be included if they examine the impact of learning activities on clinician's behaviour, attitude, knowledge, beliefs, skills, self-efficacy, work satisfaction and patient outcomes. Risk of bias will be assessed by two independent researchers. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) and Confidence in the Evidence from Reviews of Qualitative research (CERQual) will be used to synthesise results where a meta-analysis is possible. Where a meta-analysis is not possible, a narrative synthesis will be conducted. PROSPERO CRD42016050157.

Emergency contraception: why can't you give it away? Qualitative findings from an evaluation of advance provision of emergency contraception.

PubMed

Fairhurst, Karen; Ziebland, Sue; Wyke, Sally; Seaman, Peter; Glasier, Anna

2004-07-01

The Lothian Emergency Contraception Project (LECP)--a primary care-based intervention to offer advance supplies of emergency contraception (EC) to women aged 16-29 was not associated with a reduction in abortion rates. We undertook case studies, utilizing qualitative and quantitative methods, to evaluate the intervention. In this article we present findings from qualitative interviews with 44 primary care professionals working at case study sites and 22 women who had received advance supplies to explain this failure. Professionals reported that women rarely asked for advance supplies of EC and they were reluctant to offer supplies to women because of concerns about contradictory sexual health messages implied by the offer, a perceived association of EC use with chaotic behavior by women, views about the sort of women suitable for advance supplies and practical difficulties making the offer. Women were reluctant to ask for advance supplies because of misgivings about the appropriateness of offering advance supplies to everybody and concerns about being judged by health professionals as morally inadequate. If advance provision of EC is to be successful in reducing abortion rates, professionals must address their concerns about EC and develop imaginative ways of encouraging women most at risk of unwanted pregnancy to take supplies home.

Evaluation of an international and interprofessional collaboration forum.

PubMed

Stone, Teresa; Hua, Susan; Turale, Sue

2016-11-01

International and interprofessional collaborations are increasingly becoming a core requirement for health professionals in our globalized world. The aim of this study was to evaluate the effectiveness of the Asia Pacific Alliance of Health Leaders (APAHL) Forum to enhance the development of international perspectives and leadership among students and faculty in the discipline of health. This pilot study used a student-designed questionnaire to evaluate the views of students and faculty members about the effectiveness of APAHL in meeting its goals. Quantitative data from the scaled items on the questionnaire were analyzed by aggregating the data. Qualitative data were analyzed using a qualitative descriptive approach. Study participants comprised of 22 health science (nursing and laboratory science) students and 15 faculty members. Both faculty and students agreed that APAHL was effective in leadership development of students, as well as in advancing internationalization, interprofessional collaboration, and cultural awareness among students. A clear theme among the students was acknowledgement of the importance of communication, in particular being proficient in English. Difficulties in communication were an issue for both students and faculty members. This pilot study has shown the benefits of a student-focused international forum in developing cross-cultural awareness, and will provide the groundwork for evaluating the effectiveness of cross-cultural and interprofessional leadership forums aimed particularly at students of health. Copyright © 2016 Elsevier Ltd. All rights reserved.

77 FR 6471 - Bacillus thuringiensis Cry2Ae Protein in Cotton; Exemption from the Requirement of a Tolerance

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-08

... analytical method using enzyme- linked immunosorbent assay (ELISA) analyses for the qualitative detection of... study conducted by an independent third party laboratory to evaluate the ELISA test kit's performance as...

Railroad classification yard technology : assessment of car speed control systems

DOT National Transportation Integrated Search

1980-12-01

The scope of this study has encompassed an evaluation of fourteen yard speed : control devices, an identification of four generic speed control systems, a : qualitative assessment of the four systems, and finally a quantitative analysis : of three hy...

Assessing locomotor skills development in childhood using wearable inertial sensor devices: the running paradigm.

PubMed

Masci, Ilaria; Vannozzi, Giuseppe; Bergamini, Elena; Pesce, Caterina; Getchell, Nancy; Cappozzo, Aurelio

2013-04-01

Objective quantitative evaluation of motor skill development is of increasing importance to carefully drive physical exercise programs in childhood. Running is a fundamental motor skill humans adopt to accomplish locomotion, which is linked to physical activity levels, although the assessment is traditionally carried out using qualitative evaluation tests. The present study aimed at investigating the feasibility of using inertial sensors to quantify developmental differences in the running pattern of young children. Qualitative and quantitative assessment tools were adopted to identify a skill-sensitive set of biomechanical parameters for running and to further our understanding of the factors that determine progression to skilled running performance. Running performances of 54 children between the ages of 2 and 12 years were submitted to both qualitative and quantitative analysis, the former using sequences of developmental level, the latter estimating temporal and kinematic parameters from inertial sensor measurements. Discriminant analysis with running developmental level as dependent variable allowed to identify a set of temporal and kinematic parameters, within those obtained with the sensor, that best classified children into the qualitative developmental levels (accuracy higher than 67%). Multivariate analysis of variance with the quantitative parameters as dependent variables allowed to identify whether and which specific parameters or parameter subsets were differentially sensitive to specific transitions between contiguous developmental levels. The findings showed that different sets of temporal and kinematic parameters are able to tap all steps of the transitional process in running skill described through qualitative observation and can be prospectively used for applied diagnostic and sport training purposes. Copyright © 2012 Elsevier B.V. All rights reserved.

Adapting continuing medical education for post-conflict areas: assessment in Nagorno Karabagh - a qualitative study.

PubMed

Balalian, Arin A; Simonyan, Hambardzum; Hekimian, Kim; Crape, Byron

2014-08-06

One of the major challenges in the current century is the increasing number of post-conflict states where infrastructures are debilitated. The dysfunctional health care systems in post-conflict settings are putting the lives of the populations in these zones at increased risk. One of the approaches to improve such situations is to strengthen human resources by organizing training programmes to meet the special needs in post-conflict zones. Evaluations of these training programmes are essential to assure effectiveness and adaptation to the health service needs in these conditions. A specialized qualitative evaluation was conducted to assess and improve a post-conflict continuing medical education (CME) programme that was conducted in Nagorno Karabagh. Qualitative research guides were designed for this post-conflict zone that included focus group discussions with physician programme participants and semi-structured in-depth interviews with directors of hospitals and training supervisors. Saturation was achieved among the three participating groups in the themes of impact of participation in the CME and obstacles to application of obtained skills. All respondents indicated that the continuing medical education programme created important physician networks absent in this post-conflict zone, updated professional skills, and improved professional confidence among participants. However, all respondents indicated that some skills gained were inapplicable in Nagorno Karabagh hospitals and clinics due to lack of appropriate medical equipment, qualified supporting human resources and facilities. The qualitative research methods evaluation highlighted the fact that the health care human resources training should be closely linked to appropriate technologies, supplies, facilities and human resources available in post-conflict zones and identified the central importance of creating health professional networks and professional confidence among physicians in these zones. The qualitative research approach most effectively identifies these limitations and strengths and can directly inform the optimal adjustments for effective CME planning in these difficult areas of greatest need.

Integrative Reiki for cancer patients: a program evaluation.

PubMed

Fleisher, Kimberly A; Mackenzie, Elizabeth R; Frankel, Eitan S; Seluzicki, Christina; Casarett, David; Mao, Jun J

2014-01-01

This mixed methods study sought to evaluate the outcomes of an integrative Reiki volunteer program in an academic medical oncology center setting. We used de-identified program evaluation data to perform both quantitative and qualitative analyses of participants' experiences of Reiki sessions. The quantitative data were collected pre- and postsession using a modified version of the distress thermometer. The pre- and postsession data from the distress assessment were analyzed using a paired Student's : test. The qualitative data were derived from written responses to open-ended questions asked after each Reiki session and were analyzed for key words and recurring themes. Of the 213 pre-post surveys of first-time sessions in the evaluation period, we observed a more than 50% decrease in self-reported distress (from 3.80 to 1.55), anxiety (from 4.05 to 1.44), depression (from 2.54 to 1.10), pain (from 2.58 to 1.21), and fatigue (from 4.80 to 2.30) with P < .001 for all. Using conservative estimates that treat missing data as not endorsing Reiki, we found 176 (82.6%) of participants liked the Reiki session, 176 (82.6%) found the Reiki session helpful, 157 (73.7%) plan to continue using Reiki, and 175 (82.2%) would recommend Reiki to others. Qualitative analyses found that individuals reported that Reiki induced relaxation and enhanced spiritual well-being. An integrative Reiki volunteer program shows promise as a component of supportive care for cancer patients. More research is needed to evaluate and understand the impact that Reiki may have for patients, caregivers, and staff whose lives have been affected by cancer.

Supplementary search methods were more effective and offered better value than bibliographic database searching: A case study from public health and environmental enhancement.

PubMed

Cooper, Chris; Lovell, Rebecca; Husk, Kerryn; Booth, Andrew; Garside, Ruth

2018-06-01

We undertook a systematic review to evaluate the health benefits of environmental enhancement and conservation activities. We were concerned that a conventional process of study identification, focusing on exhaustive searches of bibliographic databases as the primary search method, would be ineffective, offering limited value. The focus of this study is comparing study identification methods. We compare (1) an approach led by searches of bibliographic databases with (2) an approach led by supplementary search methods. We retrospectively assessed the effectiveness and value of both approaches. Effectiveness was determined by comparing (1) the total number of studies identified and screened and (2) the number of includable studies uniquely identified by each approach. Value was determined by comparing included study quality and by using qualitative sensitivity analysis to explore the contribution of studies to the synthesis. The bibliographic databases approach identified 21 409 studies to screen and 2 included qualitative studies were uniquely identified. Study quality was moderate, and contribution to the synthesis was minimal. The supplementary search approach identified 453 studies to screen and 9 included studies were uniquely identified. Four quantitative studies were poor quality but made a substantive contribution to the synthesis; 5 studies were qualitative: 3 studies were good quality, one was moderate quality, and 1 study was excluded from the synthesis due to poor quality. All 4 included qualitative studies made significant contributions to the synthesis. This case study found value in aligning primary methods of study identification to maximise location of relevant evidence. Copyright © 2017 John Wiley & Sons, Ltd.

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

An Investigation into the Development, Implementation, and Evaluation of Online Learning Programs for Small Rural Public Schools in Texas

ERIC Educational Resources Information Center

Tabor, Bruce

2012-01-01

This qualitative study investigated the experiences of 10 superintendents in Pre-K-8, 1A, and small 2A schools located in rural areas of Texas, who have implemented an online learning program or programs. Narrative techniques were used to explore the challenges that they faced in the pre-planning, planning, implementation and evaluation of their…

A Qualitative Evaluation of a Healthy Cookery Course in Ireland Designed for Adults with Mild to Moderate Intellectual Disability

ERIC Educational Resources Information Center

Bennett, Annemarie E.; Cunningham, Cara

2014-01-01

Adults with an intellectual disability have poorer diets than the general adult population. The "Able 2 Cook 4 Health" cookery course aims to improve the diets of adults with mild to moderate intellectual disability. This study aims to evaluate the course by obtaining the views of course participants and the views of managers hosting the…

Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centred Instructional Program in Indonesia

ERIC Educational Resources Information Center

Rahayu, Sri; Chandrasegaran, A. L.; Treagust, David F.; Kita, Masakazu; Ibnu, Suhadi

2011-01-01

This study was a mixed quantitative-qualitative research to evaluate the efficacy of a designed student-centred instructional (DSCI) program for teaching about acids and bases. The teaching innovation was designed based on constructivist, hands-on inquiry and context-based approaches and implemented in seven 45-min lessons with a class of 36 grade…

Occupational Safety and Health Professionals' Training in Italy: Qualitative Evaluation Using T-LAB

ERIC Educational Resources Information Center

Papaleo, Bruno; Cangiano, Giovanna; Calicchia, Sara

2013-01-01

Purpose: The purpose of this paper is to describe the evaluation of a training course on chemicals for occupational safety and health (OSH) professionals. The study aims were to assess the effectiveness of the course; to find out what type of training met these workers' needs best, as their role is vital in the management of safety at work; and to…

Evaluating Bang for the Buck: A Cost-Effectiveness Comparison Between Individual Interviews and Focus Groups Based on Thematic Saturation Levels

ERIC Educational Resources Information Center

Namey, Emily; Guest, Greg; McKenna, Kevin; Chen, Mario

2016-01-01

Evaluators often use qualitative research methods, yet there is little evidence on the comparative cost-effectiveness of the two most commonly employed qualitative methods--in-depth interviews (IDIs) and focus groups (FGs). We performed an inductive thematic analysis of data from 40 IDIs and 40 FGs on the health-seeking behaviors of African…

Working with Science Teachers to Transform the Opportunity Landscape for Regional and Rural Youth: A Qualitative Evaluation of the Science in Schools Program

ERIC Educational Resources Information Center

Sheehan, Grania R.; Mosse, Jennifer

2013-01-01

This article reports on a qualitative evaluation of the Science in Schools program; a suite of science based activities delivered by staff of a regional university campus and designed to provide professional development for science teachers working in non-metropolitan schools in a socioeconomically disadvantaged region of Australia. The research…

A Qualitative Evaluation of the Effects of Mandatory Reporting of Domestic Violence on Victims and Their Children

ERIC Educational Resources Information Center

Antle, Becky; Barbee, Anita; Yankeelov, Pam; Bledsoe, Linda

2010-01-01

This purpose of this research was to evaluate the mandatory reporting law for domestic violence victims in the state of Kentucky through the qualitative interview of 24 female victims of domestic violence. Victims were generally supportive of the law and felt that professionals should be required to report domestic abuse. They did not feel that…

What does patient feedback reveal about the NHS? A mixed methods study of comments posted to the NHS Choices online service.

PubMed

Brookes, Gavin; Baker, Paul

2017-04-27

To examine the key themes of positive and negative feedback in patients' online feedback on NHS (National Health Service) services in England and to understand the specific issues within these themes and how they drive positive and negative evaluation. Computer-assisted quantitative and qualitative studies of 228 113 comments (28 971 142 words) of online feedback posted to the NHS Choices website. Comments containing the most frequent positive and negative evaluative words are qualitatively examined to determine the key drivers of positive and negative feedback. Contributors posting comments about the NHS between March 2013 and September 2015. Overall, NHS services were evaluated positively approximately three times more often than negatively. The four key areas of focus were: treatment, communication, interpersonal skills and system/organisation. Treatment exhibited the highest proportion of positive evaluative comments (87%), followed by communication (77%), interpersonal skills (44%) and, finally, system/organisation (41%). Qualitative analysis revealed that reference to staff interpersonal skills featured prominently, even in comments relating to treatment and system/organisational issues. Positive feedback was elicited in cases of staff being caring, compassionate and knowing patients'' names, while rudeness, apathy and not listening were frequent drivers of negative feedback. Although technical competence constitutes an undoubtedly fundamental aspect of healthcare provision, staff members were much more likely to be evaluated both positively and negatively according to their interpersonal skills. Therefore, the findings reported in this study highlight the salience of such 'soft' skills to patients and emphasise the need for these to be focused upon and developed in staff training programmes, as well as ensuring that decisions around NHS funding do not result in demotivated and rushed staff. The findings also reveal a significant overlap between the four key themes in the ways that care is evaluated by patients. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Debriefing a Health-Related Educational Game: A Case Study

ERIC Educational Resources Information Center

Lennon, Jeffrey L.

2010-01-01

This study sought to evaluate the utility of a Web-based game on the topic of immunity, based upon the work of Nobel Prize winner Ileya Mechnikov. This was accomplished through postgame written debriefing with an oral debriefing follow-up. A qualitative case study was conducted in a nonformal home setting. The participant learned new information,…

Potential Changes in Prospective Chemistry Teachers' Beliefs about Teaching and Learning--A Cross-Level Study

ERIC Educational Resources Information Center

Markic, Silvija; Eilks, Ingo

2013-01-01

This paper presents a cross-level study of German student teachers' beliefs about teaching and learning chemistry. It covers different stages of their teacher training program. The study is based upon drawings of teaching situations, which were analyzed using an evaluation pattern developed using grounded theory. The qualitative scales analyze…

An Approach to Using Toxicogenomic Data in U.S. EPA Human Health Risk Assessments: A Dibutyl Phthalate (Dbp) Case Study (External Review Draft)

EPA Science Inventory

This draft report is a description of an approach to evaluate genomic data for use in risk assessment and a case study to illustrate the approach. The dibutyl phthalate (DBP) case study example focuses on male reproductive developmental effects and the qualitative application of...

A Qualitative Case Study of Strategies for Choosing and Evaluating Alternative Assessments in Online Higher Education

ERIC Educational Resources Information Center

Streff, Robert James

2016-01-01

Studies have shown that not all students are assessed effectively using standard testing formats. However, it is unclear what alternative methodology would be useful to determine whether students have acquired the skills necessary for today's global market. This research study's purpose was to understand the processes instructors use when choosing…

Better movers and thinkers (BMT): A quasi-experimental study into the impact of physical education on children's cognition-A study protocol.

PubMed

Dalziell, Andrew; Boyle, James; Mutrie, Nanette

2015-01-01

This study will extend on a pilot study and will evaluate the impact of a novel approach to PE, Better Movers and Thinkers (BMT), on students' cognition, physical activity habits, and gross motor coordination (GMC). The study will involve six mainstream state schools with students aged 9-11 years. Three schools will be allocated as the intervention condition and three as the control condition. The design of the study is a 16-week intervention with pre-, post- and 6 month follow-up measurements taken using the 'Cognitive Assessment System (CAS)' GMC tests, and the 'Physical Activity Habits Questionnaire for Children (PAQ-C).' Qualitative data will be gathered using student focus groups and class teacher interviews in each of the six schools. ANCOVA will be used to evaluate any effect of intervention comparing pre-test scores with post-test scores and then pre-test scores with 6 month follow-up scores. Qualitative data will be analysed through an iterative process using grounded theory. This protocol provides the details of the rationale and design of the study and details of the intervention, outcome measures, and the recruitment process. The study will address gaps within current research by evaluating if a change of approach in the delivery of PE within schools has an effect on children's cognition, PA habits, and GMC within a Scottish setting.

A Mobile Health App–Based Postnatal Educational Program (Home-but not Alone): Descriptive Qualitative Study

PubMed Central

Yang, Yen Yen; Dennis, Cindy-Lee

2018-01-01

Background The postnatal period poses numerous challenges for new parents. Various educational programs are available to support new parents during this stressful period. However, the usefulness of educational programs must be evaluated to ascertain their credibility. Objective The aim of this descriptive, qualitative study was to explore the views of parents of newborns with regard to the content and delivery of a mobile health (mHealth) app–based postnatal educational program. Methods A qualitative semistructured interview guide was used to collect data from 17 participants who belonged to the intervention group of a randomized controlled trial. The intervention, a 4-week-long access to a mHealth app–based educational program, was evaluated. The interviews were conducted in English and at the participants’ homes. Thematic analysis was used to analyze the data. The Consolidated Criteria for Reporting Qualitative Research checklist was used to report the findings. Results The interviews revealed 4 main themes: (1) positive features of the mHealth app, (2) advice from midwives, (3) experiences gained from using the mHealth app, and (4) recommendations for the future. The participants evaluated the educational program to be a good source of information that was tailored to the local context. The different modes of delivery, including audio and video, accentuated the accessibility of information. The parents evaluated that the facilitator of the featured communication platform, a midwife, provided trustworthy advice. Belongingness to a virtual community beyond the hospital endowed the parents the confidence that they were not alone and were supported by other parents and health care professionals. Conclusions According to the parents, the mHealth app–based educational program was helpful in supporting a multi-ethnic sample of parents during the postnatal period. This insight indicates that the program could be implemented in a wide community of parents in the postnatal period. The helpfulness of the educational program is a testament of the potential benefits of using telemedicine among new parents postnatally. Resources can also be dedicated toward extending the duration of access to the app beyond 1 month and developing relevant content for parents across the perinatal period. PMID:29674314

Measures of fish behavior as indicators of sublethal toxicosis during standard toxicity tests

USGS Publications Warehouse

Little, E.E.; DeLonay, A.J.

1996-01-01

Behavioral functions essential for growth and survival can be dramatically altered by sublethal exposure to toxicants. Measures of these behavioral responses are effective in detecting adverse effects of sublethal contaminant exposure. Behavioral responses of fishes can be qualitatively and quantitatively evaluated during routine toxicity tests. At selected intervals of exposure, qualitative evaluations are accomplished through direct observations, whereas video recordings are used for quantitative evaluations. Standardized procedures for behavioral evaluation are readily applicable to different fish species and provide rapid, sensitive, and ecologically relevant assessments of sublethal exposure. The methods are readily applied to standardized test protocols.

Postpartum smoking relapse--a thematic synthesis of qualitative studies.

PubMed

Notley, Caitlin; Blyth, Annie; Craig, Jean; Edwards, Alice; Holland, Richard

2015-11-01

Many women quit smoking during pregnancy, but relapse after the baby is born. To understand why and identify ways of preventing this, this study reviewed the qualitative literature on women's experience of postpartum smoking relapse. A systematic review of qualitative studies and process evaluations of trials. We undertook a thematic synthesis of published qualitative data. We screened 1336 papers. Twenty-two papers reporting on 16 studies were included, reporting on the views of 1031 postpartum women. Factors affecting relapse and barriers and facilitators to relapse prevention were identified around the key themes of beliefs, social influences, motivation, physiological factors and identity. Women's beliefs about smoking as a means of coping with stress and the need for social support, especially from a partner, emerged as important. Extrinsic motivation to quit during the pregnancy (for the health of the fetus) appeared to be a factor in prompting relapse after the baby was born. During the immediate postpartum period women believed that physiological changes influence cigarette cravings. The stress of caring for a newborn, sleeplessness and adjusting to a new mothering identity were also reported to be important. Among women who quit smoking during pregnancy, those who relapse postpartum talk commonly about no longer needing to protect the baby and the effects of stress. Partner support and a sense of changed identity are cited as factors preventing relapse. © 2015 Society for the Study of Addiction.

Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care.

PubMed

Grant, Aileen; Dreischulte, Tobias; Treweek, Shaun; Guthrie, Bruce

2012-08-28

Trials of complex interventions are criticized for being 'black box', so the UK Medical Research Council recommends carrying out a process evaluation to explain the trial findings. We believe it is good practice to pre-specify and publish process evaluation protocols to set standards and minimize bias. Unlike protocols for trials, little guidance or standards exist for the reporting of process evaluations. This paper presents the mixed-method process evaluation protocol of a cluster randomized trial, drawing on a framework designed by the authors. This mixed-method evaluation is based on four research questions and maps data collection to a logic model of how the data-driven quality improvement in primary care (DQIP) intervention is expected to work. Data collection will be predominately by qualitative case studies in eight to ten of the trial practices, focus groups with patients affected by the intervention and quantitative analysis of routine practice data, trial outcome and questionnaire data and data from the DQIP intervention. We believe that pre-specifying the intentions of a process evaluation can help to minimize bias arising from potentially misleading post-hoc analysis. We recognize it is also important to retain flexibility to examine the unexpected and the unintended. From that perspective, a mixed-methods evaluation allows the combination of exploratory and flexible qualitative work, and more pre-specified quantitative analysis, with each method contributing to the design, implementation and interpretation of the other.As well as strengthening the study the authors hope to stimulate discussion among their academic colleagues about publishing protocols for evaluations of randomized trials of complex interventions. DATA-DRIVEN QUALITY IMPROVEMENT IN PRIMARY CARE TRIAL REGISTRATION: ClinicalTrials.gov: NCT01425502.

Health systems research training enhances workplace research skills: a qualitative evaluation.

PubMed

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager perceptions of the usefulness, in the work setting, of skills taught on a health systems research education course in South Africa and to assess the extent to which the course stimulated awareness and development of health systems research in the work setting. The education course was evaluated using a qualitative approach. Respondents were selected for interview using purposive sampling. Interviews were conducted with 39 respondents, including all of the major stakeholders. The interviews lasted between 20 and 60 minutes and were conducted either face to face or over the telephone. Thematic analysis was applied to the data, and key themes were identified. The course demystified health systems research and stimulated interest in reading and applying research findings. The course also changed participants' attitudes to routine data collection and was reported to have facilitated the application of informal research or problem-solving methods to everyday work situations. However, inadequate support within the workplace was a significant obstacle to applying the skills learned. A 2-week intensive, experiential course in health systems research methods can provide a mechanism for introducing basic research skills to a wide range of learners. Qualitative evaluation is a useful approach for assessing the impacts of education courses.

What Do Students Learn when We Teach Peace? A Qualitative Assessment of a Theater Peace Program

ERIC Educational Resources Information Center

Duckworth, Cheryl Lynn; Allen, Barb; Williams, Teri Triguba

2012-01-01

This is a qualitative assessment of a theater arts peace education program for high-school students. We present the results of qualitative interviews with students who participated in a peace education program. They tell us in their own words what they believe they learned. Given that most peace education evaluation is quantitative or focuses on…

Qualitative exploration of the benefits of group-based memory rehabilitation for people with neurological disabilities: implications for rehabilitation delivery and evaluation.

PubMed

Chouliara, Niki; Lincoln, Nadina B

2016-09-19

To identify patient-perceived benefits of memory rehabilitation and draw transferrable lessons for the delivery and evaluation of similar interventions for people with neurological disabilities. A qualitative study was conducted as part of a pragmatic randomised controlled trial comparing 2 memory rehabilitation approaches with a self-help control group. Postintervention interviews were conducted with 20 participants with a diagnosis of traumatic brain injury, multiple sclerosis or stroke. Data were analysed using a qualitative content analysis approach. Participants receiving memory rehabilitation reported that the sessions responded to previously unmet needs for information on brain injury and memory function and developed their insight along with a sense of self-efficacy and control over the management of their memory problems. Although they did not experience major improvements in their memory function per se, they reported that rehabilitation gave them the skills to effectively cope with the residual deficits. Respondents in the control groups did not report similar benefits. The opportunities for interaction offered by the group setting were greatly valued by all respondents. Mixed aetiology groups were received positively; however, marked differences in cognitive performance were frustrating for some participants. The study highlighted important patient-perceived outcomes that should be considered by researchers and rehabilitation professionals when evaluating the effects of memory rehabilitation. The use of domain-specific outcome measures which reflect these areas is recommended. Qualitative changes in the use of memory aids may be achieved which cannot be captured by frequency indices alone. The benefits of the group-based rehabilitation approach were stressed by participants, suggesting that a combination of group and individual sessions might be a good practice. ISRCTN92582254; Results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Development and evaluation of the Jönköping Dental Fear Coping Model: a health professional perspective.

PubMed

Brahm, Carl-Otto; Lundgren, Jesper; Carlsson, Sven G; Nilsson, Peter; Hägglin, Catharina

2018-03-21

The purpose of this study was to design a structured treatment model focusing on all levels of adult's dental fear, the Jönköping Dental Fear Coping Model (DFCM). The aim was to study the DFCM from a dental health professional perspective. The DFCM was studied by means of quantitative and qualitative analyses. Nine dental clinics participated in Period I (pre-intervention/standard care), and 133 dental health professionals (dentists, dental hygienists, dental assistants) and 3088 patients were included. After completion of Period I, four of the clinics were randomized to Period II (intervention), beginning with the professionals undergoing DFCM training. Following that, 51 dental health professionals treated 1417 patients according to the DFCM. The other five clinics served as controls. Half or more of the dental health professionals assessed the model as better than standard care, regarding anamnesis and diagnostics, communication and contact, and understanding of patients and dental fear. The dental health professionals reported higher tension in their fearful patients in Period II compared with Period I, possibly due to their increased awareness of dental fear. The qualitative data suggest that dental health professionals find the DFCM beneficial in routine dental care. The model promotes a holistic approach to the treatment of adult patients. However, stress among the professionals was not reduced when measured, neither quantitatively nor qualitatively. It is important to evaluate the model in further studies to make it possible to draw generalizable conclusions.