Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles

PubMed Central

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-01-01

Objectives Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. Data Sources All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. Study Design All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Principal Findings Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ2(1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ2(1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Conclusion Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. PMID:22092040

Cognitive Relativism in Evaluation.

ERIC Educational Resources Information Center

Alexander, H. A.

1986-01-01

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

Further assessment of a method to estimate reliability and validity of qualitative research findings.

PubMed

Hinds, P S; Scandrett-Hibden, S; McAulay, L S

1990-04-01

The reliability and validity of qualitative research findings are viewed with scepticism by some scientists. This scepticism is derived from the belief that qualitative researchers give insufficient attention to estimating reliability and validity of data, and the differences between quantitative and qualitative methods in assessing data. The danger of this scepticism is that relevant and applicable research findings will not be used. Our purpose is to describe an evaluative strategy for use with qualitative data, a strategy that is a synthesis of quantitative and qualitative assessment methods. Results of the strategy and factors that influence its use are also described.

Using Qualitative Research to Inform Development of Professional Guidelines: A Case Study of the Society of Critical Care Medicine Family-Centered Care Guidelines.

PubMed

Coombs, Maureen A; Davidson, Judy E; Nunnally, Mark E; Wickline, Mary A; Curtis, J Randall

2017-08-01

To explore the importance, challenges, and opportunities using qualitative research to enhance development of clinical practice guidelines, using recent guidelines for family-centered care in the ICU as an example. In developing the Society of Critical Care Medicine guidelines for family-centered care in the neonatal ICU, PICU, and adult ICU, we developed an innovative adaptation of the Grading of Recommendations, Assessments, Development and Evaluations approach to explicitly incorporate qualitative research. Using Grading of Recommendations, Assessments, Development and Evaluations and the Council of Medical Specialty Societies principles, we conducted a systematic review of qualitative research to establish family-centered domains and outcomes. Thematic analyses were undertaken on study findings and used to support Population, Intervention, Comparison, Outcome question development. We identified and employed three approaches using qualitative research in these guidelines. First, previously published qualitative research was used to identify important domains for the Population, Intervention, Comparison, Outcome questions. Second, this qualitative research was used to identify and prioritize key outcomes to be evaluated. Finally, we used qualitative methods, member checking with patients and families, to validate the process and outcome of the guideline development. In this, a novel report, we provide direction for standardizing the use of qualitative evidence in future guidelines. Recommendations are made to incorporate qualitative literature review and appraisal, include qualitative methodologists in guideline taskforce teams, and develop training for evaluation of qualitative research into guideline development procedures. Effective methods of involving patients and families as members of guideline development represent opportunities for future work.

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Bridging the qualitative-quantitative divide: Experiences from conducting a mixed methods evaluation in the RUCAS programme.

PubMed

Makrakis, Vassilios; Kostoulas-Makrakis, Nelly

2016-02-01

Quantitative and qualitative approaches to planning and evaluation in education for sustainable development have often been treated by practitioners from a single research paradigm. This paper discusses the utility of mixed method evaluation designs which integrate qualitative and quantitative data through a sequential transformative process. Sequential mixed method data collection strategies involve collecting data in an iterative process whereby data collected in one phase contribute to data collected in the next. This is done through examples from a programme addressing the 'Reorientation of University Curricula to Address Sustainability (RUCAS): A European Commission Tempus-funded Programme'. It is argued that the two approaches are complementary and that there are significant gains from combining both. Using methods from both research paradigms does not, however, mean that the inherent differences among epistemologies and methodologies should be neglected. Based on this experience, it is recommended that using a sequential transformative mixed method evaluation can produce more robust results than could be accomplished using a single approach in programme planning and evaluation focussed on education for sustainable development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Enhancing the quality and credibility of qualitative analysis.

PubMed

Patton, M Q

1999-12-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems.

From themes to hypotheses: following up with quantitative methods.

PubMed

Morgan, David L

2015-06-01

One important category of mixed-methods research designs consists of quantitative studies that follow up on qualitative research. In this case, the themes that serve as the results from the qualitative methods generate hypotheses for testing through the quantitative methods. That process requires operationalization to translate the concepts from the qualitative themes into quantitative variables. This article illustrates these procedures with examples that range from simple operationalization to the evaluation of complex models. It concludes with an argument for not only following up qualitative work with quantitative studies but also the reverse, and doing so by going beyond integrating methods within single projects to include broader mutual attention from qualitative and quantitative researchers who work in the same field. © The Author(s) 2015.

Critiquing qualitative research.

PubMed

Beck, Cheryl Tatano

2009-10-01

The ability to critique research is a valuable skill that is fundamental to a perioperative nurse's ability to base his or her clinical practice on evidence derived from research. Criteria differ for critiquing a quantitative versus a qualitative study (ie, statistics are evaluated in a quantitative study, but not in a qualitative study). This article provides on guidelines for assessing qualitative research. Excerpts from a published qualitative research report are summarized and then critiqued. Questions are provided that help evaluate different sections of a research study (eg, sample, data collection methods, data analysis).

A General Survey of Qualitative Research Methodology.

ERIC Educational Resources Information Center

Cary, Rick

Current definitions and philosophical foundations of qualitative research are presented; and designs, evaluation methods, and issues in application of qualitative research to education are discussed. The effects of positivism and the post-positivist era on qualitative research are outlined, and naturalist and positivist approaches are contrasted.…

Challenges of teacher-based clinical evaluation from nursing students' point of view: Qualitative content analysis.

PubMed

Sadeghi, Tabandeh; Seyed Bagheri, Seyed Hamid

2017-01-01

Clinical evaluation is very important in the educational system of nursing. One of the most common methods of clinical evaluation is evaluation by the teacher, but the challenges that students would face in this evaluation method, have not been mentioned. Thus, this study aimed to explore the experiences and views of nursing students about the challenges of teacher-based clinical evaluation. This study was a descriptive qualitative study with a qualitative content analysis approach. Data were gathered through semi-structured focused group sessions with undergraduate nursing students who were passing their 8 th semester at Rafsanjan University of Medical Sciences. Date were analyzed using Graneheim and Lundman's proposed method. Data collection and analysis were concurrent. According to the findings, "factitious evaluation" was the main theme of study that consisted of three categories: "Personal preferences," "unfairness" and "shirking responsibility." These categories are explained using quotes derived from the data. According to the results of this study, teacher-based clinical evaluation would lead to factitious evaluation. Thus, changing this approach of evaluation toward modern methods of evaluation is suggested. The finding can help nursing instructors to get a better understanding of the nursing students' point of view toward this evaluation approach and as a result could be planning for changing of this approach.

[Advantages and disadvantages of incorporating qualitative methodology in the evaluation of health services. A practical case: evaluation of a high-resolution clinic].

PubMed

Alvarez Del Arco, D; Rodríguez Rieiro, C; Sanchidrián De Blás, C; Alejos, B; Plá Mestre, R

2012-01-01

We examined the usefulness of incorporating a qualitative phase in the evaluation of the quality of care in a high-resolution medical service carried out with quantitative methods. A quantitative research was performed using a structured questionnaire and selecting interviewees by systematic randomized sampling methods (n=320). In addition, a qualitative research was carried on through semi-structured interviews with patients selected by convenience criteria (n=11), observations in the care assistance circuit, and a group interview with health professionals working in the service. A multidisciplinary research team conducted an individual analysis of the information collected in both quantitative and qualitative phases. Subsequently, three meetings based on group brainstorming techniques were held to identify the diverse contributions of each of the methodologies employed to the research, using affinity graphs to analyse the different results obtained in both phases and evaluate possible bias arising from the use of qualitative methods. Qualitative research allowed examining specific aspects of the health care service that had been collected in the quantitative phase, harmonizing the results obtained in the previous phase, giving in-depth data on the reasons for patient dissatisfaction with specific aspects, such as waiting times and available infrastructures, and identifying emerging issues of the service which had not been previously assessed. Overall, the qualitative phase enriched the results of the research. It is appropriate and recommendable to incorporate this methodological approach in research aimed at evaluating the quality of the service in specific health care settings, since it is provided first hand, by the voice of the customer. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Evaluating Bang for the Buck: A Cost-Effectiveness Comparison Between Individual Interviews and Focus Groups Based on Thematic Saturation Levels

ERIC Educational Resources Information Center

Namey, Emily; Guest, Greg; McKenna, Kevin; Chen, Mario

2016-01-01

Evaluators often use qualitative research methods, yet there is little evidence on the comparative cost-effectiveness of the two most commonly employed qualitative methods--in-depth interviews (IDIs) and focus groups (FGs). We performed an inductive thematic analysis of data from 40 IDIs and 40 FGs on the health-seeking behaviors of African…

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

PubMed

Noyes, Jane; Booth, Andrew; Flemming, Kate; Garside, Ruth; Harden, Angela; Lewin, Simon; Pantoja, Tomas; Hannes, Karin; Cargo, Margaret; Thomas, James

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Enhancing the quality and credibility of qualitative analysis.

PubMed Central

Patton, M Q

1999-01-01

Varying philosophical and theoretical orientations to qualitative inquiry remind us that issues of quality and credibility intersect with audience and intended research purposes. This overview examines ways of enhancing the quality and credibility of qualitative analysis by dealing with three distinct but related inquiry concerns: rigorous techniques and methods for gathering and analyzing qualitative data, including attention to validity, reliability, and triangulation; the credibility, competence, and perceived trustworthiness of the qualitative researcher; and the philosophical beliefs of evaluation users about such paradigm-based preferences as objectivity versus subjectivity, truth versus perspective, and generalizations versus extrapolations. Although this overview examines some general approaches to issues of credibility and data quality in qualitative analysis, it is important to acknowledge that particular philosophical underpinnings, specific paradigms, and special purposes for qualitative inquiry will typically include additional or substitute criteria for assuring and judging quality, validity, and credibility. Moreover, the context for these considerations has evolved. In early literature on evaluation methods the debate between qualitative and quantitative methodologists was often strident. In recent years the debate has softened. A consensus has gradually emerged that the important challenge is to match appropriately the methods to empirical questions and issues, and not to universally advocate any single methodological approach for all problems. PMID:10591279

Using mixed methods to develop and evaluate an online weight management intervention.

PubMed

Bradbury, Katherine; Dennison, Laura; Little, Paul; Yardley, Lucy

2015-02-01

This article illustrates the use of mixed methods in the development and evaluation of the Positive Online Weight Reduction (POWeR) programme, an e-health intervention designed to support sustainable weight loss. The studies outlined also explore how human support might enhance intervention usage and weight loss. Mixed methods were used to develop and evaluate POWeR. In the development phase, we drew on both quantitative and qualitative findings to plan and gain feedback on the intervention. Next, a feasibility trial, with nested qualitative study, explored what level of human support might lead to the most sustainable weight loss. Finally, a large community-based trial of POWeR, with nested qualitative study, explored whether the addition of brief telephone coaching enhances usage. Findings suggest that POWeR is acceptable and potentially effective. Providing human support enhanced usage in our trials, but was not unproblematic. Interestingly, there were some indications that more basic (brief) human support may produce more sustainable weight loss outcomes than more regular support. Qualitative interviews suggested that more regular support might foster reliance, meaning patients cannot sustain their weight losses when support ends. Qualitative findings in the community trial also suggested explanations for why many people may not take up the opportunity for human support. Integrating findings from both our qualitative and quantitative studies provided far richer insights than would have been gained using only a single method of inquiry. Further research should investigate the optimum delivery of human support needed to maximize sustainable weight loss in online interventions. Statement of contribution What is already known on this subject? There is evidence that human support may increase the effectiveness of e-health interventions. It is unclear what level of human support might be optimal or how human support improves effectiveness. Triangulation of quantitative and qualitative methods can be used to inform the design and implementation of interventions What does this study add? This paper demonstrates the value of a mixed methods approach when developing and evaluating an intervention. Qualitative methods provided complementary insights into the optimal level of human support. Brief human support is valued by some and may enhance usage and outcomes of an e-health intervention for weight loss. © 2014 The British Psychological Society.

A Critical Review of Qualitative Research Methods in Evaluating Nursing Curriculum Models: Implication for Nursing Education in the Arab World

ERIC Educational Resources Information Center

Devadas, Briliya

2016-01-01

Aim: The purpose of this critical literature review was to examine qualitative studies done on innovative nursing curriculums in order to determine which qualitative methods have been most effective in investigating the effectiveness of the curriculum and which would be most appropriate in an Arab Islamic country. Data Sources: At least 25 studies…

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

PubMed

Holtrop, Jodi Summers; Rabin, Borsika A; Glasgow, Russell E

2018-03-13

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study

PubMed Central

Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-01-01

Background To improve workers’ health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. Objective The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Methods Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Results Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Conclusions Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users’ characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees’ mental models; practicability; resources; and skills required of experts and users. PMID:29592846

Ethnographic methods for process evaluations of complex health behaviour interventions.

PubMed

Morgan-Trimmer, Sarah; Wood, Fiona

2016-05-04

This article outlines the contribution that ethnography could make to process evaluations for trials of complex health-behaviour interventions. Process evaluations are increasingly used to examine how health-behaviour interventions operate to produce outcomes and often employ qualitative methods to do this. Ethnography shares commonalities with the qualitative methods currently used in health-behaviour evaluations but has a distinctive approach over and above these methods. It is an overlooked methodology in trials of complex health-behaviour interventions that has much to contribute to the understanding of how interventions work. These benefits are discussed here with respect to three strengths of ethnographic methodology: (1) producing valid data, (2) understanding data within social contexts, and (3) building theory productively. The limitations of ethnography within the context of process evaluations are also discussed.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

PubMed

de Korte, Elsbeth Marieke; Wiezer, Noortje; Janssen, Joris H; Vink, Peter; Kraaij, Wessel

2018-03-28

To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available. The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts. Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories. Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results. Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users. ©Elsbeth Marieke de Korte, Noortje Wiezer, Joris H Janssen, Peter Vink, Wessel Kraaij. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 28.03.2018.

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Qualitative research within trials: developing a standard operating procedure for a clinical trials unit

PubMed Central

2013-01-01

Background Qualitative research methods are increasingly used within clinical trials to address broader research questions than can be addressed by quantitative methods alone. These methods enable health professionals, service users, and other stakeholders to contribute their views and experiences to evaluation of healthcare treatments, interventions, or policies, and influence the design of trials. Qualitative data often contribute information that is better able to reform policy or influence design. Methods Health services researchers, including trialists, clinicians, and qualitative researchers, worked collaboratively to develop a comprehensive portfolio of standard operating procedures (SOPs) for the West Wales Organisation for Rigorous Trials in Health (WWORTH), a clinical trials unit (CTU) at Swansea University, which has recently achieved registration with the UK Clinical Research Collaboration (UKCRC). Although the UKCRC requires a total of 25 SOPs from registered CTUs, WWORTH chose to add an additional qualitative-methods SOP (QM-SOP). Results The qualitative methods SOP (QM-SOP) defines good practice in designing and implementing qualitative components of trials, while allowing flexibility of approach and method. Its basic principles are that: qualitative researchers should be contributors from the start of trials with qualitative potential; the qualitative component should have clear aims; and the main study publication should report on the qualitative component. Conclusions We recommend that CTUs consider developing a QM-SOP to enhance the conduct of quantitative trials by adding qualitative data and analysis. We judge that this improves the value of quantitative trials, and contributes to the future development of multi-method trials. PMID:23433341

A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year

PubMed Central

McKibbon, Kathleen Ann; Gadd, Cynthia S

2004-01-01

Background Quantitative studies are becoming more recognized as important to understanding health care with all of its richness and complexities. The purpose of this descriptive survey was to provide a quantitative evaluation of the qualitative studies published in 170 core clinical journals for 2000. Methods All identified studies that used qualitative methods were reviewed to ascertain which clinical journals publish qualitative studies and to extract research methods, content (persons and health care issues studied), and whether mixed methods (quantitative and qualitative methods) were used. Results 60 330 articles were reviewed. 355 reports of original qualitative studies and 12 systematic review articles were identified in 48 journals. Most of the journals were in the discipline of nursing. Only 4 of the most highly cited health care journals, based on ISI Science Citation Index (SCI) Impact Factors, published qualitative studies. 37 of the 355 original reports used both qualitative and quantitative (mixed) methods. Patients and non-health care settings were the most common groups of people studied. Diseases and conditions were cancer, mental health, pregnancy and childbirth, and cerebrovascular disease with many other diseases and conditions represented. Phenomenology and grounded theory were commonly used; substantial ethnography was also present. No substantial differences were noted for content or methods when articles published in all disciplines were compared with articles published in nursing titles or when studies with mixed methods were compared with studies that included only qualitative methods. Conclusions The clinical literature includes many qualitative studies although they are often published in nursing journals or journals with low SCI Impact Factor journals. Many qualitative studies incorporate both qualitative and quantitative methods. PMID:15271221

Comparison study on qualitative and quantitative risk assessment methods for urban natural gas pipeline network.

PubMed

Han, Z Y; Weng, W G

2011-05-15

In this paper, a qualitative and a quantitative risk assessment methods for urban natural gas pipeline network are proposed. The qualitative method is comprised of an index system, which includes a causation index, an inherent risk index, a consequence index and their corresponding weights. The quantitative method consists of a probability assessment, a consequences analysis and a risk evaluation. The outcome of the qualitative method is a qualitative risk value, and for quantitative method the outcomes are individual risk and social risk. In comparison with previous research, the qualitative method proposed in this paper is particularly suitable for urban natural gas pipeline network, and the quantitative method takes different consequences of accidents into consideration, such as toxic gas diffusion, jet flame, fire ball combustion and UVCE. Two sample urban natural gas pipeline networks are used to demonstrate these two methods. It is indicated that both of the two methods can be applied to practical application, and the choice of the methods depends on the actual basic data of the gas pipelines and the precision requirements of risk assessment. Crown Copyright © 2011. Published by Elsevier B.V. All rights reserved.

Defining Leadership: Collegiate Women's Learning Circles: A Qualitative Approach

ERIC Educational Resources Information Center

Preston-Cunningham, Tammie; Elbert, Chanda D.; Dooley, Kim E.

2017-01-01

The researchers employed qualitative methods to evaluate first-year female students' definition of "leadership" through involvement in the Women's Learning Circle. The findings revealed that students defined leadership in two dimensions: traits and behaviors. The qualitative findings explore a multidimensional approach to the voices of…

Influence on Learning of a Collaborative Learning Method Comprising the Jigsaw Method and Problem-based Learning (PBL).

PubMed

Takeda, Kayoko; Takahashi, Kiyoshi; Masukawa, Hiroyuki; Shimamori, Yoshimitsu

2017-01-01

Recently, the practice of active learning has spread, increasingly recognized as an essential component of academic studies. Classes incorporating small group discussion (SGD) are conducted at many universities. At present, assessments of the effectiveness of SGD have mostly involved evaluation by questionnaires conducted by teachers, by peer assessment, and by self-evaluation of students. However, qualitative data, such as open-ended descriptions by students, have not been widely evaluated. As a result, we have been unable to analyze the processes and methods involved in how students acquire knowledge in SGD. In recent years, due to advances in information and communication technology (ICT), text mining has enabled the analysis of qualitative data. We therefore investigated whether the introduction of a learning system comprising the jigsaw method and problem-based learning (PBL) would improve student attitudes toward learning; we did this by text mining analysis of the content of student reports. We found that by applying the jigsaw method before PBL, we were able to improve student attitudes toward learning and increase the depth of their understanding of the area of study as a result of working with others. The use of text mining to analyze qualitative data also allowed us to understand the processes and methods by which students acquired knowledge in SGD and also changes in students' understanding and performance based on improvements to the class. This finding suggests that the use of text mining to analyze qualitative data could enable teachers to evaluate the effectiveness of various methods employed to improve learning.

Improving Evaluation of Dental Hygiene Students' Cultural Competence with a Mixed-Methods Approach.

PubMed

Flynn, Priscilla; Sarkarati, Nassim

2018-02-01

Most dental hygiene educational programs include cultural competence education, but may not evaluate student outcomes. The aim of this study was to design and implement a mixed-methods evaluation to measure dental hygiene students' progression toward cultural competence. Two cohorts consisting of consecutive classes in one U.S. dental hygiene program participated in the study. A total of 47 dental hygiene students (100% response rate) completed self-assessments to measure their attitudes and knowledge at three time points between 2014 and 2016. Mean scores were calculated for three domains: Physical Environment, Communication, and Values. Qualitative analysis of the students' cultural diversity papers was also conducted to further evaluate students' knowledge and skills. Bennett's five-level conceptual framework was used to code phrases or sentences to place students in the general categories of ethnocentric or ethno-relative. The quantitative and qualitative results yielded different outcomes for Cohort 1, but not for Cohort 2. The Cohort 1 students assessed themselves statistically significantly lower over time in one of the three measured domains. However, the Cohort 2 students assessed themselves as statistically significantly more culturally competent in all three domains. Qualitative results placed 72% of Cohort 1 students and 83% of Cohort 2 students in the more desirable ethno-relative category. Since quantitative methods consisting of student self-assessments may not adequately measure students' cultural competence, adding qualitative methods to measure skills specific to patient care in this study added a robust dimension to evaluating this complex dental hygiene student competence.

Methodological Challenges in Cross-Language Qualitative Research: A Research Review

PubMed Central

Squires, Allison

2009-01-01

Objectives Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this critical review of cross-language qualitative research was three fold: 1) review the methods literature addressing cross language research; 2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; and 3) test these criteria on published cross-language qualitative studies. Data sources A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. Review methods The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. Results The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant’s language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. Conclusions The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically. PMID:18789799

Criteria for quantitative and qualitative data integration: mixed-methods research methodology.

PubMed

Lee, Seonah; Smith, Carrol A M

2012-05-01

Many studies have emphasized the need and importance of a mixed-methods approach for evaluation of clinical information systems. However, those studies had no criteria to guide integration of multiple data sets. Integrating different data sets serves to actualize the paradigm that a mixed-methods approach argues; thus, we require criteria that provide the right direction to integrate quantitative and qualitative data. The first author used a set of criteria organized from a literature search for integration of multiple data sets from mixed-methods research. The purpose of this article was to reorganize the identified criteria. Through critical appraisal of the reasons for designing mixed-methods research, three criteria resulted: validation, complementarity, and discrepancy. In applying the criteria to empirical data of a previous mixed methods study, integration of quantitative and qualitative data was achieved in a systematic manner. It helped us obtain a better organized understanding of the results. The criteria of this article offer the potential to produce insightful analyses of mixed-methods evaluations of health information systems.

Searching for qualitative research for inclusion in systematic reviews: a structured methodological review.

PubMed

Booth, Andrew

2016-05-04

Qualitative systematic reviews or qualitative evidence syntheses (QES) are increasingly recognised as a way to enhance the value of systematic reviews (SRs) of clinical trials. They can explain the mechanisms by which interventions, evaluated within trials, might achieve their effect. They can investigate differences in effects between different population groups. They can identify which outcomes are most important to patients, carers, health professionals and other stakeholders. QES can explore the impact of acceptance, feasibility, meaningfulness and implementation-related factors within a real world setting and thus contribute to the design and further refinement of future interventions. To produce valid, reliable and meaningful QES requires systematic identification of relevant qualitative evidence. Although the methodologies of QES, including methods for information retrieval, are well-documented, little empirical evidence exists to inform their conduct and reporting. This structured methodological overview examines papers on searching for qualitative research identified from the Cochrane Qualitative and Implementation Methods Group Methodology Register and from citation searches of 15 key papers. A single reviewer reviewed 1299 references. Papers reporting methodological guidance, use of innovative methodologies or empirical studies of retrieval methods were categorised under eight topical headings: overviews and methodological guidance, sampling, sources, structured questions, search procedures, search strategies and filters, supplementary strategies and standards. This structured overview presents a contemporaneous view of information retrieval for qualitative research and identifies a future research agenda. This review concludes that poor empirical evidence underpins current information practice in information retrieval of qualitative research. A trend towards improved transparency of search methods and further evaluation of key search procedures offers the prospect of rapid development of search methods.

Using Radar Charts with Qualitative Evaluation: Techniques to Assess Change in Blended Learning

ERIC Educational Resources Information Center

Kaczynski, Dan; Wood, Leigh; Harding, Ansie

2008-01-01

When university academics implement changes in learning, such as introducing blended learning, it is conventional practice to examine and evaluate the impact of the resulting curriculum reform. Judging the worth and impact of an educational development is a complex task involving subtle differences in learning. Qualitative methods to explore these…

Evaluation of background parenchymal enhancement on breast MRI: a systematic review

PubMed Central

Signori, Alessio; Valdora, Francesca; Rossi, Federica; Calabrese, Massimo; Durando, Manuela; Mariscotto, Giovanna; Tagliafico, Alberto

2017-01-01

Objective: To perform a systematic review of the methods used for background parenchymal enhancement (BPE) evaluation on breast MRI. Methods: Studies dealing with BPE assessment on breast MRI were retrieved from major medical libraries independently by four reviewers up to 6 October 2015. The keywords used for database searching are “background parenchymal enhancement”, “parenchymal enhancement”, “MRI” and “breast”. The studies were included if qualitative and/or quantitative methods for BPE assessment were described. Results: Of the 420 studies identified, a total of 52 articles were included in the systematic review. 28 studies performed only a qualitative assessment of BPE, 13 studies performed only a quantitative assessment and 11 studies performed both qualitative and quantitative assessments. A wide heterogeneity was found in the MRI sequences and in the quantitative methods used for BPE assessment. Conclusion: A wide variability exists in the quantitative evaluation of BPE on breast MRI. More studies focused on a reliable and comparable method for quantitative BPE assessment are needed. Advances in knowledge: More studies focused on a quantitative BPE assessment are needed. PMID:27925480

Qualitative Methods in Mental Health Services Research

PubMed Central

Palinkas, Lawrence A.

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This paper reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the papers included in this special series along with representative examples from the literature. Qualitative methods are used to provide a “thick description” or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods, but often differ with respect to study design, data collection and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semi-structured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research. PMID:25350675

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

Using Qualitative Methods to Evaluate a Family Behavioral Intervention for Type 1 Diabetes

PubMed Central

Herbert, Linda Jones; Sweenie, Rachel; Kelly, Katherine Patterson; Holmes, Clarissa; Streisand, Randi

2013-01-01

Introduction The objectives of this study were to qualitatively evaluate a dyadic adolescent-parent type 1 diabetes (T1D) program developed to prevent deterioration in diabetes care among adolescents with T1D and provide recommendations for program refinement. Method Thirteen adolescent-parent dyads who participated in the larger RCT, the TeamWork Project, were interviewed regarding their perceptions of their participation in the program and current T1D challenges. Interviews were transcribed and coded to establish broad themes. Results Adolescents and parents thought the TeamWork Project sessions were helpful and taught them new information. Five themes catalog findings from the qualitative interviews: TeamWork content, TeamWork structure, transition of responsibility, current and future challenges, and future intervention considerations. Discussion Addressing T1D challenges as a parent-adolescent dyad via a behavioral clinic program is helpful to families during adolescence. Findings highlight the utility of qualitative evaluation to tailor interventions for the unique challenges related to pediatric chronic illness. PMID:24269281

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment.

PubMed

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action.

A Qualitative Evaluation of an Online Expert-Facilitated Course on Tobacco Dependence Treatment

PubMed Central

Ebn Ahmady, Arezoo; Barker, Megan; Dragonetti, Rosa; Fahim, Myra; Selby, Peter

2017-01-01

Qualitative evaluations of courses prove difficult due to low response rates. Online courses may permit the analysis of qualitative feedback provided by health care providers (HCPs) during and after the course is completed. This study describes the use of qualitative methods for an online continuing medical education (CME) course through the analysis of HCP feedback for the purpose of quality improvement. We used formative and summative feedback from HCPs about their self-reported experiences of completing an online expert-facilitated course on tobacco dependence treatment (the Training Enhancement in Applied Cessation Counselling and Health [TEACH] Project). Phenomenological, inductive, and deductive approaches were applied to develop themes. QSR NVivo 11 was used to analyze the themes derived from free-text comments and responses to open-ended questions. A total of 277 out of 287 participants (96.5%) completed the course evaluations and provided 690 comments focused on how to improve the program. Five themes emerged from the formative evaluations: overall quality, content, delivery method, support, and time. The majority of comments (22.6%) in the formative evaluation expressed satisfaction with overall course quality. Suggestions for improvement were mostly for course content and delivery method (20.4% and 17.8%, respectively). Five themes emerged from the summative evaluation: feedback related to learning objectives, interprofessional collaboration, future topics of relevance, overall modifications, and overall satisfaction. Comments on course content, website function, timing, and support were the identified areas for improvement. This study provides a model to evaluate the effectiveness of online educational interventions. Significantly, this constructive approach to evaluation allows CME providers to take rapid corrective action. PMID:28992759

Intelligence Analysts at State and Major Urban Area Fusion Centers: An Evaluation of Education and Training Requirements

DTIC Science & Technology

2011-06-10

Sharan Merriam, there are six standard approaches to qualitative research : phenomenology , grounded theory , ethnography , narrative analysis, critical...69Merriam, Qualitative Research , 21-22. 70Grounded Theory Institute, ―What is Grounded Theory ,‖ http...as to the available methods of research , qualitative and quantitative, and why the qualitative methodology was selected. It also provided the reader

[Qualitative research in health services research - discussion paper, Part 2: Qualitative research in health services research in Germany - an overview].

PubMed

Karbach, U; Stamer, M; Holmberg, C; Güthlin, C; Patzelt, C; Meyer, T

2012-08-01

This is the second part of a 3-part discussion paper by the working group on "Qualitative Methods" in the German network of health services research (DNVF) that shall contribute to the development of a memorandum concerning qualitative health services research. It aims to depict the different types of qualitative research that are conducted in health services research in Germany. In addition, the authors present a specific set of qualitative data collection and analysis tools to demonstrate the potential of qualitative research for health services research. QUALITATIVE RESEARCH IN HEALTH SERVICES RESEARCH - AN OVERVIEW: To give an overview of the types of qualitative research conducted in German health services research, the abstracts of the 8th German Conference on Health Services Research were filtered to identify qualitative or mixed-methods studies. These were then analysed by looking at the context which was studied, who was studied, the aims of the studies, and what type of methods were used. Those methods that were mentioned most often for data collection and analysis are described in detail. QUALITATIVE RESEARCH AT THE CONFERENCE FOR HEALTH SERVICES RESEARCH 2009: Approximately a fifth of all abstracts (n=74) had a qualitative (n=47) or a mixed-methods approach combining quantitative and qualitative methods (n=27). Research aims included needs assessment (41%), survey development (36%), evaluation (22%), and theorizing (1%). Data collection mostly consisted of one-on-one interviews (n=45) and group discussions (n=29). Qualitative content analysis was named in 35 abstracts, 30 abstracts did not reference their method of analysis. In addition to a quantitative summary of the abstract findings, the diversity of fields addressed by qualitative methods is highlighted. Although drawing conclusions on the use of qualitative methods in German health services research from the analysis of conference abstracts is not possible, the overview we present demonstrates the diversity of methods used for data collection and analysis and showed that a few select methods are extensively used. One of the tasks a memorandum of qualitative health services research should accomplish is to highlight underutilized research methods, which may help to develop the potential of qualitative methodology in German health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluation of radiographic interpretation competence of veterinary students in Finland.

PubMed

Koskinen, Heli I; Snellman, Marjatta

2009-01-01

In the evaluation of the clinical competence of veterinary students, many different definitions and methods are approved. Due to the increasing discussion of the quality of outcomes produced by newly graduated veterinarians, methods for the evaluation of clinical competencies should also be evaluated. In this study, this was done by comparing two qualitative evaluation schemes: the well-known structure of observed learning outcome (SOLO) taxonomy and a modification of this taxonomy. A case-based final radiologic examination was selected and the investigation was performed by classifying students' outcomes. These classes were finally put next to original (quantitative) scores and the statistical calculations were initiated. Significant correlations between taxonomies (0.53) and the modified taxonomy and original scores (0.66) were found and some qualitative similarities between evaluation methods were observed. In addition, some supplements were recommended for the structure of evaluation schemes, especially for the structure of the modified SOLO taxonomy.

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

Teaching Qualitative Research Methods through Service-Learning

ERIC Educational Resources Information Center

Machtmes, Krisanna; Johnson, Earl; Fox, Janet; Burke, Mary S.; Harper, Jeannie; Arcemont, Lisa; Hebert, Lanette; Tarifa, Todd; Brooks, Roy C., Jr.; Reynaud, Andree L.; Deggs, David; Matzke, Brenda; Aguirre, Regina T. P.

2009-01-01

This paper is the result of a voluntary service-learning component in a qualitative research methods course. For this course, the service-learning project was the evaluation of the benefits to volunteers who work a crisis hotline for a local crisis intervention center. The service-learning course model used in this paper most closely resembles the…

Applying cognitive developmental psychology to middle school physics learning: The rule assessment method

NASA Astrophysics Data System (ADS)

Hallinen, Nicole R.; Chi, Min; Chin, Doris B.; Prempeh, Joe; Blair, Kristen P.; Schwartz, Daniel L.

2013-01-01

Cognitive developmental psychology often describes children's growing qualitative understanding of the physical world. Physics educators may be able to use the relevant methods to advantage for characterizing changes in students' qualitative reasoning. Siegler developed the "rule assessment" method for characterizing levels of qualitative understanding for two factor situations (e.g., volume and mass for density). The method assigns children to rule levels that correspond to the degree they notice and coordinate the two factors. Here, we provide a brief tutorial plus a demonstration of how we have used this method to evaluate instructional outcomes with middle-school students who learned about torque, projectile motion, and collisions using different instructional methods with simulations.

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions

PubMed Central

Abildgaard, Johan S.; Saksvik, Per Ø.; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire (N = 285) as well as an extensive interview study (N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies. PMID:27713707

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions.

PubMed

Abildgaard, Johan S; Saksvik, Per Ø; Nielsen, Karina

2016-01-01

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire ( N = 285) as well as an extensive interview study ( N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies.

Are We There Yet? Evaluating Library Collections, Reference Services, Programs, and Personnel.

ERIC Educational Resources Information Center

Robbins-Carter, Jane; Zweizig, Douglas L.

1985-01-01

This second in a five-lesson tutorial on library evaluation focuses on the evaluation of library collections. Highlights include the seven-step evaluation process described in lesson one; quantitative methods (total size, unfilled requests, circulation, turnover rate); and qualitative methods (impressionistic, list-checking). One required and…

[Economic effects of integrated RIS-PACS solution in the university environment].

PubMed

Kröger, M; Nissen-Meyer, S; Wetekam, V; Reiser, M

1999-04-01

The goal of the current article is to demonstrate how qualitative and monetary effects resulting from an integrated RIS/PACS installation can be evaluated. First of all, the system concept of a RIS/PACS solution for a university hospital is defined and described. Based on this example, a generic method for the evaluation of qualitative and monetary effects as well as associated risks is depicted and demonstrated. To this end, qualitative analyses, investment calculations and risk analysis are employed. The sample analysis of a RIS/PACS solution specially designed for a university hospital demonstrates positive qualitative and monetary effects of the system. Under ideal conditions the payoff time of the investments is reached after 4 years of an assumed 8 years effective life of the system. Furthermore, under conservative assumptions, the risk analysis shows a probability of 0% for realising a negative net present value at the end of the payoff time period. It should be pointed out that the positive result of this sample analysis will not necessarily apply to other clinics or hospitals. However, the same methods may be used for the individual evaluation of the qualitative and monetary effects of a RIS/PACS installation in any clinic.

Evaluating Student-Generated Film as a Learning Tool for Qualitative Methods: Geographical "Drifts" and the City

ERIC Educational Resources Information Center

Anderson, Jon

2013-01-01

Film as a tool for learning offers considerable opportunity for enhancing student understanding. This paper reflects on the experiences of a project that required students to make a short film demonstrating their practical understanding of qualitative methods. In the psychogeographical tradition, students were asked to "drift" across the…

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

42 CFR 431.424 - Evaluation requirements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... evaluations. Demonstration evaluations will include the following: (1) Quantitative research methods. (i... of appropriate evaluation strategies (including experimental and other quantitative and qualitative... demonstration. (ii) CMS will consider alternative evaluation designs when quantitative designs are technically...

42 CFR 431.424 - Evaluation requirements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... evaluations. Demonstration evaluations will include the following: (1) Quantitative research methods. (i... of appropriate evaluation strategies (including experimental and other quantitative and qualitative... demonstration. (ii) CMS will consider alternative evaluation designs when quantitative designs are technically...

42 CFR 431.424 - Evaluation requirements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... evaluations. Demonstration evaluations will include the following: (1) Quantitative research methods. (i... of appropriate evaluation strategies (including experimental and other quantitative and qualitative... demonstration. (ii) CMS will consider alternative evaluation designs when quantitative designs are technically...

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

A Qualitative Evaluation of Instructors' Exam Questions at a Primary Education Department in Terms of Certain Variables

ERIC Educational Resources Information Center

Demir, Mehmet Kaan; Eryaman, Mustafa Yunus

2012-01-01

The purpose of this qualitative research study is to analyze instructors' exam questions at a Primary Education Department in terms of the exam's period, the comprehensibility of the instructions, cognitive level, and the appropriateness to the critical thinking. This qualitative study is based on document analysis method. 100 randomly selected…

Evaluating the comparative effectiveness of different demand side interventions to increase maternal health service utilization and practice of birth spacing in South Kivu, Democratic Republic of Congo: an innovative, mixed methods approach.

PubMed

Dumbaugh, Mari; Bapolisi, Wyvine; van de Weerd, Jennie; Zabiti, Michel; Mommers, Paula; Balaluka, Ghislain Bisimwa; Merten, Sonja

2017-07-03

In this protocol we describe a mixed methods study in the province of South Kivu, Democratic Republic of Congo evaluating the effectiveness of different demand side strategies to increase maternal health service utilization and the practice of birth spacing. Conditional service subsidization, conditional cash transfers and non-monetary incentives aim to encourage women to use maternal health services and practice birth spacing in two different health districts. Our methodology will comparatively evaluate the effectiveness of different approaches against each other and no intervention. This study comprises four main research activities: 1) Formative qualitative research to determine feasibility of planned activities and inform development of the quantitative survey; 2) A community-based, longitudinal survey; 3) A retrospective review of health facility records; 4) Qualitative exploration of intervention acceptability and emergent themes through in-depth interviews with program participants, non-participants, their partners and health providers. Female community health workers are engaged as core members of the research team, working in tandem with female survey teams to identify women in the community who meet eligibility criteria. Female community health workers also act as key informants and community entry points during methods design and qualitative exploration. Main study outcomes are completion of antenatal care, institutional delivery, practice of birth spacing, family planning uptake and intervention acceptability in the communities. Qualitative methods also explore decision making around maternal health service use, fertility preference and perceptions of family planning. The innovative mixed methods design allows quantitative data to inform the relationships and phenomena to be explored in qualitative collection. In turn, qualitative findings will be triangulated with quantitative findings. Inspired by the principles of grounded theory, qualitative analysis will begin while data collection is ongoing. This "conversation" between quantitative and qualitative data will result in a more holistic, context-specific exploration and understanding of research topics, including the mechanisms through which the interventions are or are not effective. In addition, engagement of female community health workers as core members of the research team roots research methods in the realities of the community and provides teams with key informants who are simultaneously implicated in the health system, community and target population.

Evaluation of the Cultural Elements in the Textbook "Genki I: an Integrated Course in Elementary Japanese"

ERIC Educational Resources Information Center

Er, Onur

2017-01-01

This study aims to examine the textbook "Genki I: An Integrated Course in Elementary Japanese" in terms of cultural elements. The data of this qualitative research were collected by means of the document review method. Content analysis, one of the qualitative analysis techniques, was used in the evaluation of the research data. A second…

Using qualitative and quantitative methods to evaluate small-scale disease management pilot programs.

PubMed

Esposito, Dominick; Taylor, Erin Fries; Gold, Marsha

2009-02-01

Interest in disease management programs continues to grow as managed care plans, the federal and state governments, and other organizations consider such efforts as a means to improve health care quality and reduce costs. These efforts vary in size, scope, and target population. While large-scale programs provide the means to measure impacts, evaluation of smaller interventions remains valuable as they often represent the early planning stages of larger initiatives. This paper describes a multi-method approach for evaluating small interventions that sought to improve the quality of care for Medicaid beneficiaries with multiple chronic conditions. Our approach relied on quantitative and qualitative methods to develop a complete understanding of each intervention. Quantitative data in the form of both process measures, such as case manager contacts, and outcome measures, such as hospital use, were reported and analyzed. Qualitative information was collected through interviews and the development of logic models to document the flow of intervention activities and how they were intended to affect outcomes. The logic models helped us to understand the underlying reasons for the success or lack thereof of each intervention. The analysis provides useful information on several fronts. First, qualitative data provided valuable information about implementation. Second, process measures helped determine whether implementation occurred as anticipated. Third, outcome measures indicated the potential for favorable results later, possibly suggesting further study. Finally, the evaluation of qualitative and quantitative data in combination helped us assess the potential promise of each intervention and identify common themes and challenges across all interventions.

Designing a mixed methods study in primary care.

PubMed

Creswell, John W; Fetters, Michael D; Ivankova, Nataliya V

2004-01-01

Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research.

Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ

PubMed Central

2012-01-01

Background The syntheses of multiple qualitative studies can pull together data across different contexts, generate new theoretical or conceptual models, identify research gaps, and provide evidence for the development, implementation and evaluation of health interventions. This study aims to develop a framework for reporting the synthesis of qualitative health research. Methods We conducted a comprehensive search for guidance and reviews relevant to the synthesis of qualitative research, methodology papers, and published syntheses of qualitative health research in MEDLINE, Embase, CINAHL and relevant organisational websites to May 2011. Initial items were generated inductively from guides to synthesizing qualitative health research. The preliminary checklist was piloted against forty published syntheses of qualitative research, purposively selected to capture a range of year of publication, methods and methodologies, and health topics. We removed items that were duplicated, impractical to assess, and rephrased items for clarity. Results The Enhancing transparency in reporting the synthesis of qualitative research (ENTREQ) statement consists of 21 items grouped into five main domains: introduction, methods and methodology, literature search and selection, appraisal, and synthesis of findings. Conclusions The ENTREQ statement can help researchers to report the stages most commonly associated with the synthesis of qualitative health research: searching and selecting qualitative research, quality appraisal, and methods for synthesising qualitative findings. The synthesis of qualitative research is an expanding and evolving methodological area and we would value feedback from all stakeholders for the continued development and extension of the ENTREQ statement. PMID:23185978

Reflections on Empowerment Evaluation: Learning from Experience.

ERIC Educational Resources Information Center

Fetterman, David M.

1999-01-01

Reflects on empowerment evaluation, the use of evaluation to foster improvement and self-determination. Empowerment evaluation uses quantitative and qualitative methods, and usually focuses on program evaluation. Discusses the growth in empowerment evaluation as a result of interest in participatory evaluation. (SLD)

Methodological challenges in cross-language qualitative research: a research review.

PubMed

Squires, Allison

2009-02-01

Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this analysis of cross-language qualitative research was threefold: (1) review the methods literature addressing cross-language research; (2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; (3) test these criteria on published cross-language qualitative studies. A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant's language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically.

Bridging informatics and implementation science: evaluating a framework to assess electronic health record implementations in community settings.

PubMed

Richardson, Joshua E; Abramson, Erika L; Pfoh, Elizabeth R; Kaushal, Rainu

2012-01-01

Effective electronic health record (EHR) implementations in community settings are critical to promoting safe and reliable EHR use as well as mitigating provider dissatisfaction that often results. The implementation challenge is compounded given the scale and scope of EHR installations that are occurring and will continue to occur over the next five years. However, when compared to EHR evaluations relatively few biomedical informatics researchers have published on evaluating EHR implementations. Fewer still have evaluated EHR implementations in community settings. We report on the methods we used to achieve a novel application of an implementation science framework in informatics to qualitatively evaluate community-based EHR implementations. We briefly provide an overview of the implementation science framework, our methods for adapting it to informatics, the effects the framework had on our qualitative methods of inquiry and analysis, and discuss its potential value for informatics research.

Designing A Mixed Methods Study In Primary Care

PubMed Central

Creswell, John W.; Fetters, Michael D.; Ivankova, Nataliya V.

2004-01-01

BACKGROUND Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. METHODS We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. RESULTS Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. DISCUSSION We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research. PMID:15053277

Discovering the Future of the Case Study Method in Evaluation Research.

ERIC Educational Resources Information Center

Yin, Robert K.

1994-01-01

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

Evaluation of bone marrow aspirates in patients with acute myeloid leukemia at day 14 of induction therapy.

PubMed

Souto Filho, João Tadeu D; Loureiro, Monique M; Pulcheri, Wolmar; Morais, José Carlos; Nucci, Marcio; Portugal, Rodrigo D

2015-07-25

Early assessment of response to chemotherapy in acute myeloid leukemia may be performed by examining bone marrow aspirate (BMA) or biopsy (BMB); a hypocellular bone marrow sample indicates adequate anti-leukemic activity. We sought to evaluate the quantitative and qualitative assessment of BMA performed on day 14 (D14) of chemotherapy, to verify the inter-observer agreement, to compare the results of BMA and BMB, and to evaluate the impact of D14 blast clearance on the overall survival (OS). A total of 107 patients who received standard induction chemotherapy and had bone marrow samples were included. BMA evaluation was performed by two observers using two methods: quantitative assessment and a qualitative (Likert) scale. ROC curves were obtained correlating the BMA quantification of blasts and the qualitative scale, by both observers, with BMB result as gold-standard. There was a significant agreement between the two observers in both the qualitative and quantitative assessments (Kw = 0.737, p < 0.001, and rs = 0.798, p < 0.001; ICC = 0.836, p < 0.001, respectively). The areas under the curve (AUC) were 0.924 and 0.946 for observer 1 and 0.867 and 0.870 for observer 2 for assessments of the percentage of blasts and qualitative scale, respectively. The best cutoff for blast percentage in BMA was 6% and 7% for observers 1 and 2, respectively. A similar analysis for the qualitative scale showed the best cutoff as "probably infiltrated". Patients who attained higher grades of cytoreduction on D14 had better OS. Evaluation of D14 BMA using both methods had a significant agreement with BMB and between observers, identifying a population of patients with poor outcome.

[Modality of combined methods of quantitative and qualitative research in evaluation of therapeutic effects of Chinese medicine].

PubMed

Liu, Jian-ping

2011-05-01

The core of evidence-based medicine lies in implementing the current best available evidence of clinical research to direct the decision making in clinical practice, incorporation of individual experience and value and preference of patients. However, the current evaluation method for clinical therapeutic effect cannot reflect the humanity and wholesomeness as well as individualized tailored treatment of Chinese medicine (CM) by using randomized controlled trials. This assay addressed the complex intervention of highly individualized treatment of CM and its societal characteristics, and the author proposes a model for the evaluation of therapeutic effects of CM in which quantitative and qualitative methods are combined, embodying the characteristics of the social and natural sciences in CM. The model can show the dynamic process of CM diagnosis and treatment from a perspective of the whole system and can be used for the evaluation of complex intervention of CM. We hope to raise a different thinking and method from the new drug development in the therapeutic effect evaluation.

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing students’ clinical competencies seems necessary. PMID:24554959

Qualitative methods in PhD theses from general practice in Scandinavia.

PubMed

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-12-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox.

Qualitative methods in PhD theses from general practice in Scandinavia

PubMed Central

Malterud, Kirsti; Hamberg, Katarina; Reventlow, Susanne

2017-01-01

Qualitative methodology is gaining increasing attention and esteem in medical research, with general practice research taking a lead. With these methods, human and social interaction and meaning can be explored and shared by systematic interpretation of text from talk, observation or video. Qualitative studies are often included in Ph.D. theses from general practice in Scandinavia. Still, the Ph.D. programs across nations and institutions offer only limited training in qualitative methods. In this opinion article, we draw upon our observations and experiences, unpacking and reflecting upon values and challenges at stake when qualitative studies are included in Ph.D. theses. Hypotheses to explain these observations are presented, followed by suggestions for standards of evaluation and improvement of Ph.D. programs. The authors conclude that multimethod Ph.D. theses should be encouraged in general practice research, in order to offer future researchers an appropriate toolbox. PMID:29094644

Qualitative Secondary Analysis: A Case Exemplar.

PubMed

Tate, Judith Ann; Happ, Mary Beth

Qualitative secondary analysis (QSA) is the use of qualitative data that was collected by someone else or was collected to answer a different research question. Secondary analysis of qualitative data provides an opportunity to maximize data utility, particularly with difficult-to-reach patient populations. However, qualitative secondary analysis methods require careful consideration and explicit description to best understand, contextualize, and evaluate the research results. In this article, we describe methodologic considerations using a case exemplar to illustrate challenges specific to qualitative secondary analysis and strategies to overcome them. Copyright © 2017 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Evaluation of the Michigan Public School Academy Initiative: Final Report [and] Executive Summary.

ERIC Educational Resources Information Center

Horn, Jerry; Miron, Gary

This is the final report of a one-year evaluation of the Michigan Public School Academy (PSA) initiative. The evaluation involved both formative and summative evaluations and used both qualitative and quantitative methods. The study was conducted between October 1997 and December 1998. Data-collection methods included a charter-school survey and a…

Qualitative research in rehabilitation science: opportunities, challenges, and future directions.

PubMed

VanderKaay, Sandra; Moll, Sandra E; Gewurtz, Rebecca E; Jindal, Pranay; Loyola-Sanchez, Adalberto; Packham, Tara L; Lim, Chun Y

2018-03-01

Qualitative research has had a significant impact within rehabilitation science over time. During the past 20 years the number of qualitative studies published per year in Disability and Rehabilitation has markedly increased (from 1 to 54). In addition, during this period there have been significant changes in how qualitative research is conceptualized, conducted, and utilized to advance the field of rehabilitation. The purpose of this article is to reflect upon the progress of qualitative research within rehabilitation to date, to explicate current opportunities and challenges, and to suggest future directions to continue to strengthen the contribution of qualitative research in this field. Relevant literature searches were conducted in electronic data bases and reference lists. Pertinent literature was examined to identify current opportunities and challenges for qualitative research use in rehabilitation and to identify future directions. Six key areas of opportunity and challenge were identified: (a) paradigm shifts, (b) advancements in methodology, (c) emerging technology, (d) advances in quality evaluation, (e) increasing popularity of mixed methods approaches, and (f) evolving approaches to knowledge translation. Two important future directions for rehabilitation are posited: (1) advanced training in qualitative methods and (2) engaging qualitative communities of research. Qualitative research is well established in rehabilitation and has an important place in the continued growth of this field. Ongoing development of qualitative researchers and methods are essential. Implications for Rehabilitation Qualitative research has the potential to improve rehabilitation practice by addressing some of the most pervasive concerns in the field such as practitioner-client interaction, the subjective and lived experience of disability, and clinical reasoning and decision making. This will serve to better inform those providing rehabilitation services thereby benefiting patients that are utilizing these services. Changes over time in how qualitative research is conceptualized, conducted, and utilized to advance rehabilitation science have resulted in a number of unique opportunities and challenges in using qualitative research that must be considered within this field. Advances in methodology and increased expectations for evaluation must be considered to ensure quality and credibility of qualitative rehabilitation research within rehabilitation. Improved quality and credibility may increase likelihood of research dissemination and use by clinicians intervening within the rehabilitation process in order to improve clinical practice. In order to maximize opportunities and mitigate challenges there are two principal future directions for rehabilitation scientists to consider: (1) advancing training in qualitative methods to adequately prepare future rehabilitation scientists and (2) engaging qualitative communities of research.

An Innovative Method to Involve Community Health Workers as Partners in Evaluation Research

PubMed Central

Issel, L. Michele; Townsell, Stephanie J.; Chapple-McGruder, Theresa; Handler, Arden

2011-01-01

Objectives. We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Methods. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Results. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Conclusions. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training. PMID:22021290

An innovative method to involve community health workers as partners in evaluation research.

PubMed

Peacock, Nadine; Issel, L Michele; Townsell, Stephanie J; Chapple-McGruder, Theresa; Handler, Arden

2011-12-01

We developed a process through which community outreach workers, whose role is not typically that of a trained researcher, could actively participate in collection of qualitative evaluation data. Outreach workers for a community-based intervention project received training in qualitative research methodology and certification in research ethics. They used a Voice over Internet Protocol phone-in system to provide narrative reports about challenges faced by women they encountered in their outreach activities as well as their own experiences as outreach workers. Qualitative data contributed by outreach workers provided insights not otherwise available to the evaluation team, including details about the complex lives of underserved women at risk for poor pregnancy outcomes and the challenges and rewards of the outreach worker role. Lay health workers can be a valuable asset as part of a research team. Training in research ethics and methods can be tailored to their educational level and preferences, and their insights provide important information and perspectives that may not be accessible via other data collection methods. Challenges encountered in the dual roles of researcher and lay health worker can be addressed in training.

Methodological Reflections on the Contribution of Qualitative Research to the Evaluation of Clinical Ethics Support Services.

PubMed

Wäscher, Sebastian; Salloch, Sabine; Ritter, Peter; Vollmann, Jochen; Schildmann, Jan

2017-05-01

This article describes a process of developing, implementing and evaluating a clinical ethics support service intervention with the goal of building up a context-sensitive structure of minimal clinical-ethics in an oncology department without prior clinical ethics structure. Scholars from different disciplines have called for an improvement in the evaluation of clinical ethics support services (CESS) for different reasons over several decades. However, while a lot has been said about the concepts and methodological challenges of evaluating CESS up to the present time, relatively few empirical studies have been carried out. The aim of this article is twofold. On the one hand, it describes a process of development, modifying and evaluating a CESS intervention as part of the ETHICO research project, using the approach of qualitative-formative evaluation. On the other hand, it provides a methodological analysis which specifies the contribution of qualitative empirical methods to the (formative) evaluation of CESS. We conclude with a consideration of the strengths and limitations of qualitative evaluation research with regards to the evaluation and development of context sensitive CESS. We further discuss our own approach in contrast to rather traditional consult or committee models. © 2017 John Wiley & Sons Ltd.

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

New method for qualitative simulations of water resources systems. 2. Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Antunes, M.P.; Seixas, M.J.; Camara, A.S.

1987-11-01

SLIN (Simulacao Linguistica) is a new method for qualitative dynamic simulation. As was presented previously, SLIN relies upon a categorical representation of variables which are manipulated by logical rules. Two applications to water resources systems are included to illustrate SLIN's potential usefulness: the environmental impact evaluation of a hydropower plant and the assessment of oil dispersion in the sea after a tanker wreck.

On the evaluation of segmentation editing tools

PubMed Central

Heckel, Frank; Moltz, Jan H.; Meine, Hans; Geisler, Benjamin; Kießling, Andreas; D’Anastasi, Melvin; dos Santos, Daniel Pinto; Theruvath, Ashok Joseph; Hahn, Horst K.

2014-01-01

Abstract. Efficient segmentation editing tools are important components in the segmentation process, as no automatic methods exist that always generate sufficient results. Evaluating segmentation editing algorithms is challenging, because their quality depends on the user’s subjective impression. So far, no established methods for an objective, comprehensive evaluation of such tools exist and, particularly, intermediate segmentation results are not taken into account. We discuss the evaluation of editing algorithms in the context of tumor segmentation in computed tomography. We propose a rating scheme to qualitatively measure the accuracy and efficiency of editing tools in user studies. In order to objectively summarize the overall quality, we propose two scores based on the subjective rating and the quantified segmentation quality over time. Finally, a simulation-based evaluation approach is discussed, which allows a more reproducible evaluation without the need for human input. This automated evaluation complements user studies, allowing a more convincing evaluation, particularly during development, where frequent user studies are not possible. The proposed methods have been used to evaluate two dedicated editing algorithms on 131 representative tumor segmentations. We show how the comparison of editing algorithms benefits from the proposed methods. Our results also show the correlation of the suggested quality score with the qualitative ratings. PMID:26158063

A comparative study of qualitative and quantitative methods for the assessment of adhesive remnant after bracket debonding.

PubMed

Cehreli, S Burcak; Polat-Ozsoy, Omur; Sar, Cagla; Cubukcu, H Evren; Cehreli, Zafer C

2012-04-01

The amount of the residual adhesive after bracket debonding is frequently assessed in a qualitative manner, utilizing the adhesive remnant index (ARI). This study aimed to investigate whether quantitative assessment of the adhesive remnant yields more precise results compared to qualitative methods utilizing the 4- and 5-point ARI scales. Twenty debonded brackets were selected. Evaluation and scoring of the adhesive remnant on bracket bases were made consecutively using: 1. qualitative assessment (visual scoring) and 2. quantitative measurement (image analysis) on digital photographs. Image analysis was made on scanning electron micrographs (SEM) and high-precision elemental maps of the adhesive remnant as determined by energy dispersed X-ray spectrometry. Evaluations were made in accordance with the original 4-point and the modified 5-point ARI scales. Intra-class correlation coefficients (ICCs) were calculated, and the data were evaluated using Friedman test followed by Wilcoxon signed ranks test with Bonferroni correction. ICC statistics indicated high levels of agreement for qualitative visual scoring among examiners. The 4-point ARI scale was compliant with the SEM assessments but indicated significantly less adhesive remnant compared to the results of quantitative elemental mapping. When the 5-point scale was used, both quantitative techniques yielded similar results with those obtained qualitatively. These results indicate that qualitative visual scoring using the ARI is capable of generating similar results with those assessed by quantitative image analysis techniques. In particular, visual scoring with the 5-point ARI scale can yield similar results with both the SEM analysis and elemental mapping.

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

Inter-observer agreement improves with PERCIST 1.0 as opposed to qualitative evaluation in non-small cell lung cancer patients evaluated with F-18-FDG PET/CT early in the course of chemo-radiotherapy.

PubMed

Fledelius, Joan; Khalil, Azza; Hjorthaug, Karin; Frøkiær, Jørgen

2016-12-01

The purpose of this study is to determine whether a qualitative approach or a semi-quantitative approach provides the most robust method for early response evaluation with 2'-deoxy-2'-[(18)F]fluoro-D-glucose (F-18-FDG) positron emission tomography combined with whole body computed tomography (PET/CT) in non-small cell lung cancer (NSCLC). In this study eight Nuclear Medicine consultants analyzed F-18-FDG PET/CT scans from 35 patients with locally advanced NSCLC. Scans were performed at baseline and after 2 cycles of chemotherapy. Each observer used two different methods for evaluation: (1) PET response criteria in solid tumors (PERCIST) 1.0 and (2) a qualitative approach. Both methods allocate patients into one of four response categories (complete and partial metabolic response (CMR and PMR) and stable and progressive metabolic disease (SMD and PMD)). The inter-observer agreement was evaluated using Fleiss' kappa for multiple raters, Cohens kappa for comparison of the two methods, and intraclass correlation coefficients (ICC) for comparison of lean body mass corrected standardized uptake value (SUL) peak measurements. The agreement between observers when determining the percentage change in SULpeak was "almost perfect", with ICC = 0.959. There was a strong agreement among observers allocating patients to the different response categories with a Fleiss kappa of 0.76 (0.71-0.81). In 22 of the 35 patients, complete agreement was observed with PERCIST 1.0. The agreement was lower when using the qualitative method, moderate, having a Fleiss kappa of 0.60 (0.55-0.64). Complete agreement was achieved in only 10 of the 35 patients. The difference between the two methods was statistically significant (p < 0.005) (chi-squared). Comparing the two methods for each individual observer showed Cohen's kappa values ranging from 0.64 to 0.79, translating into a strong agreement between the two methods. PERCIST 1.0 provides a higher overall agreement between observers than the qualitative approach in categorizing early treatment response in NSCLC patients. The inter-observer agreement is in fact strong when using PERCIST 1.0 even when the level of instruction is purposely kept to a minimum in order to mimic the everyday situation. The variability is largely owing to the subjective elements of the method.

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Noninvasive method for assessing the human circadian clock using hair follicle cells

PubMed Central

Akashi, Makoto; Soma, Haruhiko; Yamamoto, Takuro; Tsugitomi, Asuka; Yamashita, Shiko; Yamamoto, Takuya; Nishida, Eisuke; Yasuda, Akio; Liao, James K.; Node, Koichi

2010-01-01

A thorough understanding of the circadian clock requires qualitative evaluation of circadian clock gene expression. Thus far, no simple and effective method for detecting human clock gene expression has become available. This limitation has greatly hampered our understanding of human circadian rhythm. Here we report a convenient, reliable, and less invasive method for detecting human clock gene expression using biopsy samples of hair follicle cells from the head or chin. We show that the circadian phase of clock gene expression in hair follicle cells accurately reflects that of individual behavioral rhythms, demonstrating that this strategy is appropriate for evaluating the human peripheral circadian clock. Furthermore, using this method, we indicate that rotating shift workers suffer from a serious time lag between circadian gene expression rhythms and lifestyle. Qualitative evaluation of clock gene expression in hair follicle cells, therefore, may be an effective approach for studying the human circadian clock in the clinical setting. PMID:20798039

Practicable group testing method to evaluate weight/weight GMO content in maize grains.

PubMed

Mano, Junichi; Yanaka, Yuka; Ikezu, Yoko; Onishi, Mari; Futo, Satoshi; Minegishi, Yasutaka; Ninomiya, Kenji; Yotsuyanagi, Yuichi; Spiegelhalter, Frank; Akiyama, Hiroshi; Teshima, Reiko; Hino, Akihiro; Naito, Shigehiro; Koiwa, Tomohiro; Takabatake, Reona; Furui, Satoshi; Kitta, Kazumi

2011-07-13

Because of the increasing use of maize hybrids with genetically modified (GM) stacked events, the established and commonly used bulk sample methods for PCR quantification of GM maize in non-GM maize are prone to overestimate the GM organism (GMO) content, compared to the actual weight/weight percentage of GM maize in the grain sample. As an alternative method, we designed and assessed a group testing strategy in which the GMO content is statistically evaluated based on qualitative analyses of multiple small pools, consisting of 20 maize kernels each. This approach enables the GMO content evaluation on a weight/weight basis, irrespective of the presence of stacked-event kernels. To enhance the method's user-friendliness in routine application, we devised an easy-to-use PCR-based qualitative analytical method comprising a sample preparation step in which 20 maize kernels are ground in a lysis buffer and a subsequent PCR assay in which the lysate is directly used as a DNA template. This method was validated in a multilaboratory collaborative trial.

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets

PubMed Central

2017-01-01

Background To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. Methods In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Results Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Conclusions Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate the time and resources required to incorporate qualitative methods into COS development. PMID:28301485

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

PubMed

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development. To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care. Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients' experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor's knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. 'Resistance' emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines. The synthesis of studies of lay experiences of living with rheumatoid arthritis began with 29 papers. Four could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with rheumatoid arthritis. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory. In both topic areas, only a minority of the studies included in the syntheses were found to have referenced each other, suggesting that unnecessary replication had occurred. We only evaluated meta-ethnography as a method for synthesising qualitative research, but there are other methods being employed. Further research is required to investigate how different methods of qualitative synthesis influence the outcome of the synthesis. Meta-ethnography is an effective method for synthesising qualitative research. The process of reciprocally translating the findings from each individual study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a 'line of argument' that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, but not all meta-ethnographic syntheses do so. Instead, some will identify fields in which saturation has been reached and in which no theoretical development has taken place for some time. Both outcomes are helpful in either moving research forward or avoiding wasted resources. Meta-ethnography is a highly interpretative method requiring considerable immersion in the individual studies to achieve a synthesis. It places substantial demands upon the synthesiser and requires a high degree of qualitative research skill. Meta-ethnography has great potential as a method of synthesis in qualitative health technology assessment but it is still evolving and cannot, at present, be regarded as a standardised approach capable of application in a routinised way. Funding for this study was provided by the Health Technology Assessment programme of the National Institute for Health Research.

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.

Protocol for the mixed-methods process and context evaluation of the TB & Tobacco randomised controlled trial in Bangladesh and Pakistan: a hybrid effectiveness–implementation study

PubMed Central

Nohavova, Iveta; Dogar, Omara; Kralikova, Eva; Pankova, Alexandra; Zvolska, Kamila; Huque, Rumana; Fatima, Razia; Noor, Maryam; Elsey, Helen; Sheikh, Aziz; Siddiqi, Kamran; Kotz, Daniel

2018-01-01

Introduction Tuberculosis (TB) remains a significant public health problem in South Asia. Tobacco use increases the risks of TB infection and TB progression. The TB& Tobacco placebo-controlled randomised trial aims to (1) assess the effectiveness of the tobacco cessation medication cytisine versus placebo when combined with behavioural support and (2) implement tobacco cessation medication and behavioural support as part of general TB care in Bangladesh and Pakistan. This paper summarises the process and context evaluation protocol embedded in the effectiveness–implementation hybrid design. Methods and analysis We are conducting a mixed-methods process and context evaluation informed by an intervention logic model that draws on the UK Medical Research Council’s Process Evaluation Guidance. Our approach includes quantitative and qualitative data collection on context, recruitment, reach, dose delivered, dose received and fidelity. Quantitative data include patient characteristics, reach of recruitment among eligible patients, routine trial data on dose delivered and dose received, and a COM-B (‘capability’, ‘opportunity’, ‘motivation’ and ‘behaviour’) questionnaire filled in by participating health workers. Qualitative data include semistructured interviews with TB health workers and patients, and with policy-makers at district and central levels in each country. Interviews will be analysed using the framework approach. The behavioural intervention delivery is audio recorded and assessed using a predefined fidelity coding index based on behavioural change technique taxonomy. Ethics and dissemination The study complies with the guidelines of the Declaration of Helsinki. Ethics approval for the study and process evaluation was granted by the University of Leeds (qualitative components), University of York (trial data and fidelity assessment), Bangladesh Medical Research Council and Bangladesh Drug Administration (trial data and qualitative components) and Pakistan Medical Research Council (trial data and qualitative components). Results of this research will be disseminated through reports to stakeholders and peer-reviewed publications and conference presentations. Trial registration number ISRCTN43811467; Pre-results. PMID:29602847

An Exploratory Study of the United States Naval Academy Engineering Curriculum

DTIC Science & Technology

2007-06-01

research was conducted in an entirely quantitative fashion. There is a large amount of qualitative data that was not analyzed. These data are from the... qualitative assessment of the Naval Academy’s engineering program, and would be an excellent opportunity for future research . Overall, the results of...California: Sage Publications. Patton, M. Q. (1987). How to Use Qualitative Methods in Evaluation. California: Sage Publications. 89

Mentoring doctoral students for qualitative research: interviews with experienced nursing faculty in Japan.

PubMed

Kayama, Mami; Gregg, Misuzu F; Asahara, Kiyomi; Yamamoto-Mitani, Noriko; Okuma, Keiko; Ohta, Kikuko; Kinoshita, Yasuhito

2013-05-01

This study aimed to describe the process of mentoring doctoral students for qualitative research in Japanese graduate programs in nursing. Nine experienced faculty-seven nurse researchers and two sociologists-were interviewed. Participants were asked about their process of mentoring students for qualitative nursing dissertations. Data analysis was conducted using a qualitative descriptive method. Participants' age ranged from 48 to 60 years. The first theme in the mentoring process is about the individualized, one-on-one mentorship process. The second theme occurs in a group process. The third theme is coordinating mentors and establishing a network to support the evaluation system. The mentoring processes identified in this study will be useful for future faculty development. The study elucidated much room for improvement in doctoral education programs for qualitative research methods in nursing science. Copyright 2013, SLACK Incorporated.

Multiple and mixed methods in formative evaluation: Is more better? Reflections from a South African study.

PubMed

Odendaal, Willem; Atkins, Salla; Lewin, Simon

2016-12-15

Formative programme evaluations assess intervention implementation processes, and are seen widely as a way of unlocking the 'black box' of any programme in order to explore and understand why a programme functions as it does. However, few critical assessments of the methods used in such evaluations are available, and there are especially few that reflect on how well the evaluation achieved its objectives. This paper describes a formative evaluation of a community-based lay health worker programme for TB and HIV/AIDS clients across three low-income communities in South Africa. It assesses each of the methods used in relation to the evaluation objectives, and offers suggestions on ways of optimising the use of multiple, mixed-methods within formative evaluations of complex health system interventions. The evaluation's qualitative methods comprised interviews, focus groups, observations and diary keeping. Quantitative methods included a time-and-motion study of the lay health workers' scope of practice and a client survey. The authors conceptualised and conducted the evaluation, and through iterative discussions, assessed the methods used and their results. Overall, the evaluation highlighted programme issues and insights beyond the reach of traditional single methods evaluations. The strengths of the multiple, mixed-methods in this evaluation included a detailed description and nuanced understanding of the programme and its implementation, and triangulation of the perspectives and experiences of clients, lay health workers, and programme managers. However, the use of multiple methods needs to be carefully planned and implemented as this approach can overstretch the logistic and analytic resources of an evaluation. For complex interventions, formative evaluation designs including multiple qualitative and quantitative methods hold distinct advantages over single method evaluations. However, their value is not in the number of methods used, but in how each method matches the evaluation questions and the scientific integrity with which the methods are selected and implemented.

Prospects for Public Library Evaluation.

ERIC Educational Resources Information Center

Van House, Nancy A.; Childers, Thomas

1991-01-01

Discusses methods of evaluation that can be used to measure public library effectiveness, based on a conference sponsored by the Council on Library Resources. Topics discussed include the Public Library Effectiveness Study (PLES), quantitative and qualitative evaluation, using evaluative information for resource acquisition and resource…

Measures of fish behavior as indicators of sublethal toxicosis during standard toxicity tests

USGS Publications Warehouse

Little, E.E.; DeLonay, A.J.

1996-01-01

Behavioral functions essential for growth and survival can be dramatically altered by sublethal exposure to toxicants. Measures of these behavioral responses are effective in detecting adverse effects of sublethal contaminant exposure. Behavioral responses of fishes can be qualitatively and quantitatively evaluated during routine toxicity tests. At selected intervals of exposure, qualitative evaluations are accomplished through direct observations, whereas video recordings are used for quantitative evaluations. Standardized procedures for behavioral evaluation are readily applicable to different fish species and provide rapid, sensitive, and ecologically relevant assessments of sublethal exposure. The methods are readily applied to standardized test protocols.

Alumni Perspectives on Career Preparation during a Postdoctoral Training Program: A Qualitative Study

ERIC Educational Resources Information Center

Faupel-Badger, Jessica M.; Raue, Kimberley; Nelson, David E.; Tsakraklides, Sophia

2015-01-01

Published evaluations of career preparation of alumni from long-standing postdoctoral fellowship programs in the biomedical sciences are limited and often focus on quantitative analysis of data from extant publicly available sources. Qualitative methods provide the opportunity to gather robust information about specific program elements from…

Integration of a Professional Dancer into College

ERIC Educational Resources Information Center

Pulinkala, Ivan

2011-01-01

This paper evaluates the experience of integrating a professional dancer into a collegiate environment using a case study method of qualitative research. Interviews, focus groups, observation studies and document analysis techniques were used to gather qualitative data for this study. The innovation of diffusion theory was used to highlight the…

A review of patient and carer participation and the use of qualitative research in the development of core outcome sets.

PubMed

Jones, Janet E; Jones, Laura L; Keeley, Thomas J H; Calvert, Melanie J; Mathers, Jonathan

2017-01-01

To be meaningful, a core outcome set (COS) should be relevant to all stakeholders including patients and carers. This review aimed to explore the methods by which patients and carers have been included as participants in COS development exercises and, in particular, the use and reporting of qualitative methods. In August 2015, a search of the Core Outcomes Measures in Effectiveness Trials (COMET) database was undertaken to identify papers involving patients and carers in COS development. Data were extracted to identify the data collection methods used in COS development, the number of health professionals, patients and carers participating in these, and the reported details of qualitative research undertaken. Fifty-nine papers reporting patient and carer participation were included in the review, ten of which reported using qualitative methods. Although patients and carers participated in outcome elicitation for inclusion in COS processes, health professionals tended to dominate the prioritisation exercises. Of the ten qualitative papers, only three were reported as a clear pre-designed part of a COS process. Qualitative data were collected using interviews, focus groups or a combination of these. None of the qualitative papers reported an underpinning methodological framework and details regarding data saturation, reflexivity and resource use associated with data collection were often poorly reported. Five papers reported difficulty in achieving a diverse sample of participants and two reported that a large and varied range of outcomes were often identified by participants making subsequent rating and ranking difficult. Consideration of the best way to include patients and carers throughout the COS development process is needed. Additionally, further work is required to assess the potential role of qualitative methods in COS, to explore the knowledge produced by different qualitative data collection methods, and to evaluate the time and resources required to incorporate qualitative methods into COS development.

Portfolio assessment and evaluation: implications and guidelines for clinical nursing education.

PubMed

Chabeli, M M

2002-08-01

With the advent of Outcomes-Based Education in South Africa, the quality of nursing education is debatable, especially with regard to the assessment and evaluation of clinical nursing education, which is complex and renders the validity and reliability of the methods used questionable. This paper seeks to explore and describe the use of portfolio assessment and evaluation, its implications and guidelines for its effective use in nursing education. Firstly, the concepts of assessment, evaluation, portfolio and alternative methods of evaluation are defined. Secondly, a comparison of the characteristics of the old (traditional) methods and the new alternative methods of evaluation is made. Thirdly, through deductive analysis, synthesis and inference, implications and guidelines for the effective use of portfolio assessment and evaluation are described. In view of the qualitative, descriptive and exploratory nature of the study, a focus group interview with twenty students following a post-basic degree at a university in Gauteng regarding their perceptions on the use of portfolio assessment and evaluation method in clinical nursing education was used. A descriptive method of qualitative data analysis of open coding in accordance with Tesch's protocol (in Creswell 1994:155) was used. Resultant implications and guidelines were conceptualised and described within the existing theoretical framework. Principles of trustworthiness were maintained as described by (Lincoln & Guba 1985:290-327). Ethical considerations were in accordance with DENOSA's standards of research (1998:7).

A comparison of in vitro cytotoxicity assays in medical device regulatory studies.

PubMed

Liu, Xuemei; Rodeheaver, Denise P; White, Jeffrey C; Wright, Ann M; Walker, Lisa M; Zhang, Fan; Shannon, Stephen

2018-06-06

Medical device biocompatibility testing is used to evaluate the risk of adverse effects on tissues from exposure to leachates/extracts. A battery of tests is typically recommended in accordance with regulatory standards to determine if the device is biocompatible. In vitro cytotoxicity, a key element of the standards, is a required endpoint for all types of medical devices. Each validated cytotoxicity method has different methodology and acceptance criteria that could influence the selection of a specific test. In addition, some guidances are more specific than others as to the recommended test methods. For example, the International Organization for Standardization (ISO 1 ) cites preference for quantitative methods (e.g., tetrazolium (MTT/XTT), neutral red (NR), or colony formation assays (CFA)) over qualitative methods (e.g., elution, agar overlay/diffusion, or direct), while a recent ISO standard for contact lens/lens care solutions specifically requires a qualitative direct test. Qualitative methods are described in United States Pharmacopeia (USP) while quantitative CFAs are listed in Japan guidance. The aim of this review is to compare the methodologies such as test article preparation, test conditions, and criteria for six cytotoxicity methods recommended in regulatory standards in order to inform decisions on which method(s) to select during the medical device safety evaluation. Copyright © 2018. Published by Elsevier Inc.

Do Different Training Conditions Facilitate Team Implementation? A Quasi-Experimental Mixed Methods Study

ERIC Educational Resources Information Center

Nielsen, Karina; Randall, Raymond; Christensen, Karl B.

2017-01-01

A mixed methods approach was applied to examine the effects of a naturally occurring teamwork intervention supported with training. The first objective was to integrate qualitative process evaluation and quantitative effect evaluation to examine "how" and "why" the training influence intervention outcomes. The intervention (N =…

[Application and Integration of Qualitative and Quantitative Research Methods in Intervention Studies in Rehabilitation Research].

PubMed

Wirtz, M A; Strohmer, J

2016-06-01

In order to develop and evaluate interventions in rehabilitation research a wide range of empirical research methods may be adopted. Qualitative research methods emphasize the relevance of an open research focus and a natural proximity to research objects. Accordingly, using qualitative methods special benefits may arise if researchers strive to identify and organize unknown information aspects (inductive purpose). Particularly, quantitative research methods require a high degree of standardization and transparency of the research process. Furthermore, a clear definition of efficacy and effectiveness exists (deductive purpose). These paradigmatic approaches are characterized by almost opposite key characteristics, application standards, purposes and quality criteria. Hence, specific aspects have to be regarded if researchers aim to select or combine those approaches in order to ensure an optimal gain in knowledge. © Georg Thieme Verlag KG Stuttgart · New York.

A new method for qualitative simulation of water resources systems: 2. Applications

NASA Astrophysics Data System (ADS)

Antunes, M. P.; Seixas, M. J.; Camara, A. S.; Pinheiro, M.

1987-11-01

SLIN (Simulação Linguistica) is a new method for qualitative dynamic simulation. As was presented previously (Camara et al., this issue), SLIN relies upon a categorical representation of variables which are manipulated by logical rules. Two applications to water resources systems are included to illustrate SLIN's potential usefulness: the environmental impact evaluation of a hydropower plant and the assessment of oil dispersion in the sea after a tanker wreck.

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

A Computational Approach to Qualitative Analysis in Large Textual Datasets

PubMed Central

Evans, Michael S.

2014-01-01

In this paper I introduce computational techniques to extend qualitative analysis into the study of large textual datasets. I demonstrate these techniques by using probabilistic topic modeling to analyze a broad sample of 14,952 documents published in major American newspapers from 1980 through 2012. I show how computational data mining techniques can identify and evaluate the significance of qualitatively distinct subjects of discussion across a wide range of public discourse. I also show how examining large textual datasets with computational methods can overcome methodological limitations of conventional qualitative methods, such as how to measure the impact of particular cases on broader discourse, how to validate substantive inferences from small samples of textual data, and how to determine if identified cases are part of a consistent temporal pattern. PMID:24498398

Serials Evaluation: An Innovative Approach.

ERIC Educational Resources Information Center

Berger, Marilyn; Devine, Jane

1990-01-01

Describes a method of analyzing serials collections in special libraries that combines evaluative criteria with database management technology. Choice of computer software is discussed, qualitative information used to evaluate subject coverage is examined, and quantitative and descriptive data that can be used for collection management are…

A Strengths-Based Group Intervention for Women Who Experienced Child Sexual Abuse

ERIC Educational Resources Information Center

Walker-Williams, Hayley J.; Fouché, Ansie

2017-01-01

Purpose: This study evaluated the benefits of a ''survivor to thriver'' strengths-based group intervention program to facilitate posttraumatic growth in women survivors of child sexual abuse. Method: A quasi-experimental, one group, pretest, posttest, time-delay design was employed using qualitative methods to evaluate the benefits of the…

A Holistic Approach to Evaluating Vocational Education: Traditional Chinese Physicians (TCP) Model.

ERIC Educational Resources Information Center

Lee, Lung-Sheng; Chang, Liang-Te

Conventional approaches to evaluating vocational education have often been criticized for failing to deal holistically with the institution or program being evaluated. Integrated quantitative and qualitative evaluation methods have documented benefits; therefore, it would be useful to consider possibility of developing a model for evaluating…

Evaluation of Educational Administration: A Decade Review of Research (2001-2010)

ERIC Educational Resources Information Center

Parylo, Oksana

2012-01-01

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

Evaluating Change in Medical School Curricula: How Did We Know Where We Were Going?

ERIC Educational Resources Information Center

Mahaffy, John; Gerrity, Martha S.

1998-01-01

Compares and contrasts the primary outcomes and methods used to evaluate curricular changes at eight medical schools participating in a large-scale medical curriculum development project. Describes how the evaluative data, both quantitative and qualitative, were collected, and how evaluation drove curricular change. Although the evaluations were…

Development and Validation of a Novel LC-MS/MS Opioid Confirmation Assay: Evaluation of β-glucuronidase Enzymes and Sample Cleanup Methods.

PubMed

Yang, He S; Wu, Alan H B; Lynch, Kara L

2016-06-01

With the rise in the use and misuse of prescription opioids, there is an increasing need for the confirmed identification of opioid analgesics in toxicology laboratories. The goals of this study were to (i) systematically evaluate the hydrolysis efficiency of four β-glucuronidase enzymes under optimized condition; (ii) evaluate compound recovery, matrix effects and precision of three protein precipitation plates and (iii) develop and validate a qualitative liquid-chromatography mass spectrometry (LC-MS/MS) assay to identify 13 opioids in urine. A recombinant β-glucuronidase exhibited the best overall hydrolysis efficiency for seven opioid glucuronide conjugates compared with β-glucuronidase from red abalone, Escherichia coli and Patella vulgata One of the protein precipitation plates tested exhibited overall better recovery of the opioids and lower ion suppression compared with the other two plates. An ESI positive mode LC-MS/MS assay for qualitative opioid analysis was developed and validated. Linearity, LOD, precision, matrix effect, recovery, carryover and interference of the method were evaluated. Sixty-two patient samples were analyzed by both a legacy GC-MS opioid method and the LC-MS/MS method, and 22 samples were analyzed by the LC-MS/MS and an LC-MS/MS reference method. The results of the comparisons showed good concordance. Overall, we described an efficient sample preparation procedure for a sensitive qualitative opioid confirmation assay in urine. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Building and critiquing qualitative research websites: a cyberspace project to connect undergraduate nursing students in Canada and the United States.

PubMed

Teel, Cynthia S; Shaw, Judith A

2005-01-01

This project had a dual purpose: 1) to facilitate student learning about qualitative research methods, and 2) to promote collegiality and professional development among senior nursing students in Canada and the United States through the use of distance technology. In each of three project years, students at St. Francis Xavier University (STFX) in Nova Scotia initiated the experience by working in small groups to develop websites about different methodological approaches in qualitative research. Site information included an overview of the selected approach, discussion of trustworthiness issues, citation of journal articles in which authors used the approach, additional references, and some personal information about the student developers. Also working in small groups, University of Kansas students identified and read related research articles, reviewed website information, and responded to the STFX groups about the usefulness of site information in increasing understanding of qualitative methods and using the information for evaluation of research. The experience promoted active use of qualitative research concepts and facilitated the development of skills in evaluating research article content and website content. Participation in the activity fostered positive perceptions about the value and use of research and helped students appreciate the similarities in courses, programs, and professional requirements and values among international peers.

Using hybrid method to evaluate the green performance in uncertainty.

PubMed

Tseng, Ming-Lang; Lan, Lawrence W; Wang, Ray; Chiu, Anthony; Cheng, Hui-Ping

2011-04-01

Green performance measure is vital for enterprises in making continuous improvements to maintain sustainable competitive advantages. Evaluation of green performance, however, is a challenging task due to the dependence complexity of the aspects, criteria, and the linguistic vagueness of some qualitative information and quantitative data together. To deal with this issue, this study proposes a novel approach to evaluate the dependence aspects and criteria of firm's green performance. The rationale of the proposed approach, namely green network balanced scorecard, is using balanced scorecard to combine fuzzy set theory with analytical network process (ANP) and importance-performance analysis (IPA) methods, wherein fuzzy set theory accounts for the linguistic vagueness of qualitative criteria and ANP converts the relations among the dependence aspects and criteria into an intelligible structural modeling used IPA. For the empirical case study, four dependence aspects and 34 green performance criteria for PCB firms in Taiwan were evaluated. The managerial implications are discussed.

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

In the Eye of the Beholder: Mothers' Perceptions of Poor Neighborhoods as Places to Raise Children

ERIC Educational Resources Information Center

Dahl, Trayci; Ceballo, Rosario; Huerta, Marisela

2010-01-01

This study explores how mothers facing similar neighborhood conditions evaluate their neighborhoods as places to raise children. The authors relied upon a triangulation of methods, using both quantitative and qualitative methodologies, with a sample of 91 low-income mothers. Content analysis of qualitative interviews revealed that mothers often…

The BioScope Initiative: Integrating Technology into the Biology Classroom.

ERIC Educational Resources Information Center

Ashburn, Sarah J.; Eichinger, David C.; Witham, Shelly A.; Cross, Vanessa D.; Krockover, Gerald H.; Pae, Tae-Il; Islam, Samantha; Robinson, J. Paul

2002-01-01

Reports on the quantitative and qualitative assessment of the CD-ROM "Cell Structure and Function" which includes five sections: (1) Basics; (2) Simple Cell; (3) Cell Viewer; (4) Cellular Changes; and (5) Handles. Evaluates the effectiveness of the CD-ROM with the participation of (n=65) students. Applies both qualitative and statistical methods.…

Development of Pre-Service Science Teachers' Awareness of Sustainable Water Use

ERIC Educational Resources Information Center

Cankaya, Cemile; Filik Iscen, Cansu

2015-01-01

Water is a vital resource for sustainable development. The aim of this research was to develop and evaluate pre-service science teachers' awareness of sustainable water usage. This research was based on a mixed method. The qualitative part of the research was based on a single group pretest-posttest experimental design, and the qualitative data…

[The study of establishment of the " Chinese provincial Blindness prevention technical guidance group performance evaluation system"].

PubMed

Lu, L N; He, X G; Zhu, J F; Xu, X; Zhang, R; Hu, X; Zou, H D

2016-11-11

Objective: To establish an assessment system, including indexes and scoring methods, that can be used for performance evaluation of the provincial blindness prevention technical guidance group properly and effectively . Methods: The indexes and scoring methods were set based on the core content of The " National Plan of Prevention and Treatment of Blindness (2012-2015)" , the specific requirement and target of the World Health Organization (WHO) "For the General Eye Health: Global plan of Action (2014-2019)" , and the current situation of the China's provinces and autonomous regions. These indexes should be of effectiveness, feasibility, comparability, guidance and advancing. Formed by a literature review of candidate indicators, the framework of the system is built by qualitative assessment. With the Delphi method, the system was further revised and improved. Empirical pilot study was then used to prove the feasibility, followed by the final qualitative analysis that establish the " Chinese provincial Blindness prevention technical guidance group performance evaluation system" . Results: Through the literature review and qualitative assessment, a six dimensional system framework was built, including 6 first-level indicators, 16 second-level indicators, and 29 third-level indicators through Delphi method evaluation. With the variation coefficient method, the coeffiences of the first-level index weight were calculated as: Organization and management 0.15, Development and implementation of blindness prevention plans 0.15, Implementation of blindness prevention projects 0.14, Training 0.17, Health education 0.18, and Cooperation and exchanges 0.21. The specific scoring method for this system is confirmed as: data and files check, field interview, and record interview, sampling investigation. Empirical pilot study was conducted in the Jilin, Guizhou and Gansu provinces, and the self-assessment results from local experts were consistent with the scores from the systems. Conclusion: This system established is appropriate at current time, and it can effectively evaluate the performance of the Chinese provincial Blindness prevention technical guidance group. (Chin J Ophthalmol, 2016, 52:814-824) .

The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation.

PubMed

Stevens, Katherine; Palfreyman, Simon

2012-12-01

To describe how qualitative methods can be used in the development of descriptive systems of preference-based measures (PBMs) of health-related quality of life. The requirements of the National Institute for Health and Clinical Excellence and other agencies together with the increasing use of patient-reported outcome measures has led to an increase in the demand for PBMs. Recently, interest has grown in developing new PBMs and while previous research on PBMs has mainly focused on the methods of valuation, research into the methods of developing descriptive systems is an emerging field. Traditionally, descriptive systems of PBMs were developed by using top-down methods, where content was derived from existing measures, the literature, or health surveys. A contrasting approach is a bottom-up methodology, which takes the views of patients or laypeople on how their life is affected by their health. This approach generally requires the use of qualitative methods. Qualitative methods lend themselves well to the development of PBMs. They also ensure that the measure has appropriate language, content validity, and responsiveness to change. While the use of qualitative methods in the development of non-PBMs is fairly standard, their use in developing PBMs was until recently nonexistent. In this article, we illustrate the use of qualitative methods by presenting two case studies of recently developed PBMs, one generic and one condition specific. We outline the stages involved, discuss the strengths and weaknesses of the approach, and compare with the top-down approach used in the majority of PBMs to date. Copyright © 2012 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Originality Detection Software in a Graduate Policy Course: A Mixed-Methods Evaluation of Plagiarism

ERIC Educational Resources Information Center

Dreuth Zeman, Laura; Steen, Julie A.; Metz Zeman, Natalie

2011-01-01

The authors used a mixed-methods approach to evaluate the use of Turnitin originality detection software in a graduate social work course. Qualitative analysis of student responses revealed positive and negative spent completing assignments, and the tone of the class. Quantitative analysis of students' originality scores indicated a short-term…

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

PubMed Central

2017-01-01

Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). Conclusions This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. PMID:28292738

Comparison and evaluation of fusion methods used for GF-2 satellite image in coastal mangrove area

NASA Astrophysics Data System (ADS)

Ling, Chengxing; Ju, Hongbo; Liu, Hua; Zhang, Huaiqing; Sun, Hua

2018-04-01

GF-2 satellite is the highest spatial resolution Remote Sensing Satellite of the development history of China's satellite. In this study, three traditional fusion methods including Brovey, Gram-Schmidt and Color Normalized (CN were used to compare with the other new fusion method NNDiffuse, which used the qualitative assessment and quantitative fusion quality index, including information entropy, variance, mean gradient, deviation index, spectral correlation coefficient. Analysis results show that NNDiffuse method presented the optimum in qualitative and quantitative analysis. It had more effective for the follow up of remote sensing information extraction and forest, wetland resources monitoring applications.

PRO development: rigorous qualitative research as the crucial foundation.

PubMed

Lasch, Kathryn Eilene; Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-10-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.

PRO development: rigorous qualitative research as the crucial foundation

PubMed Central

Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-01-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity. PMID:20512662

Intrinsic and Extrinsic Evaluation of Spatiotemporal Text Representations in Twitter Streams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Phillips, Lawrence A.; Shaffer, Kyle J.; Arendt, Dustin L.

Language in social media is a dynamic system, constantly evolving and adapting, with words and concepts rapidly emerging, disappearing, and changing their meaning. These changes can be estimated using word representations in context, over time and across locations. A number of methods have been proposed to track these spatiotemporal changes but no general method exists to evaluate the quality of these representations. Previous work largely focused on qualitative evaluation, which we improve by proposing a set of visualizations that highlight changes in text representation over both space and time. We demonstrate usefulness of novel spatiotemporal representations to explore and characterizemore » specific aspects of the corpus of tweets collected from European countries over a two-week period centered around the terrorist attacks in Brussels in March 2016. In addition, we quantitatively evaluate spatiotemporal representations by feeding them into a downstream classification task – event type prediction. Thus, our work is the first to provide both intrinsic (qualitative) and extrinsic (quantitative) evaluation of text representations for spatiotemporal trends.« less

Nondestructive evaluation of degradation in papaya fruit using intensity based algorithms

NASA Astrophysics Data System (ADS)

Kumari, Shubhashri; Nirala, Anil Kumar

2018-05-01

In the proposed work degradation in Papaya fruit has been evaluated nondestructively using laser biospeckle technique. The biospeckle activity inside the fruit has been evaluated qualitatively and quantitatively during its maturity to degradation stage using intensity based algorithms. Co-occurrence matrix (COM) has been used for qualitative analysis whereas Inertia Moment (IM), Absolute value Difference (AVD) and Autocovariance methods have been used for quantitative analysis. The biospeckle activity has been found to first increase and then decrease during study period of five days. In addition Granulometric size distribution (GSD) has also been used for the first time for the evaluation of degradation of the papaya. It is concluded that the degradation process of papaya fruit can be evaluated nondestructively using all the mentioned algorithms.

Integrating qualitative research into evidence based practice.

PubMed

Greenhalgh, Trisha

2002-09-01

This article attempts to provide an overview of qualitative tools and methods using mainly examples from diabetes research. The other articles in this issue of the Endocrinology and Metabolism Clinics of North America have demonstrated the enormous contribution made in the past 15 years or so by rigorous quantitative studies of prevalence, diagnosis, prognosis, and therapy to clinical decision-making in endocrinology. In the early 21st century, the state of qualitative research into such topics as the illness experience of diabetes; the barriers to effective self care and positive health choices; the design of complex educational interventions; the design of appropriate, acceptable and responsive health services; and the decision-making behavior of health professionals, is such that there remain many more questions than answers. But qualitative research is increasingly recognized as an important, legitimate and expanding dimension of evidence-based health care (18;19). It is highly likely that the major landmark studies in diabetes care over the next decade will build on an exploratory qualitative study or incorporate an explanatory or evaluative dimension based on qualitative methods.

An Examination of Physical Education Teachers' Perceptions of Utilizing Contemporary Music in the Classroom Environment: A Qualitative Approach

ERIC Educational Resources Information Center

Barney, David C.; Pleban, Francis T.

2018-01-01

Objectives: To provide further information regarding physical education (PE) teachers' perceptions of incorporating music in PE lessons and to evaluate the influence of music on the classroom environment using a qualitative approach. Method: Electronic survey interviews were conducted with 26 veteran PE instructors (10 male, 16 female), from 7…

A qualitative investigation of the health economic impacts of bariatric surgery for obesity and implications for improved practice in health economics.

PubMed

Campbell, Julie A; Ezzy, Douglas; Neil, Amanda; Hensher, Martin; Venn, Alison; Sharman, Melanie J; Palmer, Andrew J

2018-06-01

Obesity is an economic problem. Bariatric surgery is cost-effective for severe and resistant obesity. Most economic evaluations of bariatric surgery use administrative data and narrowly defined direct medical costs in their quantitative analyses. Demand far outstrips supply for bariatric surgery. Further allocation of health care resources to bariatric surgery (particularly public) could be stimulated by new health economic evidence that supports the provision of bariatric surgery. We postulated that qualitative research methods would elicit important health economic dimensions of bariatric surgery that would typically be omitted from the current economic evaluation framework, nor be reported and therefore not considered by policymakers with sufficient priority. We listened to patients: Focus group data were analysed thematically with software assistance. Key themes were identified inductively through a dialogue between the qualitative data and pre-existing economic theory (perspective, externalities, and emotional capital). We identified the concept of emotional capital where participants described life-changing desires to be productive and participate in their communities postoperatively. After self-funding bariatric surgery, some participants experienced financial distress. We recommend a mixed-methods approach to the economic evaluation of bariatric surgery. This could be operationalised in health economic model conceptualisation and construction, through to the separate reporting of qualitative results to supplement quantitative results. Copyright © 2018 John Wiley & Sons, Ltd.

Evaluation of board performance in Iran’s universities of medical sciences

PubMed Central

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-01-01

Background: The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. Methods: The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Results: Participants believed that the boards had no acceptable performance for a long time.Results also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards’ resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Conclusion: Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process. PMID:25337597

Using Mixed Methods to Evaluate a Community Intervention for Sexual Assault Survivors: A Methodological Tale.

PubMed

Campbell, Rebecca; Patterson, Debra; Bybee, Deborah

2011-03-01

This article reviews current epistemological and design issues in the mixed methods literature and then examines the application of one specific design, a sequential explanatory mixed methods design, in an evaluation of a community-based intervention to improve postassault care for sexual assault survivors. Guided by a pragmatist epistemological framework, this study collected quantitative and qualitative data to understand how the implementation of a Sexual Assault Nurse Examiner (SANE) program affected prosecution rates of adult sexual assault cases in a large midwestern community. Quantitative results indicated that the program was successful in affecting legal systems change and the qualitative data revealed the mediating mechanisms of the intervention's effectiveness. Challenges of implementing this design are discussed, including epistemological and practical difficulties that developed from blending methodologies into a single project. © The Author(s) 2011.

Integrating Evidence Within and Across Evidence Streams Using Qualitative Methods

EPA Science Inventory

There is high demand in environmental health for adoption of a structured process that evaluates and integrates evidence while making decisions transparent. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework holds promise to address this deman...

77 FR 18795 - Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-28

... collected through qualitative evaluation methods will increase the Bureau's understanding of consumers... following methods: Electronic: http://www.regulations.gov . Follow the instructions for submitting comments... directs the Bureau to research, analyze, and report on consumer awareness and understanding of, and...

Active thermography in qualitative evaluation of protective materials.

PubMed

Gralewicz, Grzegorz; Wiecek, Bogusław

2009-01-01

This is a study of the possibilities of a qualitative evaluation of protective materials with active thermography. It presents a simulation of a periodic excitation of a multilayer composite material. Tests were conducted with lock-in thermography on Kevlar composite consisting of 16 layers of Kevlar fabric reinforced with formaldehyde resin with implanted delamination defects. Lock-in thermography is a versatile tool for nondestructive evaluation. It is a fast, remote and nondestructive procedure. Hence, it was used to detect delaminations in the composite structure of materials used in the production of components designed for personal protection. This method directly contributes to an improvement in safety.

Evaluating the impact of a partnership for creating change in substance misuse practice in St. Petersburg, Russia.

PubMed

Green, Anita J; Holloway, David G

2005-11-01

This paper reports on an evaluation of an innovative education and training programme for nurses and narcologists in St. Petersburg, Russia. The aims of the evaluation were: first, to evaluate the effect of the education and training programme on the clinical practice of doctors and nurses who have had direct contact with the programme and, second, to evaluate the influence of the education and training programme on city-wide drug and alcohol policy and practice. Brief contextual information regarding the programme is provided prior to an account of the qualitative methodology. Particular attention was paid to the work of Patton [Utilisation-focused evaluation, second ed., Sage, London, 1986; Qualitative research and evaluation methods, third ed., Sage, London, 2002] for the theoretical framework and to Hantais and Mangen [Cross-national research methods in the social sciences, Pinter, London, 1996] regarding the methodological issues that surround international and cross-cultural research projects. Data collection was carried out in St. Petersburg and in the United Kingdom, which involved key participants in the programme. The data analysis followed Miles and Huberman [Qualitative data analysis. An expanded sourcebook, second ed. Sage, Thousand Oaks, 1994] which yielded six major themes: rehabilitation, the role and continuing professional development of the trained nurse; the status of the nurse training-college and the staff, small scale projects and their significance; sharing experiences/networking/face-to-face meetings; and, lack of resistance. The findings are discussed and recommendations for further involvement are identified.

A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors

ERIC Educational Resources Information Center

Plough, India C.; Briggs, Sarah L.; Van Bonn, Sarah

2010-01-01

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

Hey girlfriend: an evaluation of AIDS prevention among women in the sex industry.

PubMed

Dorfman, L E; Derish, P A; Cohen, J B

1992-01-01

Increasingly, acquired immunodeficiency syndrome (AIDS) prevention programs have been developed to reach and influence street-based populations. Standard methods of evaluation do not fit the conditions of such programs. This article describes a process and outcome evaluation of an AIDS prevention program for sex workers in which qualitative and quantitative methods were combined in order to mediate research problems endemic to street-based populations. Methods included epidemiological questionnaires, open-ended interviews with participants, and ethnographic field notes. Process evaluation findings show that field staff who were indigenous to the neighborhood and population readily gained access to the community of sex workers and simultaneously became role models for positive behavior change. Outcome findings show that sex workers do feel at risk for AIDS, but usually from clients rather than from husbands or boyfriends. Accordingly, they use condoms more frequently with clients than with steady partners. Increasing condom use among sex workers with their steady partners remains an important challenge for AIDS prevention. Combining qualitative and quantitative research data provided a more comprehensive assessment of how to reach sex workers with effective AIDS risk reduction messages than either method could have provided alone.

High Resolution Qualitative and Quantitative MR Evaluation of the Glenoid Labrum

PubMed Central

Iwasaki, Kenyu; Tafur, Monica; Chang, Eric Y.; SherondaStatum; Biswas, Reni; Tran, Betty; Bae, Won C.; Du, Jiang; Bydder, Graeme M.; Chung, Christine B.

2015-01-01

Objective To implement qualitative and quantitative MR sequences for the evaluation of labral pathology. Methods Six glenoid labra were dissected and the anterior and posterior portions were divided into normal, mildly degenerated, or severely degenerated groups using gross and MR findings. Qualitative evaluation was performed using T1-weighted, proton density-weighted (PD), spoiled gradient echo (SPGR) and ultra-short echo time (UTE) sequences. Quantitative evaluation included T2 and T1rho measurements as well as T1, T2*, and T1rho measurements acquired with UTE techniques. Results SPGR and UTE sequences best demonstrated labral fiber structure. Degenerated labra had a tendency towards decreased T1 values, increased T2/T2* values and increased T1 rho values. T2* values obtained with the UTE sequence allowed for delineation between normal, mildly degenerated and severely degenerated groups (p<0.001). Conclusion Quantitative T2* measurements acquired with the UTE technique are useful for distinguishing between normal, mildly degenerated and severely degenerated labra. PMID:26359581

A 96-well-plate-based optical method for the quantitative and qualitative evaluation of Pseudomonas aeruginosa biofilm formation and its application to susceptibility testing.

PubMed

Müsken, Mathias; Di Fiore, Stefano; Römling, Ute; Häussler, Susanne

2010-08-01

A major reason for bacterial persistence during chronic infections is the survival of bacteria within biofilm structures, which protect cells from environmental stresses, host immune responses and antimicrobial therapy. Thus, there is concern that laboratory methods developed to measure the antibiotic susceptibility of planktonic bacteria may not be relevant to chronic biofilm infections, and it has been suggested that alternative methods should test antibiotic susceptibility within a biofilm. In this paper, we describe a fast and reliable protocol for using 96-well microtiter plates for the formation of Pseudomonas aeruginosa biofilms; the method is easily adaptable for antimicrobial susceptibility testing. This method is based on bacterial viability staining in combination with automated confocal laser scanning microscopy. The procedure simplifies qualitative and quantitative evaluation of biofilms and has proven to be effective for standardized determination of antibiotic efficiency on P. aeruginosa biofilms. The protocol can be performed within approximately 60 h.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Toro, Javier, E-mail: jjtoroca@unal.edu.co; Requena, Ignacio, E-mail: requena@decsai.ugr.es; Duarte, Oscar, E-mail: ogduartev@unal.edu.co

In environmental impact assessment, qualitative methods are used because they are versatile and easy to apply. This methodology is based on the evaluation of the strength of the impact by grading a series of qualitative attributes that can be manipulated by the evaluator. The results thus obtained are not objective, and all too often impacts are eliminated that should be mitigated with corrective measures. However, qualitative methodology can be improved if the calculation of Impact Importance is based on the characteristics of environmental factors and project activities instead on indicators assessed by evaluators. In this sense, this paper proposes themore » inclusion of the vulnerability of environmental factors and the potential environmental impact of project activities. For this purpose, the study described in this paper defined Total Impact Importance and specified a quantification procedure. The results obtained in the case study of oil drilling in Colombia reflect greater objectivity in the evaluation of impacts as well as a positive correlation between impact values, the environmental characteristics at and near the project location, and the technical characteristics of project activities. -- Highlights: • Concept of vulnerability has been used to calculate the importance impact assessment. • This paper defined Total Impact Importance and specified a quantification procedure. • The method includes the characteristics of environmental and project activities. • The application has shown greater objectivity in the evaluation of impacts. • Better correlation between impact values, environment and the project has been shown.« less

Evidence for success in health promotion: suggestions for improvement.

PubMed

Macdonald, G; Veen, C; Tones, K

1996-09-01

This paper argues that health promotion needs to develop an approach to evaluation and effectiveness that values qualitative methodologies. It posits the idea that qualitative research could learn from the experience of quantitative researchers and promote more useful ways of measuring effectiveness by the use of intermediate and indirect indicators. It refers to a European-wide project designed to gather information on the effectiveness of health promotion interventions. This project discovered that there was a need for an instrument that allowed qualitative intervention methodologies to be assessed in the same way as quantitative methods.

Searching for Rigour in the Reporting of Mixed Methods Population Health Research: A Methodological Review

ERIC Educational Resources Information Center

Brown, K. M.; Elliott, S. J.; Leatherdale, S. T.; Robertson-Wilson, J.

2015-01-01

The environments in which population health interventions occur shape both their implementation and outcomes. Hence, when evaluating these interventions, we must explore both intervention content and context. Mixed methods (integrating quantitative and qualitative methods) provide this opportunity. However, although criteria exist for establishing…

Strategy to Promote Active Learning of an Advanced Research Method

ERIC Educational Resources Information Center

McDermott, Hilary J.; Dovey, Terence M.

2013-01-01

Research methods courses aim to equip students with the knowledge and skills required for research yet seldom include practical aspects of assessment. This reflective practitioner report describes and evaluates an innovative approach to teaching and assessing advanced qualitative research methods to final-year psychology undergraduate students. An…

A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model

DOE PAGES

Gan, Yanjun; Duan, Qingyun; Gong, Wei; ...

2014-01-01

Sensitivity analysis (SA) is a commonly used approach for identifying important parameters that dominate model behaviors. We use a newly developed software package, a Problem Solving environment for Uncertainty Analysis and Design Exploration (PSUADE), to evaluate the effectiveness and efficiency of ten widely used SA methods, including seven qualitative and three quantitative ones. All SA methods are tested using a variety of sampling techniques to screen out the most sensitive (i.e., important) parameters from the insensitive ones. The Sacramento Soil Moisture Accounting (SAC-SMA) model, which has thirteen tunable parameters, is used for illustration. The South Branch Potomac River basin nearmore » Springfield, West Virginia in the U.S. is chosen as the study area. The key findings from this study are: (1) For qualitative SA methods, Correlation Analysis (CA), Regression Analysis (RA), and Gaussian Process (GP) screening methods are shown to be not effective in this example. Morris One-At-a-Time (MOAT) screening is the most efficient, needing only 280 samples to identify the most important parameters, but it is the least robust method. Multivariate Adaptive Regression Splines (MARS), Delta Test (DT) and Sum-Of-Trees (SOT) screening methods need about 400–600 samples for the same purpose. Monte Carlo (MC), Orthogonal Array (OA) and Orthogonal Array based Latin Hypercube (OALH) are appropriate sampling techniques for them; (2) For quantitative SA methods, at least 2777 samples are needed for Fourier Amplitude Sensitivity Test (FAST) to identity parameter main effect. McKay method needs about 360 samples to evaluate the main effect, more than 1000 samples to assess the two-way interaction effect. OALH and LPτ (LPTAU) sampling techniques are more appropriate for McKay method. For the Sobol' method, the minimum samples needed are 1050 to compute the first-order and total sensitivity indices correctly. These comparisons show that qualitative SA methods are more efficient but less accurate and robust than quantitative ones.« less

Evaluation of a Family-Centred Children's Weight Management Intervention

ERIC Educational Resources Information Center

Jinks, Annette; English, Sue; Coufopoulos, Anne

2013-01-01

Purpose: The purpose of this paper is to conduct an in-depth quantitative and qualitative evaluation of a family-based weight loss and healthy life style programme for clinically obese children in England. Design/methodology/approach: The mixed method case study evaluation used included obtaining pre and post measurements of anthropometry and a…

Evaluation Techniques for the Sandy Point Discovery Center, Great Bay National Estuarine Research Reserve.

ERIC Educational Resources Information Center

Heffernan, Bernadette M.

1998-01-01

Describes work done to provide staff of the Sandy Point Discovery Center with methods for evaluating exhibits and interpretive programming. Quantitative and qualitative evaluation measures were designed to assess the program's objective of estuary education. Pretest-posttest questionnaires and interviews are used to measure subjects' knowledge and…

Risk Evaluation of Bogie System Based on Extension Theory and Entropy Weight Method

PubMed Central

Du, Yanping; Zhang, Yuan; Zhao, Xiaogang; Wang, Xiaohui

2014-01-01

A bogie system is the key equipment of railway vehicles. Rigorous practical evaluation of bogies is still a challenge. Presently, there is overreliance on part-specific experiments in practice. In the present work, a risk evaluation index system of a bogie system has been established based on the inspection data and experts' evaluation. Then, considering quantitative and qualitative aspects, the risk state of a bogie system has been evaluated using an extension theory and an entropy weight method. Finally, the method has been used to assess the bogie system of four different samples. Results show that this method can assess the risk state of a bogie system exactly. PMID:25574159

Risk evaluation of bogie system based on extension theory and entropy weight method.

PubMed

Du, Yanping; Zhang, Yuan; Zhao, Xiaogang; Wang, Xiaohui

2014-01-01

A bogie system is the key equipment of railway vehicles. Rigorous practical evaluation of bogies is still a challenge. Presently, there is overreliance on part-specific experiments in practice. In the present work, a risk evaluation index system of a bogie system has been established based on the inspection data and experts' evaluation. Then, considering quantitative and qualitative aspects, the risk state of a bogie system has been evaluated using an extension theory and an entropy weight method. Finally, the method has been used to assess the bogie system of four different samples. Results show that this method can assess the risk state of a bogie system exactly.

A Question-Answer System for Mobile Devices in Lecture-Based Instruction: A Qualitative Analysis of Student Engagement and Learning

ERIC Educational Resources Information Center

Hatun Atas, Amine; Delialioglu, Ömer

2018-01-01

The aim of this study was to explore the opinions, perceptions and evaluations of students about their experiences with a question-answer system used on mobile devices in a lecture-based course. Basic qualitative research method was employed in this study to understand how students made sense of their experiences during the instruction. The…

Evaluating Research Administration: Methods and Utility

ERIC Educational Resources Information Center

Marina, Sarah; Davis-Hamilton, Zoya; Charmanski, Kara E.

2015-01-01

Three studies were jointly conducted by the Office of Research Administration and Office of Proposal Development at Tufts University to evaluate the services within each respective office. The studies featured assessments that used, respectively, (1) quantitative metrics; (2) a quantitative satisfaction survey with limited qualitative questions;…

23 CFR 636.302 - Are there any limitations on the selection and use of proposal evaluation factors?

Code of Federal Regulations, 2010 CFR

2010-04-01

... evaluation of proposals and award of the contract may be based on qualitative considerations; (iv) If the... project funded with Federal-aid highway funds shall be based on at least one of the following methods: (A...

A Synthesis Of Knowledge About Caregiver Decision Making Finds Gaps In Support For Those Who Care For Aging Loved Ones.

PubMed

Garvelink, Mirjam M; Ngangue, Patrice A G; Adekpedjou, Rheda; Diouf, Ndeye T; Goh, Larissa; Blair, Louisa; Légaré, France

2016-04-01

We conducted a mixed-methods knowledge synthesis to assess the effectiveness of interventions to improve caregivers' involvement in decision making with seniors, and to describe caregivers' experiences of decision making in the absence of interventions. We analyzed forty-nine qualitative, fourteen quantitative, and three mixed-methods studies. The qualitative studies indicated that caregivers had unmet needs for information, discussions of values and needs, and decision support, which led to negative sentiments after decision making. Our results indicate that there have been insufficient quantitative evaluations of interventions to involve caregivers in decision making with seniors and that the evaluations that do exist found few clinically significant effects. Elements of usual care that received positive evaluations were the availability of a decision coach and a supportive decision-making environment. Additional rigorously evaluated interventions are needed to help caregivers be more involved in decision making with seniors. Project HOPE—The People-to-People Health Foundation, Inc.

Advanced image fusion algorithms for Gamma Knife treatment planning. Evaluation and proposal for clinical use.

PubMed

Apostolou, N; Papazoglou, Th; Koutsouris, D

2006-01-01

Image fusion is a process of combining information from multiple sensors. It is a useful tool implemented in the treatment planning programme of Gamma Knife Radiosurgery. In this paper we evaluate advanced image fusion algorithms for Matlab platform and head images. We develop nine level grayscale image fusion methods: average, principal component analysis (PCA), discrete wavelet transform (DWT) and Laplacian, filter - subtract - decimate (FSD), contrast, gradient, morphological pyramid and a shift invariant discrete wavelet transform (SIDWT) method in Matlab platform. We test these methods qualitatively and quantitatively. The quantitative criteria we use are the Root Mean Square Error (RMSE), the Mutual Information (MI), the Standard Deviation (STD), the Entropy (H), the Difference Entropy (DH) and the Cross Entropy (CEN). The qualitative are: natural appearance, brilliance contrast, presence of complementary features and enhancement of common features. Finally we make clinically useful suggestions.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

Evaluating Work-Based Learning: Insights from an Illuminative Evaluation Study of Work-Based Learning in a Vocational Qualification

ERIC Educational Resources Information Center

van Rensburg, Estelle

2008-01-01

This article outlines an illuminative evaluation study of the work-based module in a vocational qualification in Animal Health offered for the paraveterinary industry by a distance education institution in South Africa. In illuminative evaluation, a programme is studied by qualitative methods to gain an in-depth understanding of its…

Qualitative evaluations and comparisons of six night-vision colorization methods

NASA Astrophysics Data System (ADS)

Zheng, Yufeng; Reese, Kristopher; Blasch, Erik; McManamon, Paul

2013-05-01

Current multispectral night vision (NV) colorization techniques can manipulate images to produce colorized images that closely resemble natural scenes. The colorized NV images can enhance human perception by improving observer object classification and reaction times especially for low light conditions. This paper focuses on the qualitative (subjective) evaluations and comparisons of six NV colorization methods. The multispectral images include visible (Red-Green- Blue), near infrared (NIR), and long wave infrared (LWIR) images. The six colorization methods are channel-based color fusion (CBCF), statistic matching (SM), histogram matching (HM), joint-histogram matching (JHM), statistic matching then joint-histogram matching (SM-JHM), and the lookup table (LUT). Four categries of quality measurements are used for the qualitative evaluations, which are contrast, detail, colorfulness, and overall quality. The score of each measurement is rated from 1 to 3 scale to represent low, average, and high quality, respectively. Specifically, high contrast (of rated score 3) means an adequate level of brightness and contrast. The high detail represents high clarity of detailed contents while maintaining low artifacts. The high colorfulness preserves more natural colors (i.e., closely resembles the daylight image). Overall quality is determined from the NV image compared to the reference image. Nine sets of multispectral NV images were used in our experiments. For each set, the six colorized NV images (produced from NIR and LWIR images) are concurrently presented to users along with the reference color (RGB) image (taken at daytime). A total of 67 subjects passed a screening test ("Ishihara Color Blindness Test") and were asked to evaluate the 9-set colorized images. The experimental results showed the quality order of colorization methods from the best to the worst: CBCF < SM < SM-JHM < LUT < JHM < HM. It is anticipated that this work will provide a benchmark for NV colorization and for quantitative evaluation using an objective metric such as objective evaluation index (OEI).

Qualitative research in palliative care 1990-1999: a descriptive review.

PubMed

Froggatt, Katherine A; Field, David; Bailey, Chris; Krishnasamy, Meinir

2003-03-01

A collaborative, evaluative review of qualitative research in palliative care published between 1990 and 1999 has been conducted. Nearly 30,000 articles in 48 journals from specialist palliative care, oncology, death studies, medicine, nursing, gerontology, health and the social sciences were examined. From these journals, 138 articles (0.5%) reporting qualitative research with a focus on palliative care in the context of death, dying or bereavement were identified. These articles were reviewed using a proforma designed by the group. This article describes the review process, and the following findings: the distribution of different forms of qualitative research in palliative care; the location of such papers; the focus of the research; and the research methodology and methods adopted.

The relevance of qualitative research for clinical programs in psychiatry.

PubMed

Goering, Paula; Boydell, Katherine M; Pignatiello, Antonio

2008-03-01

It is time to move beyond education about qualitative research theory and methods to using them to understand and improve psychiatric practice. There is a good fit between this agenda and current thinking about research use that broadens definitions of evidence beyond the results of experiments. This paper describes a qualitative program evaluation to illustrate what kind of useful knowledge is generated and how it can be created through a clinician-researcher partnership. The linkage and exchange model of effective knowledge translation described involves interaction between clinicians and researchers throughout the research process and results in mutual learning through the planning, disseminating, and application of existing or new qualitative research in decision making.

Development of the pediatric quality of life inventory neurofibromatosis type 1 module items for children, adolescents and young adults: qualitative methods.

PubMed

Nutakki, Kavitha; Varni, James W; Steinbrenner, Sheila; Draucker, Claire B; Swigonski, Nancy L

2017-03-01

Health-related quality of life (HRQOL) is arguably one of the most important measures in evaluating effectiveness of clinical treatments. At present, there is no disease-specific outcome measure to assess the HRQOL of children, adolescents and young adults with Neurofibromatosis Type 1 (NF1). This study aimed to develop the items and support the content validity for the Pediatric Quality of Life Inventory™ (PedsQL™) NF1 Module for children, adolescents and young adults. The iterative process included multiphase qualitative methods including a literature review, survey of expert opinions, semi-structured interviews, cognitive interviews and pilot testing. Fifteen domains were derived from the qualitative methods, with content saturation achieved, resulting in 115 items. The domains include skin, pain, pain impact, pain management, cognitive functioning, speech, fine motor, balance, vision, perceived physical appearance, communication, worry, treatment, medicines and gastrointestinal symptoms. This study is limited because all participants are recruited from a single-site. Qualitative methods support the content validity for the PedsQL™ NF1 Module for children, adolescents and young adults. The PedsQL™ NF1 Module is now undergoing national multisite field testing for the psychometric validation of the instrument development.

A Hospice Rotation for Military Medical Residents: A Mixed Methods, Multi-Perspective Program Evaluation

PubMed Central

Boyden, Jackelyn Y.; Kalish, Virginia B.; Muir, J. Cameron; Richardson, Suzanne; Connor, Stephen R.

2016-01-01

Abstract Background: An estimated 6,000 to 18,000 additional hospice and palliative medicine (HPM) physicians are needed in the United States. A source could be the military graduate medical education system where 15% of U.S. medical residents are trained. A community-based hospice and palliative care organization created a one-week rotation for military residents including participation in interdisciplinary group visits at patients' homes, facilities, and an inpatient hospice unit. Objective: Our goal was to evaluate the effectiveness of a one-week community HPM rotation for military medical residents. Methods: A mixed-methods, multi-stakeholder perspective program evaluation model was used for program years 2011 to 2013. Data were managed and analyzed using Microsoft Excel and Atlas.ti. Participants in the rotation were residents training at two local military hospitals. Program evaluation data were collected from residents, military program liaisons, and hospice clinical preceptors. Quantitative data included pre- and post-tests based on Accreditation Council for Graduate Medical Education competencies completed by residents. Qualitative data included resident essays and semi-structured interviews with hospice preceptors and military program liaisons. Results: Quantitative and qualitative data suggested that the rotation increased military residents' knowledge, attitudes, and comfort level with HPM. Quantitative analysis of test scores indicated improvements from pre- to post-tests in each of five areas of learning. Qualitative data indicated the rotation created a greater appreciation for the overall importance of HPM and increased understanding of eligibility and methods for pain and symptom management. Conclusions: A one-week community hospice rotation for medical military residents impacts participant's knowledge of and attitudes toward HPM. PMID:27139524

Benefit Finding in Maternal Caregivers of Pediatric Cancer Survivors: A Mixed Methods Approach.

PubMed

Willard, Victoria W; Hostetter, Sarah A; Hutchinson, Katherine C; Bonner, Melanie J; Hardy, Kristina K

2016-09-01

Benefit finding has been described as the identification of positive effects resulting from otherwise stressful experiences. In this mixed methods study, we examined the relations between qualitative themes related to benefit finding and quantitative measures of psychosocial adjustment and coping as reported by maternal caregivers of survivors of pediatric cancer. Female caregivers of survivors of pediatric cancer (n = 40) completed a qualitative questionnaire about their experiences caring for their child, along with several quantitative measures. Qualitative questionnaires were coded for salient themes, including social support and personal growth. Correlation matrices evaluated associations between qualitative themes and quantitative measures of stress and coping. Identified benefits included social support and personal growth, as well as child-specific benefits. Total benefits reported were significantly positively correlated with availability of emotional resources. Coping methods were also associated, with accepting responsibility associated with fewer identified benefits. Despite the stress of their child's illness, many female caregivers of survivors of pediatric cancer reported finding benefits associated with their experience. Benefit finding in this sample was associated with better adjustment. © 2016 by Association of Pediatric Hematology/Oncology Nurses.

The scope for qualitative methods in research and clinical trials in dementia.

PubMed

Gibson, Grant; Timlin, Alison; Curran, Stephen; Wattis, John

2004-07-01

In the evaluation of drugs, the randomised double-blind placebo controlled trial is the 'gold standard'. This method, based on a positivist paradigm, answers questions about efficacy and side-effects of treatments that are accepted as valid, reliable and generalisable, provided the study is well designed and properly conducted. In contrast, qualitative research methodologies, originating from the social sciences, embrace a variety of approaches, including phenomenological and other paradigms. Within clinical and health services research, qualitative approaches view the world more subjectively, acknowledging that the researcher is part of what is researched, focusing on meanings and understanding of experience, rather than on what can be reduced to quantitative measures. They can develop new ideas through induction from data, rather than confirming or refuting hypotheses. Qualitative methods have improved our understanding of the experiences of people with dementia and, if used alongside clinical trials, could be used to improve the relevance of outcomes to patients, compliance and user involvement. They could also possibly generate new measures of efficacy and effectiveness in severe dementia.

Evaluating Writing Programs: Paradigms, Problems, Possibilities.

ERIC Educational Resources Information Center

McLeod, Susan H.

1992-01-01

Describes two methodological approaches (qualitative and quantitative) that grow out of two different research examples. Suggests the problems these methods present. Discusses the ways in which an awareness of these problems can help teachers to understand how to work with researchers in designing useful evaluations of writing programs. (PRA)

A Journal-Neutral Ratio for Marketing Faculty Scholarship Assessment

ERIC Educational Resources Information Center

Elbeck, Matt; Baruca, Arne

2015-01-01

This article proposes a journal-neutral Publication to Citation Ratio (PCR) to complement qualitative methods to evaluate a marketing educator's scholarship for reappointment, promotion, tenure, and post-tenure review (RPTP) decisions. We empirically establish a minimum time period to evaluate scholarship data, then benchmark publication and…

Qualitative Methods in Field Research: An Indonesian Experience in Community Based Practice.

ERIC Educational Resources Information Center

Lysack, Catherine L.; Krefting, Laura

1994-01-01

Cross-cultural evaluation of a community-based rehabilitation project in Indonesia used three methods: focus groups, questionnaires, and key informant interviews. A continuous cyclical approach to data collection and concern for cultural sensitivity increased the rigor of the research. (SK)

76 FR 39860 - Proposed Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-07

... ``Broad Program Area Categories'' (BPACs) for purposes of conducting the research. For each evaluation... data collection methods than those prescribed for high-rigor. For example, data may be collected by... methods to produce energy savings and outcome estimates. A range of qualitative, quantitative (survey), on...

Assessment in Simulations

ERIC Educational Resources Information Center

Raymond, Chad; Usherwood, Simon

2013-01-01

Simulations are employed widely as teaching tools in political science, yet evidence of their pedagogical effectiveness, in comparison to other methods of instruction, is mixed. The assessment of learning outcomes is often a secondary concern in simulation design, and the qualitative and quantitative methods used to evaluate outcomes are…

[Qualitative techniques for public health research and the development of health care services: more than just another technique].

PubMed

March Cerdà, J C; Prieto Rodríguez, M A; Hernán García, M; Solas Gaspar, O

1999-01-01

Regarding the debate on the existence of two current focuses on health science research (qualitative and quantitative), the paper states the need for complementing the techniques which contribute to a better knowledge of populations and communities, and the need for offering effective solutions to different problems. The article analyses the usefulness of qualitative methods, describes the techniques and procedures more frequently used to guarantee the validity and reliability of research findings and ends bringing up the need for using qualitative and quantitative approaches. This way of working together or learning from each other will enrich research and interventions on public heath and health management fields. Qualitative methods are useful for sound understanding of a given issue that is being investigated or evaluated taking into account the point of view of the participants under research. Key techniques, listed from the most structured to the less structured are among others: structured interview, Delphi, nominal group, case study, semistructured interview, focal group, brainstorming, discussion group, in depth interview, life story and participant observation.

How Qualitative Research Informs Clinical and Policy Decision Making in Transplantation: A Review.

PubMed

Tong, Allison; Morton, Rachael L; Webster, Angela C

2016-09-01

Patient-centered care is no longer just a buzzword. It is now widely touted as a cornerstone in delivering quality care across all fields of medicine. However, patient-centered strategies and interventions necessitate evidence about patients' decision-making processes, values, priorities, and needs. Qualitative research is particularly well suited to understanding the experience and perspective of patients, donors, clinicians, and policy makers on a wide range of transplantation-related topics including organ donation and allocation, adherence to prescribed therapy, pretransplant and posttransplant care, implementation of clinical guidelines, and doctor-patient communication. In transplantation, evidence derived from qualitative research has been integrated into strategies for shared decision-making, patient educational resources, process evaluations of trials, clinical guidelines, and policies. The aim of this article is to outline key concepts and methods used in qualitative research, guide the appraisal of qualitative studies, and assist clinicians to understand how qualitative research may inform their practice and policy.

The Design, Development, and Evaluation of a Qualitative Data Collection Application for Pregnant Women.

PubMed

Keedle, Hazel; Schmied, Virginia; Burns, Elaine; Dahlen, Hannah

2018-01-01

This article explores the development and evaluation of a smartphone mobile software application (app) to collect qualitative data. The app was specifically designed to capture real-time qualitative data from women planning a vaginal birth after caesarean delivery. This article outlines the design and development of the app to include funding, ethics, and the recruitment of an app developer, as well as the evaluation of using the app by seven participants. Data collection methods used in qualitative research include interviews and focus groups (either online, face-to-face, or by phone), participant diaries, or observations of interactions. This article identifies an alternative data collection methodology using a smartphone app to collect real-time data. The app provides real-time data and instant access to data alongside the ability to access participants from a variety of locations. This allows the researcher to gain insight into the experiences of participants through audio or video recordings in longitudinal studies without the need for constant interactions or interviews with participants. Using smartphone applications can allow researchers to access participants who are traditionally hard to reach and access their data in real time. Evaluating these apps before use in research is invaluable. © 2017 Sigma Theta Tau International.

Classification of cassava genotypes based on qualitative and quantitative data.

PubMed

Oliveira, E J; Oliveira Filho, O S; Santos, V S

2015-02-02

We evaluated the genetic variation of cassava accessions based on qualitative (binomial and multicategorical) and quantitative traits (continuous). We characterized 95 accessions obtained from the Cassava Germplasm Bank of Embrapa Mandioca e Fruticultura; we evaluated these accessions for 13 continuous, 10 binary, and 25 multicategorical traits. First, we analyzed the accessions based only on quantitative traits; next, we conducted joint analysis (qualitative and quantitative traits) based on the Ward-MLM method, which performs clustering in two stages. According to the pseudo-F, pseudo-t2, and maximum likelihood criteria, we identified five and four groups based on quantitative trait and joint analysis, respectively. The smaller number of groups identified based on joint analysis may be related to the nature of the data. On the other hand, quantitative data are more subject to environmental effects in the phenotype expression; this results in the absence of genetic differences, thereby contributing to greater differentiation among accessions. For most of the accessions, the maximum probability of classification was >0.90, independent of the trait analyzed, indicating a good fit of the clustering method. Differences in clustering according to the type of data implied that analysis of quantitative and qualitative traits in cassava germplasm might explore different genomic regions. On the other hand, when joint analysis was used, the means and ranges of genetic distances were high, indicating that the Ward-MLM method is very useful for clustering genotypes when there are several phenotypic traits, such as in the case of genetic resources and breeding programs.

A online credit evaluation method based on AHP and SPA

NASA Astrophysics Data System (ADS)

Xu, Yingtao; Zhang, Ying

2009-07-01

Online credit evaluation is the foundation for the establishment of trust and for the management of risk between buyers and sellers in e-commerce. In this paper, a new credit evaluation method based on the analytic hierarchy process (AHP) and the set pair analysis (SPA) is presented to determine the credibility of the electronic commerce participants. It solves some of the drawbacks found in classical credit evaluation methods and broadens the scope of current approaches. Both qualitative and quantitative indicators are considered in the proposed method, then a overall credit score is achieved from the optimal perspective. In the end, a case analysis of China Garment Network is provided for illustrative purposes.

Study protocol of a mixed-methods evaluation of a cluster randomized trial to improve the safety of NSAID and antiplatelet prescribing: data-driven quality improvement in primary care.

PubMed

Grant, Aileen; Dreischulte, Tobias; Treweek, Shaun; Guthrie, Bruce

2012-08-28

Trials of complex interventions are criticized for being 'black box', so the UK Medical Research Council recommends carrying out a process evaluation to explain the trial findings. We believe it is good practice to pre-specify and publish process evaluation protocols to set standards and minimize bias. Unlike protocols for trials, little guidance or standards exist for the reporting of process evaluations. This paper presents the mixed-method process evaluation protocol of a cluster randomized trial, drawing on a framework designed by the authors. This mixed-method evaluation is based on four research questions and maps data collection to a logic model of how the data-driven quality improvement in primary care (DQIP) intervention is expected to work. Data collection will be predominately by qualitative case studies in eight to ten of the trial practices, focus groups with patients affected by the intervention and quantitative analysis of routine practice data, trial outcome and questionnaire data and data from the DQIP intervention. We believe that pre-specifying the intentions of a process evaluation can help to minimize bias arising from potentially misleading post-hoc analysis. We recognize it is also important to retain flexibility to examine the unexpected and the unintended. From that perspective, a mixed-methods evaluation allows the combination of exploratory and flexible qualitative work, and more pre-specified quantitative analysis, with each method contributing to the design, implementation and interpretation of the other.As well as strengthening the study the authors hope to stimulate discussion among their academic colleagues about publishing protocols for evaluations of randomized trials of complex interventions. DATA-DRIVEN QUALITY IMPROVEMENT IN PRIMARY CARE TRIAL REGISTRATION: ClinicalTrials.gov: NCT01425502.

Psychometric Evaluation of the Child-Adolescent Teasing Scale

ERIC Educational Resources Information Center

Vessey, Judith A.; Horowitz, June A.; Carlson, Karen L.; Duffy, Mary

2008-01-01

Background: This article presents the psychometric evaluation of the Child-Adolescent Teasing Scale (CATS), an instrument to be used as a screening measure with middle school students. Methods: A 70-item scale was initially derived from qualitative data obtained from focus groups comprised of middle school students. A diverse sample of…

A methodology for decisionmaking in project evaluation in land management planning

Treesearch

A. Weintraub

1978-01-01

In order to evaluate alternative plans, wildland management planners must consider many objectives, such as timber production, recreational use, and community stability. The method presented utilizes the type of qualitative and intuitive information widely available to wildland management planners, and structures this information into a format suitable for...

Developing Recruitment Methods for Vulnerable, Traumatized Adolescents: A Feminist Evaluation Approach

ERIC Educational Resources Information Center

Campbell, Rebecca; Greeson, Megan R.; Fehler-Cabral, Giannina

2014-01-01

This article describes the process by which we created a recruitment protocol for engaging adolescent sexual assault victims in a qualitative evaluation study. Working in collaboration with forensic nurses, rape victim advocates, adolescent rape survivors, and our institutional review board (IRB), we created a prospective recruitment method…

Evaluating Organizational Change at a Multinational Transportation Corporation: Method and Reflections

ERIC Educational Resources Information Center

Plakhotnik, Maria S.

2016-01-01

The purpose of this perspective on practice is to share my experience conducting an organizational change evaluation using qualitative methodology at a multinational transportation company Global Logistics. I provide a detailed description of the three phase approach to data analysis and my reflections on the process.

Measuring Core/Facesheet Bond Toughness in Honeycomb Sandwich Structures

NASA Technical Reports Server (NTRS)

Nettles, A. T.

2006-01-01

This study examines two test methods to evaluate the peel toughness of the skin to core debond of sandwich panels. The methods tested were the climbing drum (CD) peel test and the double cantilever beam (DCB) test. While the CD peel test is only intended for qualitative measurements, it is shown in this study that qualitative measurements can be performed and compare well with DCB test data. It is also shown that artificially stiffening the facesheets of a DCB specimen can cause the test to behave more like a flatwise tensile test than a peel test.

Evaluation of life and death studies course on attitudes toward life and death among nursing students.

PubMed

Hwang, Huei-Lih; Lin, Huey-Shyan; Chen, Wen-Tin

2005-12-01

The aim of this study was to evaluate attitudes toward life and death among nursing students after attending the life and death studies (LDS) program. Both qualitative and quantitative methods were used to collect data. The pretest-posttest control group design randomly assigned students to an experimental (n = 47) or control group (n = 49). The 13-week course included lectures, video appraisal, games, simulations, films, books, assignments and group sharing. Statistical and content analysis were used to analyze qualitative and quantitative data. The findings showed a significant improvement in perception of the meaningfulness of life in four categories of improvement: expanded viewpoint, sadness about death, treating life sincerely, and instilling hope in life. The qualitative data indicated that a positive change in meaning of life was associated with interaction with others and self-reflection.

Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study

PubMed Central

Glenton, Claire; Oxman, Andrew D

2009-01-01

Objective To examine the use of qualitative approaches alongside randomised trials of complex healthcare interventions. Design Review of randomised controlled trials of interventions to change professional practice or the organisation of care. Data sources Systematic sample of 100 trials published in English from the register of the Cochrane Effective Practice and Organisation of Care Review Group. Methods Published and unpublished qualitative studies linked to the randomised controlled trials were identified through database searches and contact with authors. Data were extracted from each study by two reviewers using a standard form. We extracted data describing the randomised controlled trials and qualitative studies, the quality of these studies, and how, if at all, the qualitative and quantitative findings were combined. A narrative synthesis of the findings was done. Results 30 of the 100 trials had associated qualitative work and 19 of these were published studies. 14 qualitative studies were done before the trial, nine during the trial, and four after the trial. 13 studies reported an explicit theoretical basis and 11 specified their methodological approach. Approaches to sampling and data analysis were poorly described. For most cases (n=20) we found no indication of integration of qualitative and quantitative findings at the level of either analysis or interpretation. The quality of the qualitative studies was highly variable. Conclusions Qualitative studies alongside randomised controlled trials remain uncommon, even where relatively complex interventions are being evaluated. Most of the qualitative studies were carried out before or during the trials with few studies used to explain trial results. The findings of the qualitative studies seemed to be poorly integrated with those of the trials and often had major methodological shortcomings. PMID:19744976

[Research progress of polyethylene inserts wear measurement and evaluation in total knee arthroplasty].

PubMed

Zhao, Feng; Wang, Chuan; Fan, Yubo

2015-01-01

Wear of polyethylene (PE) tibial inserts is a significant cause of implant failure of total knee arthroplasty (TKA). PE inserts wear measurement and evaluation is the key in TKA researches. There are many methods to measure insert wear. Qualitative methods such as observation are used to determine the wear and its type. Quantitative methods such as gravimetric analysis, coordinate measuring machines (CMM) and micro-computed tomography (micro-CT) are used to measure the mass, volume and geometry of wear. In this paper, the principle, characteristics and research progress of main insert wear evaluation method were introduced and the problems and disadvantages were analyzed.

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

The trees and the forest: mixed methods in the assessment of recovery based interventions' processes and outcomes in mental health.

PubMed

Hasson-Ohayon, Ilanit; Roe, David; Yanos, Philip T; Lysaker, Paul H

2016-12-01

Recent developments in mental health have emphasized recovery as an outcome for people with serious mental illness (SMI). Accordingly, several studies have attempted to evaluate the process and outcome of recovery-oriented psychosocial interventions. To review and discuss quantitative and qualitative findings from previous efforts to study the impact of five recovery-oriented interventions: Illness Management and Recovery (IMR), Narrative Enhancement and Cognitive Therapy (NECT), Supported Employment (SE), Supported Socialization (SS), and Family Psychoeducation. Reviewing the literature on studies that examine the effectiveness of these interventions by using both quantitative and qualitative approach. Qualitative findings in these studies augment quantitative findings and at times draw attention to unexpected findings and uniquely illuminate the effects of these interventions on self-reflective processes. There is a need for further exploration of how mixed-methods can be implemented to explore recovery-oriented outcomes. Critical questions regarding the implications of qualitative findings are posed.

A Mixed Methods Content Analysis of the Research Literature in Science Education

ERIC Educational Resources Information Center

Schram, Asta B.

2014-01-01

In recent years, more and more researchers in science education have been turning to the practice of combining qualitative and quantitative methods in the same study. This approach of using mixed methods creates possibilities to study the various issues that science educators encounter in more depth. In this content analysis, I evaluated 18…

Explicating Metatheory for Mixed Methods Research in Educational Leadership: An Application of Habermas's "Theory of Communicative Action"

ERIC Educational Resources Information Center

Whiteman, Rodney S.

2015-01-01

Purpose: Mixed methods research can provide a fruitful line of inquiry for educational leadership, program evaluation, and policy analysis; however, mixed methods research requires a metatheory that allows for mixing what have traditionally been considered incompatible qualitative and quantitative inquiry. The purpose of this paper is to apply…

African Swine Fever in Uganda: Qualitative Evaluation of Three Surveillance Methods with Implications for Other Resource-Poor Settings.

PubMed

Chenais, Erika; Sternberg-Lewerin, Susanna; Boqvist, Sofia; Emanuelson, Ulf; Aliro, Tonny; Tejler, Emma; Cocca, Giampaolo; Masembe, Charles; Ståhl, Karl

2015-01-01

Animal diseases impact negatively on households and on national economies. In low-income countries, this pertains especially to socio-economic effects on household level. To control animal diseases and mitigate their impact, it is necessary to understand the epidemiology of the disease in its local context. Such understanding, gained through disease surveillance, is often lacking in resource-poor settings. Alternative surveillance methods have been developed to overcome some of the hurdles obstructing surveillance. The objective of this study was to evaluate and qualitatively compare three methods for surveillance of acute infectious diseases using African swine fever in northern Uganda as an example. Report-driven outbreak investigations, participatory rural appraisals (PRAs), and a household survey using a smartphone application were evaluated. All three methods had good disease-detecting capacity, and each of them detected many more outbreaks compared to those reported to the World Organization for Animal Health during the same time period. Apparent mortality rates were similar for the three methods although highest for the report-driven outbreak investigations, followed by the PRAs, and then the household survey. The three methods have different characteristics and the method of choice will depend on the surveillance objective. The optimal situation might be achieved by a combination of the methods: outbreak detection via smartphone-based real-time surveillance, outbreak investigation for collection of biological samples, and a PRA for a better understanding of the epidemiology of the specific outbreak. All three methods require initial investments and continuous efforts. The sustainability of the surveillance system should, therefore, be carefully evaluated before making such investments.

Australian health promotion practitioners' perceptions on evaluation of empowerment and participation.

PubMed

Brandstetter, Susanne; McCool, Megan; Wise, Marilyn; Loss, Julika

2014-03-01

Although participation and empowerment are hallmarks of the WHO vision of health promotion, it is acknowledged that they are difficult to evaluate. Devising adequate study designs, indicators and methods for the assessment of participation and empowerment should consider the experiences, concerns and constraints of health promotion practitioners. The aim of this study was to investigate health promotion practitioners' perspectives on general and methodological aspects of evaluation of empowerment and participation. Semi-structured interviews were conducted with 17 experienced practitioners in community-based health promotion in New South Wales, Australia. The interviews covered benefits of and barriers to the evaluation of participation and empowerment, key indicators and methodological aspects. Interview transcripts were examined using thematic content analysis. The idea of evaluating empowerment and participation is supported by health promotion practitioners. Including indicators of empowerment and participation in the evaluation could also emphasise-to practitioners and citizens alike-the value of involving and enabling community members. The interviews highlighted the importance of a receptive environment for evaluation of empowerment and participation to take root. The resistance of health authorities towards empowerment indicators was seen as a challenge for funding evaluations. Community members should be included in the evaluation process, although interviewees found it difficult to do so in a representative way and empowering approach. Qualitative methods might capture best whether empowerment and participation have occurred in a programme. The positive experiences that the interviewees made with innovative qualitative methods encourage further investment in developing new research designs.

Qualitative Evaluation of Emotional Intelligence In-Service Program for Secondary School Teachers

ERIC Educational Resources Information Center

Fer, Seval

2004-01-01

This paper is an attempt to evaluate the Emotional Intelligence (EQ) In-Service Program on the basis of experiences of 20 secondary school teachers who attended the program in a private school in Turkey. A phenomenological approach, with a focus group method was used. The first objective of this study was to evaluate EQ program on the basis of…

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

Evaluating Creative Thinking of Rn-Bsn Students in the Course of Clinical Case Study and Practicum

ERIC Educational Resources Information Center

Ku, Ya-Lie

2015-01-01

This case study evaluated creative thinking of RN-BSN students in the course of clinical case study and practicum. Study design used quantitative and qualitative evaluations of creative thinking of RN-BSN students by triangulation method in the course of clinical case study and practicum. Sixty RN-BSN students self-perceived the changing levels of…

Quantitative methods in assessment of neurologic function.

PubMed

Potvin, A R; Tourtellotte, W W; Syndulko, K; Potvin, J

1981-01-01

Traditionally, neurologists have emphasized qualitative techniques for assessing results of clinical trials. However, in recent years qualitative evaluations have been increasingly augmented by quantitative tests for measuring neurologic functions pertaining to mental state, strength, steadiness, reactions, speed, coordination, sensation, fatigue, gait, station, and simulated activities of daily living. Quantitative tests have long been used by psychologists for evaluating asymptomatic function, assessing human information processing, and predicting proficiency in skilled tasks; however, their methodology has never been directly assessed for validity in a clinical environment. In this report, relevant contributions from the literature on asymptomatic human performance and that on clinical quantitative neurologic function are reviewed and assessed. While emphasis is focused on tests appropriate for evaluating clinical neurologic trials, evaluations of tests for reproducibility, reliability, validity, and examiner training procedures, and for effects of motivation, learning, handedness, age, and sex are also reported and interpreted. Examples of statistical strategies for data analysis, scoring systems, data reduction methods, and data display concepts are presented. Although investigative work still remains to be done, it appears that carefully selected and evaluated tests of sensory and motor function should be an essential factor for evaluating clinical trials in an objective manner.

Interactive Video Usage on Autism Spectrum Disorder Training in Medical Education

ERIC Educational Resources Information Center

Taslibeyaz, Elif; Dursun, Onur Burak; Karaman, Selcuk

2017-01-01

This study aimed to compare the effects of interactive and non-interactive videos concerning the autism spectrum disorder on medical students' achievement. It also evaluated the relation between the interactive videos' interactivity and the students' decision-making process. It used multiple methods, including quantitative and qualitative methods.…

Aligning Person-Centred Methods and Young People's Conceptualizations of Diversity

ERIC Educational Resources Information Center

Waite, Sue; Boyask, Ruth; Lawson, Hazel

2010-01-01

Many existing studies of diversity are concerned with social groups identified by externally determined factors, for example, ethnicity, gender, or educational attainment, and examine, either quantitatively or qualitatively, issues delineated by these. In evaluating methods used in previous research, we consider ways in which the adoption of…

Developing patient-centered treatment protocols in brain stimulation: a rationale for combining quantitative and qualitative approaches in persons with HIV.

PubMed

Rosedale, Mary; Malaspina, Dolores; Malamud, Daniel; Strauss, Shiela M; Horne, Jaclyn D; Abouzied, Salman; Cruciani, Ricardo A; Knotkova, Helena

2012-01-01

This article reports and discusses how quantitative (physiological and behavioral) and qualitative methods are being combined in an open-label pilot feasibility study. The study evaluates safety, tolerability, and acceptability of a protocol to treat depression in HIV-infected individuals, using a 2-week block of transcranial direct current stimulation (tDCS) over the dorsolateral prefrontal cortex. Major depressive disorder (MDD) is the second most prevalent psychiatric disorder after substance abuse among HIV-positive adults, and novel antidepressant treatments are needed for this vulnerable population. The authors describe the challenges and contributions derived from different research perspectives and methodological approaches and provide a philosophical framework for combining quantitative and qualitative measurements for a fuller examination of the disorder. Four methodological points are presented: (1) the value of combining quantitative and qualitative approaches; (2) the need for context-specific measures when studying patients with medical and psychiatric comorbidities; (3) the importance of research designs that integrate physiological, behavioral, and qualitative approaches when evaluating novel treatments; and (4) the need to explore the relationships between biomarkers, clinical symptom assessments, patient self-evaluations, and patient experiences when developing new, patient-centered protocols. The authors conclude that the complexity of studying novel treatments in complex and new patient populations requires complex research designs to capture the richness of data that inform translational research.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

PubMed

Badran, Hani; Pluye, Pierre; Grad, Roland

2017-03-14

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. ©Hani Badran, Pierre Pluye, Roland Grad. Originally published in JMIR Medical Education (http://mededu.jmir.org), 14.03.2017.

Evaluating the BK 21 Program. Research Brief

ERIC Educational Resources Information Center

Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.

2008-01-01

The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…

Principal Evaluation--Linking Individual and Building-Level Progress: Making the Connections and Embracing the Tensions

ERIC Educational Resources Information Center

Zepeda, Sally J.; Lanoue, Philip D.; Price, Noris F.; Jimenez, Albert M.

2014-01-01

The article examines the tensions one superintendent in the USA experienced as he evaluated principals in a high-stakes environment that had undergone numerous transformations at the central office. Using qualitative methods, primarily, shadowing techniques, observations and debriefing, the following tensions emerged and were examined in light of…

Methodology for Evaluating an Adaptation of Evidence-Based Drug Abuse Prevention in Alternative Schools

ERIC Educational Resources Information Center

Hopson, Laura M.; Steiker, Lori K. H.

2008-01-01

The purpose of this article is to set forth an innovative methodological protocol for culturally grounding interventions with high-risk youths in alternative schools. This study used mixed methods to evaluate original and adapted versions of a culturally grounded substance abuse prevention program. The qualitative and quantitative methods…

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

From Speed Dating to Intimacy: Methodological Change in the Evaluation of a Writing Group

ERIC Educational Resources Information Center

Bosanquet, Agnes; Cahir, Jayde; Jacenyik-Trawoger, Christa; McNeill, Margot

2014-01-01

This paper explores an innovative approach to evaluating the effectiveness of a writing group in an Australian research-intensive university. Traditional qualitative and quantitative methods typically applied in higher-education research may be effective in analysing the output of writing groups; however, they do not always address the affective…

Initial Results of Illinois' Shifting Gears Pilot Demonstration Evaluation

ERIC Educational Resources Information Center

Bragg, Debra D.; Harmon, Timothy; Kirby, Catherine L.; Kim, Sujung

2009-01-01

This report provides initial results of Illinois' Shifting Gears Initiative that operated between July 1, 2007 and June 30, 2009. This mixed method (qualitative and quantitative) evaluation sought to accomplish three goals: (1) to assess program and student outcomes for two models (adult education and developmental education) for two target groups…

Multi-Method Evaluation of College Teaching

ERIC Educational Resources Information Center

Algozzine, Bob; Beattie, John; Bray, Marty; Flowers, Claudia; Gretes, John; Mohanty, Ganesh; Spooner, Fred

2010-01-01

Student evaluation of instruction in college and university courses has been a routine and mandatory part of undergraduate and graduate education for some time. A major shortcoming of the process is that it relies exclusively on the opinions or qualitative judgments of students rather than on assessing the learning or transfer of knowledge that…

Qualitative studies. Their role in medical research.

PubMed Central

Huston, P.; Rowan, M.

1998-01-01

OBJECTIVE: To define qualitative research in terms of its philosophical roots, the questions it addresses, its methods and analyses, and the type of results it can offer. DATA SOURCES: MEDLINE and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases were searched for the years January 1985 to April 1998. The search strategy consisted of "textword" terms that searched in the "title" field of both databases. Qualitative research and evaluation textbooks in health and the social sciences were also used. QUALITY OF EVIDENCE: The information on qualitative research is based on the most recent and valid evidence from the health and social science fields. MAIN MESSAGE: Qualitative research seeks to understand and interpret personal experience to explain social phenomena, including those related to health. It can address questions that quantitative research cannot, such as why people do not adhere to a treatment regimen or why a certain health care intervention is successful. It uses many methods of data collection, including participant observation, case studies, and interviews, and numerous approaches to data analysis that range from the quasistatistical to the intuitive and inductive. CONCLUSIONS: Qualitative research, a form of research completely different from quantitative research, can provide important insights into health-related phenomena and can enrich further research inquiries. PMID:9839063

Screening method to evaluate point-of-care human chorionic gonadotropin (hCG) devices for susceptibility to the hook effect by hCG β core fragment: evaluation of 11 devices.

PubMed

Nerenz, Robert D; Song, Haowei; Gronowski, Ann M

2014-04-01

The predominant hCG variant in urine, hCG β core fragment (hCGβcf), has been demonstrated to cause false-negative results in qualitative point-of-care (POC) hCG devices. This is a major concern for healthcare professionals using POC pregnancy tests. We developed a screening method to evaluate qualitative POC hCG devices for their susceptibility to inhibition by hCGβcf. Using this method, we evaluated the performance of 11 commonly used devices. A wide range of purified hCG and hCGβcf concentrations were mixed and tested on 2 POC devices. By use of those results, a screening method was defined and 9 additional POC devices were evaluated. Two solutions containing (a) 500 pmol/L (171 IU/L) intact hCG with 0 pmol/L hCGβcf and (b) 500 pmol/L intact hCG with 500 000 pmol/L hCGβcf were used to screen all POC devices. The OSOM and Cen-Med Elite devices were found to be most susceptible to false-negative results due to hCGβcf. The BC Icon 20 and the Alere were the least susceptible. The remaining 7 were moderately affected. Devices that gave the strongest signal with hCGβcf alone were those that were least likely to show a hook effect. The screening method put forth here can be used by device users and manufacturers to evaluate POC devices for inhibition by hCGβcf. Of 11 devices evaluated, only 2 have been identified that exhibit minimal to no susceptibility to hCGβcf.

A novel approach to mixing qualitative and quantitative methods in HIV and STI prevention research.

PubMed

Penman-Aguilar, Ana; Macaluso, Maurizio; Peacock, Nadine; Snead, M Christine; Posner, Samuel F

2014-04-01

Mixed-method designs are increasingly used in sexually transmitted infection (STI) and HIV prevention research. The authors designed a mixedmethod approach and applied it to estimate and evaluate a predictor of continued female condom use (6+ uses, among those who used it at least once) in a 6-month prospective cohort study. The analysis included 402 women who received an intervention promoting use of female and male condoms for STI prevention and completed monthly quantitative surveys; 33 also completed a semistructured qualitative interview. The authors identified a qualitative theme (couples' female condom enjoyment [CFCE]), applied discriminant analysis techniques to estimate CFCE for all participants, and added CFCE to a multivariable logistic regression model of continued female condom use. CFCE related to comfort, naturalness, pleasure, feeling protected, playfulness, ease of use, intimacy, and feeling in control of protection. CFCE was associated with continued female condom use (adjusted odds ratio: 2.8, 95% confidence interval: 1.4-5.6) and significantly improved model fit (p < .001). CFCE predicted continued female condom use. Mixed-method approaches for "scaling up" qualitative findings from small samples to larger numbers of participants can benefit HIV and STI prevention research.

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

[Evaluation by case managers dementia : An explorative practice based study on types and content].

PubMed

Ketelaar, Nicole A B M; Jukema, Jan S; van Bemmel, Marlies; Adriaansen, Marian J M; Smits, Carolien H M

2017-06-01

This practice based explorative study aims to provide insight into the ways in which case managers shape and fill up the evaluation phase of their support of the informal care network of persons with dementia. A combination of quantitative and qualitative research methods were used. A group of 57 case managers of persons with dementia in three different organisational networks took part in this study. Results from the quantitative and qualitative data are organized into four themes: (1) attitude towards evaluation, (2) forms of evaluation, (3) implementation of evaluation and (4) content of evaluation. There are different ways in shaping evaluation and the content of it. The importance of interim and final evaluation is recognized, but is difficult to realize in a methodical way. Barriers experienced by the case managers include various factors associated both with clients as professionals. Case managers evaluate continuously and in an informal way to assess whether the extent of their assistance is meeting the needs of the client and informal network. Case managers do not use systematic evaluation to measure the quality of care they offer to persons with dementia and their caregivers. The findings demand a discussion on the level of clients, as well as on the professional and societal level about the way case managers should evaluate their support.

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

PubMed

Tonkin-Crine, Sarah; Anthierens, Sibyl; Hood, Kerenza; Yardley, Lucy; Cals, Jochen W L; Francis, Nick A; Coenen, Samuel; van der Velden, Alike W; Godycki-Cwirko, Maciek; Llor, Carl; Butler, Chris C; Verheij, Theo J M; Goossens, Herman; Little, Paul

2016-05-12

Mixed methods are commonly used in health services research; however, data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point-of-care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs' and patients' experiences of taking part in the trial. Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with (1) 62 patients and (2) 66 GPs and quantitative data collected via questionnaires with (3) 2886 patients and (4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence. Three instances of dissonance occurred in 39 independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt that the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested that this was unnecessary if a full explanation was given. Whilst qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet. Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient booklet were relevant and useful for all patients and associated with increased patient satisfaction. A triangulation protocol to integrate qualitative and quantitative data can reveal findings that need further interpretation and also highlight areas of dissonance that lead to a deeper insight than separate analyses.

Impact of Participation in TimeSlips, a Creative Group-Based Storytelling Program, on Medical Student Attitudes Toward Persons With Dementia: A Qualitative Study

PubMed Central

George, Daniel R.; Stuckey, Heather L.; Dillon, Caroline F.; Whitehead, Megan M.

2011-01-01

Purpose: To evaluate whether medical student participation in TimeSlips (TS), a creative group-based storytelling program, with persons affected by dementia would improve student attitudes toward this patient population. Design and Methods: Fifteen fourth-year medical students from Penn State College of Medicine participated in a month-long regimen of TS sessions at a retirement community. Student course evaluations were analyzed at the conclusion of the program to examine perceived qualitative changes in attitude. Findings: Qualitative data revealed insights into the manner in which student attitudes toward a geriatric patient population became more positive. Implications: This is the first known pilot study to suggest that participation in a creative group-based storytelling program might improve medical student attitudes toward persons with dementia. PMID:21665958

DOE Office of Scientific and Technical Information (OSTI.GOV)

Toro, Javier, E-mail: jjtoroca@unal.edu.co; Duarte, Oscar, E-mail: ogduartev@unal.edu.co; Requena, Ignacio, E-mail: requena@decsai.ugr.es

The concept of vulnerability has been used to describe the susceptibility of physical, biotic, and social systems to harm or hazard. In this sense, it is a tool that reduces the uncertainties of Environmental Impact Assessment (EIA) since it does not depend exclusively on the value assessments of the evaluator, but rather is based on the environmental state indicators of the site where the projects or activities are being carried out. The concept of vulnerability thus reduces the possibility that evaluators will subjectively interpret results, and be influenced by outside interests and pressures during projects. However, up until now, EIAmore » has been hindered by a lack of effective methods. This research study analyzes the concept of vulnerability, defines Vulnerability Importance and proposes its inclusion in qualitative EIA methodology. The method used to quantify Vulnerability Importance is based on a set of environmental factors and indicators that provide a comprehensive overview of the environmental state. The results obtained in Colombia highlight the usefulness and objectivity of this method since there is a direct relation between this value and the environmental state of the departments analyzed. - Research Highlights: Black-Right-Pointing-Pointer The concept of vulnerability could be considered defining Vulnerability Importance included in qualitative EIA methodology. Black-Right-Pointing-Pointer The use of the concept of environmental vulnerability could reduce the subjectivity of qualitative methods of EIA. Black-Right-Pointing-Pointer A method to quantify the Vulnerability Importance proposed provides a comprehensive overview of the environmental state. Black-Right-Pointing-Pointer Results in Colombia highlight the usefulness and objectivity of this method.« less

A human factors systems approach to understanding team-based primary care: a qualitative analysis

PubMed Central

Mundt, Marlon P.; Swedlund, Matthew P.

2016-01-01

Background. Research shows that high-functioning teams improve patient outcomes in primary care. However, there is no consensus on a conceptual model of team-based primary care that can be used to guide measurement and performance evaluation of teams. Objective. To qualitatively understand whether the Systems Engineering Initiative for Patient Safety (SEIPS) model could serve as a framework for creating and evaluating team-based primary care. Methods. We evaluated qualitative interview data from 19 clinicians and staff members from 6 primary care clinics associated with a large Midwestern university. All health care clinicians and staff in the study clinics completed a survey of their communication connections to team members. Social network analysis identified key informants for interviews by selecting the respondents with the highest frequency of communication ties as reported by their teammates. Semi-structured interviews focused on communication patterns, team climate and teamwork. Results. Themes derived from the interviews lent support to the SEIPS model components, such as the work system (Team, Tools and Technology, Physical Environment, Tasks and Organization), team processes and team outcomes. Conclusions. Our qualitative data support the SEIPS model as a promising conceptual framework for creating and evaluating primary care teams. Future studies of team-based care may benefit from using the SEIPS model to shift clinical practice to high functioning team-based primary care. PMID:27578837

A quantitative evaluation of a qualitative risk assessment framework: Examining the assumptions and predictions of the Productivity Susceptibility Analysis (PSA)

PubMed Central

2018-01-01

Qualitative risk assessment frameworks, such as the Productivity Susceptibility Analysis (PSA), have been developed to rapidly evaluate the risks of fishing to marine populations and prioritize management and research among species. Despite being applied to over 1,000 fish populations, and an ongoing debate about the most appropriate method to convert biological and fishery characteristics into an overall measure of risk, the assumptions and predictive capacity of these approaches have not been evaluated. Several interpretations of the PSA were mapped to a conventional age-structured fisheries dynamics model to evaluate the performance of the approach under a range of assumptions regarding exploitation rates and measures of biological risk. The results demonstrate that the underlying assumptions of these qualitative risk-based approaches are inappropriate, and the expected performance is poor for a wide range of conditions. The information required to score a fishery using a PSA-type approach is comparable to that required to populate an operating model and evaluating the population dynamics within a simulation framework. In addition to providing a more credible characterization of complex system dynamics, the operating model approach is transparent, reproducible and can evaluate alternative management strategies over a range of plausible hypotheses for the system. PMID:29856869

Is the worldview of qualitative inquiry a proper guide for psychological research?

PubMed

Capaldi, E J; Proctor, Robert W

2005-01-01

Qualitative methods are becoming increasingly popular in psychology. Although the distinction between qualitative and quantitative often is stated in terms of methods, the real distinction is between worldviews: that favored by most qualitative methodologists, which emphasizes subjective experience and multiple realities, and that commonly accepted in science. The worldview accepted by most adherents of qualitative inquiry suggests the exclusive use of methods that include verbal reports of lived experience. Qualitative methods serve an important function in psychology, but their use as recommended by their adherents is limited in 2 respects: The adherents use a narrow and unconventional approach to qualitative methods that differs from that normally understood, and they favor use of a restricted range of qualitative methods over other qualitative methods and quantitative methods. If qualitative inquiry is to make a greater contribution to psychology, researchers in that tradition must acquire a better understanding of contemporary science, correct their misunderstandings of the rationale for quantitative methods, and address the apparent limitations of their methods emphasizing reported experience.

Scenario-Based Case Study Method and the Functionality of the Section Called "From Production to Consumption" from the Perspective of Primary School Students

ERIC Educational Resources Information Center

Taneri, Ahu

2018-01-01

In this research, the aim was showing the evaluation of students on scenario-based case study method and showing the functionality of the studied section called "from production to consumption". Qualitative research method and content analysis were used to reveal participants' experiences and reveal meaningful relations regarding…

Combining Qualitative and Quantitative Approaches: Some Arguments for Mixed Methods Research

ERIC Educational Resources Information Center

Lund, Thorleif

2012-01-01

One purpose of the present paper is to elaborate 4 general advantages of the mixed methods approach. Another purpose is to propose a 5-phase evaluation design, and to demonstrate its usefulness for mixed methods research. The account is limited to research on groups in need of treatment, i.e., vulnerable groups, and the advantages of mixed methods…

Absolute order-of-magnitude reasoning applied to a social multi-criteria evaluation framework

NASA Astrophysics Data System (ADS)

Afsordegan, A.; Sánchez, M.; Agell, N.; Aguado, J. C.; Gamboa, G.

2016-03-01

A social multi-criteria evaluation framework for solving a real-case problem of selecting a wind farm location in the regions of Urgell and Conca de Barberá in Catalonia (northeast of Spain) is studied. This paper applies a qualitative multi-criteria decision analysis approach based on linguistic labels assessment able to address uncertainty and deal with different levels of precision. This method is based on qualitative reasoning as an artificial intelligence technique for assessing and ranking multi-attribute alternatives with linguistic labels in order to handle uncertainty. This method is suitable for problems in the social framework such as energy planning which require the construction of a dialogue process among many social actors with high level of complexity and uncertainty. The method is compared with an existing approach, which has been applied previously in the wind farm location problem. This approach, consisting of an outranking method, is based on Condorcet's original method. The results obtained by both approaches are analysed and their performance in the selection of the wind farm location is compared in aggregation procedures. Although results show that both methods conduct to similar alternatives rankings, the study highlights both their advantages and drawbacks.

'CHEATS': a generic information communication technology (ICT) evaluation framework.

PubMed

Shaw, Nicola T

2002-05-01

This paper describes a generic framework for the evaluation of information communication technologies. This framework, CHEATS, utilises both qualitative and quantitative research methods and has proved appropriate in multiple clinical settings including telepsychiatry, teledermatology and teleeducation. The paper demonstrates how a multidisciplinary approach is essential when evaluating new and emerging technologies, particularly when such systems are implemented in real service as opposed to a research setting.

Study on the application of ambient vibration tests to evaluate the effectiveness of seismic retrofitting

NASA Astrophysics Data System (ADS)

Liang, Li; Takaaki, Ohkubo; Guang-hui, Li

2018-03-01

In recent years, earthquakes have occurred frequently, and the seismic performance of existing school buildings has become particularly important. The main method for improving the seismic resistance of existing buildings is reinforcement. However, there are few effective methods to evaluate the effect of reinforcement. Ambient vibration measurement experiments were conducted before and after seismic retrofitting using wireless measurement system and the changes of vibration characteristics were compared. The changes of acceleration response spectrum, natural periods and vibration modes indicate that the wireless vibration measurement system can be effectively applied to evaluate the effect of seismic retrofitting. The method can evaluate the effect of seismic retrofitting qualitatively, it is difficult to evaluate the effect of seismic retrofitting quantitatively at this stage.

Recommendations for a mixed methods approach to evaluating the patient-centered medical home.

PubMed

Goldman, Roberta E; Parker, Donna R; Brown, Joanna; Walker, Judith; Eaton, Charles B; Borkan, Jeffrey M

2015-03-01

There is a strong push in the United States to evaluate whether the patient-centered medical home (PCMH) model produces desired results. The explanatory and contextually based questions of how and why PCMH succeeds in different practice settings are often neglected. We report the development of a comprehensive, mixed qualitative-quantitative evaluation set for researchers, policy makers, and clinician groups. To develop an evaluation set, the Brown Primary Care Transformation Initiative convened a multidisciplinary group of PCMH experts, reviewed the PCMH literature and evaluation strategies, developed key domains for evaluation, and selected or created methods and measures for inclusion. The measures and methods in the evaluation set (survey instruments, PCMH meta-measures, patient outcomes, quality measures, qualitative interviews, participant observation, and process evaluation) are meant to be used together. PCMH evaluation must be sufficiently comprehensive to assess and explain both the context of transformation in different primary care practices and the experiences of diverse stakeholders. In addition to commonly assessed patient outcomes, quality, and cost, it is critical to include PCMH components integral to practice culture transformation: patient and family centeredness, authentic patient activation, mutual trust among practice employees and patients, and transparency, joy, and collaboration in delivering and receiving care in a changing environment. This evaluation set offers a comprehensive methodology to enable understanding of how PCMH transformation occurs in different practice settings. This approach can foster insights about how transformation affects critical outcomes to achieve meaningful, patient-centered, high-quality, and cost-effective sustainable change among diverse primary care practices. © 2015 Annals of Family Medicine, Inc.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

Health systems research training enhances workplace research skills: a qualitative evaluation.

PubMed

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager perceptions of the usefulness, in the work setting, of skills taught on a health systems research education course in South Africa and to assess the extent to which the course stimulated awareness and development of health systems research in the work setting. The education course was evaluated using a qualitative approach. Respondents were selected for interview using purposive sampling. Interviews were conducted with 39 respondents, including all of the major stakeholders. The interviews lasted between 20 and 60 minutes and were conducted either face to face or over the telephone. Thematic analysis was applied to the data, and key themes were identified. The course demystified health systems research and stimulated interest in reading and applying research findings. The course also changed participants' attitudes to routine data collection and was reported to have facilitated the application of informal research or problem-solving methods to everyday work situations. However, inadequate support within the workplace was a significant obstacle to applying the skills learned. A 2-week intensive, experiential course in health systems research methods can provide a mechanism for introducing basic research skills to a wide range of learners. Qualitative evaluation is a useful approach for assessing the impacts of education courses.

Development of an Interactive Social Media Tool for Parents with Concerns about Vaccines

ERIC Educational Resources Information Center

Shoup, Jo Ann; Wagner, Nicole M.; Kraus, Courtney R.; Narwaney, Komal J.; Goddard, Kristin S.; Glanz, Jason M.

2015-01-01

Objective: Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method: We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results:…

Sexual Health Promotion Programme: Participants' Perspectives on Capacity Building

ERIC Educational Resources Information Center

Keogh, Brian; Daly, Louise; Sharek, Danika; De Vries, Jan; McCann, Edward; Higgins, Agnes

2016-01-01

Objectives: The aim of this study was to evaluate a Health Service Executive (HSE) Foundation Programme in Sexual Health Promotion (FPSHP) with a specific emphasis on capacity building. Design: A mixed-method design using both quantitative and qualitative methods was used to collect the data. Setting: The FPSHP was delivered to staff working in…

Evaluating the Use of Reflective Counseling Group Supervision for Military Counselors in Taiwan

ERIC Educational Resources Information Center

Jen der Pan, Peter; Deng, Liang-Yu F.; Tsai, Shiou-Ling

2008-01-01

The purpose of this study is to examine the effects of reflective counseling group supervision (RCGS) for military counselors. A convenience sampling method is adopted. Twenty-two military counselors participate in this study. Both qualitative and quantitative research methods are used for collecting and analyzing data. The results support our…

Using Research-Based Instruction to Improve Math Outcomes with Underprepared Students

ERIC Educational Resources Information Center

Pearce, Lee R.; Pearce, Kristi L.; Siewert, Daluss J.

2017-01-01

The authors used a mixed-methods research design to evaluate a multi-tiered system of supports model to address the disturbing failure rates of underprepared college students placed in developmental mathematics at a small state university. While qualitative data gathered from using Participatory Action Research methods directed the two-year…

[The positioning of nursing research in the academic studies: the origin and development of qualitative and quantitative studies].

PubMed

Lu, Pei-Pei; Ting, Shing-Shiang; Chen, Mei-Ling; Tang, Woung-Ru

2005-12-01

The purpose of this study is to discuss the historical context of qualitative and quantitative research so as to explain the principle of qualitative study and examine the positioning of nursing research within academic study as a whole. This paper guides the readers towards the historical context from empirical science, discusses the influences of qualitative and quantitative research on nursing research, then investigates the nature of research paradigms, examines the positioning of nursing research, which includes the characteristics of fields such as natural science, humanity and social studies, and science, and lastly, presents the research standard proposed by Yardley in 2000. The research paradigms include Positivism, Postpositivism, Criticism, and Constructivism, which can be compared with Ontology, Epistemology, and Methodology. The nature of the paradigm is to determine the assumption of the paradigm on the basis of Ontology, Epistemology, and Methodology. The paradigm determines how the researcher views the world and decides on what to answer, how to research, and how to answer. The difference in academic environment is reflected in the long-term dialogue between qualitative and quantitative studies, as well as the standard for criticism. This paper introduces the method of evaluation of the quality of qualitative study proposed by Yardley in 2002, namely the sensitivity of the context, the promise and conscientiousness, transparency and consistency, influence and significance. The paper is intended to provide a guideline for readers in evaluating the quality of qualitative study.

Peer support for parents of children with chronic disabling conditions: a systematic review of quantitative and qualitative studies.

PubMed

Shilling, Val; Morris, Christopher; Thompson-Coon, Jo; Ukoumunne, Obioha; Rogers, Morwenna; Logan, Stuart

2013-07-01

To review the qualitative and quantitative evidence of the benefits of peer support for parents of children with disabling conditions in the context of health, well-being, impact on family, and economic and service implications. We comprehensively searched multiple databases. Eligible studies evaluated parent-to-parent support and reported on the psychological health and experience of giving or receiving support. There were no limits on the child's condition, study design, language, date, or setting. We sought to aggregate quantitative data; findings of qualitative studies were combined using thematic analysis. Qualitative and quantitative data were brought together in a narrative synthesis. Seventeen papers were included: nine qualitative studies, seven quantitative studies, and one mixed-methods evaluation. Four themes were identified from qualitative studies: (1) shared social identity, (2) learning from the experiences of others, (3) personal growth, and (4) supporting others. Some quantitative studies reported a positive effect of peer support on psychological health and other outcomes; however, this was not consistently confirmed. It was not possible to aggregate data across studies. No costing data were identified. Qualitative studies strongly suggest that parents perceive benefit from peer support programmes, an effect seen across different types of support and conditions. However, quantitative studies provide inconsistent evidence of positive effects. Further research should explore whether this dissonance is substantive or an artefact of how outcomes have been measured. © The Authors. Developmental Medicine & Child Neurology © 2013 Mac Keith Press.

Searching for rigour in the reporting of mixed methods population health research: a methodological review.

PubMed

Brown, K M; Elliott, S J; Leatherdale, S T; Robertson-Wilson, J

2015-12-01

The environments in which population health interventions occur shape both their implementation and outcomes. Hence, when evaluating these interventions, we must explore both intervention content and context. Mixed methods (integrating quantitative and qualitative methods) provide this opportunity. However, although criteria exist for establishing rigour in quantitative and qualitative research, there is poor consensus regarding rigour in mixed methods. Using the empirical example of school-based obesity interventions, this methodological review examined how mixed methods have been used and reported, and how rigour has been addressed. Twenty-three peer-reviewed mixed methods studies were identified through a systematic search of five databases and appraised using the guidelines for Good Reporting of a Mixed Methods Study. In general, more detailed description of data collection and analysis, integration, inferences and justifying the use of mixed methods is needed. Additionally, improved reporting of methodological rigour is required. This review calls for increased discussion of practical techniques for establishing rigour in mixed methods research, beyond those for quantitative and qualitative criteria individually. A guide for reporting mixed methods research in population health should be developed to improve the reporting quality of mixed methods studies. Through improved reporting, mixed methods can provide strong evidence to inform policy and practice. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Identification of volatiles by headspace gas chromatography with simultaneous flame ionization and mass spectrometric detection.

PubMed

Tiscione, Nicholas B; Yeatman, Dustin Tate; Shan, Xiaoqin; Kahl, Joseph H

2013-10-01

Volatiles are frequently abused as inhalants. The methods used for identification are generally nonspecific if analyzed concurrently with ethanol or require an additional analytical procedure that employs mass spectrometry. A previously published technique utilizing a capillary flow technology splitter to simultaneously quantitate and confirm ethyl alcohol by flame ionization and mass spectrometric detection after headspace sampling and gas chromatographic separation was evaluated for the detection of inhalants. Methanol, isopropanol, acetone, acetaldehyde, toluene, methyl ethyl ketone, isoamyl alcohol, isobutyl alcohol, n-butyl alcohol, 1,1-difluoroethane, 1,1,1-trifluoroethane, 1,1,1,2-tetrafluoroethane (Norflurane, HFC-134a), chloroethane, trichlorofluoromethane (Freon®-11), dichlorodifluoromethane (Freon®-12), dichlorofluoromethane (Freon®-21), chlorodifluoromethane (Freon®-22) and 1,2-dichlorotetrafluoroethane (Freon®-114) were validated for qualitative identification by this method. The validation for qualitative identification included evaluation of matrix effects, sensitivity, carryover, specificity, repeatability and ruggedness/robustness.

Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute.

PubMed

Petticrew, Mark; Rehfuess, Eva; Noyes, Jane; Higgins, Julian P T; Mayhew, Alain; Pantoja, Tomas; Shemilt, Ian; Sowden, Amanda

2013-11-01

Although there is increasing interest in the evaluation of complex interventions, there is little guidance on how evidence from complex interventions may be reviewed and synthesized, and the relevance of the plethora of evidence synthesis methods to complexity is unclear. This article aims to explore how different meta-analytical approaches can be used to examine aspects of complexity; describe the contribution of various narrative, tabular, and graphical approaches to synthesis; and give an overview of the potential choice of selected qualitative and mixed-method evidence synthesis approaches. The methodological discussions presented here build on a 2-day workshop held in Montebello, Canada, in January 2012, involving methodological experts from the Campbell and Cochrane Collaborations and from other international review centers (Anderson L, Petticrew M, Chandler J, et al. systematic reviews of complex interventions. In press). These systematic review methodologists discussed the broad range of existing methods and considered the relevance of these methods to reviews of complex interventions. The evidence from primary studies of complex interventions may be qualitative or quantitative. There is a wide range of methodological options for reviewing and presenting this evidence. Specific contributions of statistical approaches include the use of meta-analysis, meta-regression, and Bayesian methods, whereas narrative summary approaches provide valuable precursors or alternatives to these. Qualitative and mixed-method approaches include thematic synthesis, framework synthesis, and realist synthesis. A suitable combination of these approaches allows synthesis of evidence for understanding complex interventions. Reviewers need to consider which aspects of complex interventions should be a focus of their review and what types of quantitative and/or qualitative studies they will be including, and this will inform their choice of review methods. These may range from standard meta-analysis through to more complex mixed-method synthesis and synthesis approaches that incorporate theory and/or user's perspectives. Copyright © 2013 Elsevier Inc. All rights reserved.

Qualitative versus quantitative methods in psychiatric research.

PubMed

Razafsha, Mahdi; Behforuzi, Hura; Azari, Hassan; Zhang, Zhiqun; Wang, Kevin K; Kobeissy, Firas H; Gold, Mark S

2012-01-01

Qualitative studies are gaining their credibility after a period of being misinterpreted as "not being quantitative." Qualitative method is a broad umbrella term for research methodologies that describe and explain individuals' experiences, behaviors, interactions, and social contexts. In-depth interview, focus groups, and participant observation are among the qualitative methods of inquiry commonly used in psychiatry. Researchers measure the frequency of occurring events using quantitative methods; however, qualitative methods provide a broader understanding and a more thorough reasoning behind the event. Hence, it is considered to be of special importance in psychiatry. Besides hypothesis generation in earlier phases of the research, qualitative methods can be employed in questionnaire design, diagnostic criteria establishment, feasibility studies, as well as studies of attitude and beliefs. Animal models are another area that qualitative methods can be employed, especially when naturalistic observation of animal behavior is important. However, since qualitative results can be researcher's own view, they need to be statistically confirmed, quantitative methods. The tendency to combine both qualitative and quantitative methods as complementary methods has emerged over recent years. By applying both methods of research, scientists can take advantage of interpretative characteristics of qualitative methods as well as experimental dimensions of quantitative methods.

Impact of pedagogical method on Brazilian dental students' waste management practice.

PubMed

Victorelli, Gabriela; Flório, Flávia Martão; Ramacciato, Juliana Cama; Motta, Rogério Heládio Lopes; de Souza Fonseca Silva, Almenara

2014-11-01

The purpose of this study was to conduct a qualitative analysis of waste management practices among a group of Brazilian dental students (n=64) before and after implementing two different pedagogical methods: 1) the students attended a two-hour lecture based on World Health Organization standards; and 2) the students applied the lessons learned in an organized group setting aimed toward raising their awareness about socioenvironmental issues related to waste. All eligible students participated, and the students' learning was evaluated through their answers to a series of essay questions, which were quantitatively measured. Afterwards, the impact of the pedagogical approaches was compared by means of qualitative categorization of wastes generated in clinical activities. Waste categorization was performed for a period of eight consecutive days, both before and thirty days after the pedagogical strategies. In the written evaluation, 80 to 90 percent of the students' answers were correct. The qualitative assessment revealed a high frequency of incorrect waste disposal with a significant increase of incorrect disposal inside general and infectious waste containers (p<0.05). Although the students' theoretical learning improved, it was not enough to change behaviors established by cultural values or to encourage the students to adequately segregate and package waste material.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bogunovic, Hrvoje; Pozo, Jose Maria; Villa-Uriol, Maria Cruz

Purpose: To evaluate the suitability of an improved version of an automatic segmentation method based on geodesic active regions (GAR) for segmenting cerebral vasculature with aneurysms from 3D x-ray reconstruction angiography (3DRA) and time of flight magnetic resonance angiography (TOF-MRA) images available in the clinical routine. Methods: Three aspects of the GAR method have been improved: execution time, robustness to variability in imaging protocols, and robustness to variability in image spatial resolutions. The improved GAR was retrospectively evaluated on images from patients containing intracranial aneurysms in the area of the Circle of Willis and imaged with two modalities: 3DRA andmore » TOF-MRA. Images were obtained from two clinical centers, each using different imaging equipment. Evaluation included qualitative and quantitative analyses of the segmentation results on 20 images from 10 patients. The gold standard was built from 660 cross-sections (33 per image) of vessels and aneurysms, manually measured by interventional neuroradiologists. GAR has also been compared to an interactive segmentation method: isointensity surface extraction (ISE). In addition, since patients had been imaged with the two modalities, we performed an intermodality agreement analysis with respect to both the manual measurements and each of the two segmentation methods. Results: Both GAR and ISE differed from the gold standard within acceptable limits compared to the imaging resolution. GAR (ISE) had an average accuracy of 0.20 (0.24) mm for 3DRA and 0.27 (0.30) mm for TOF-MRA, and had a repeatability of 0.05 (0.20) mm. Compared to ISE, GAR had a lower qualitative error in the vessel region and a lower quantitative error in the aneurysm region. The repeatability of GAR was superior to manual measurements and ISE. The intermodality agreement was similar between GAR and the manual measurements. Conclusions: The improved GAR method outperformed ISE qualitatively as well as quantitatively and is suitable for segmenting 3DRA and TOF-MRA images from clinical routine.« less

How to use concept mapping to identify barriers and facilitators of an electronic quality improvement intervention.

PubMed

van Engen-Verheul, Mariëtte; Peek, Niels; Vromen, Tom; Jaspers, Monique; de Keizer, Nicolette

2015-01-01

Systematic quality improvement (QI) interventions are increasingly used to change complex health care systems. Results of randomized clinical trials can provide quantitative evidence whether QI interventions were effective but they do not teach us why and how QI was (not) achieved. Qualitative research methods can answer these questions but typically involve only a small group of respondents against high resources. Concept mapping methodology overcomes these drawbacks by integrating results from qualitative group sessions with multivariate statistical analysis to represent ideas of diverse stakeholders visually on maps in an efficient way. This paper aims to describe how to use concept mapping to qualitatively gain insight into barriers and facilitators of an electronic QI intervention and presents experiences with the method from an ongoing case study to evaluate a QI system in the field of cardiac rehabilitation in the Netherlands.

An Experiential Approach to Clinical Supervision Training: A Mixed Methods Evaluation of Effectiveness

ERIC Educational Resources Information Center

Fisher, Amy Killen; Simmons, Christopher; Allen, Susan C.

2016-01-01

This study evaluates an intensive experiential exercise designed to facilitate the provision of high-quality supervision in social work. Data from 46 BSW and MSW students suggest that the exercise can be an effective learning tool. Both quantitative and qualitative findings indicated that the students formed a supervisory working alliance; BSW…

Scaling up STEM Academies Statewide: Implementation, Network Supports, and Early Outcomes

ERIC Educational Resources Information Center

Young, Viki; House, Ann; Sherer, David; Singleton, Corinne; Wang, Haiwen; Klopfenstein, Kristin

2016-01-01

This chapter presents a case study of scaling up the T-STEM initiative in Texas. Data come from the four-year longitudinal evaluation of the Texas High School Project (THSP). The evaluation studied the implementation and impact of T-STEM and the other THSP reforms using a mixed-methods design, including qualitative case studies; principal,…

Attracting Mature Students into Higher Education: The Impact of Approaches to Learning and Social Identity

ERIC Educational Resources Information Center

Howard, Chris; Davies, Peter

2013-01-01

This paper reports on data collected during an evaluation of two higher education courses designed to attract mature entrants aged between 21 and 60 to undergraduate degree programmes. Employing an evaluation design informed by a critical realist approach, the study utilised a mix of quantitative and qualitative methods to investigate the outcomes…

Intergenerational volunteering and quality of life: mixed methods evaluation of a randomized control trial involving persons with mild to moderate dementia.

PubMed

George, Daniel R

2011-09-01

This article reports on a mixed methods evaluation of a randomized control trial in Cleveland, Ohio, USA, that assessed whether an intergenerational volunteering intervention could enhance quality of life (QOL) for persons with mild to moderate dementia. Fifteen participants were randomized into intervention and control groups. The intervention group participated in hour-long volunteer sessions with a kindergarten class and an older elementary class in alternating weeks over a 5-month interval. Psychometric data on cognitive functioning, stress, depression, sense of purpose, and sense of usefulness were collected at baseline and at the close of the intervention, and change scores were computed and analyzed for all variables. Ethnography was carried out through the duration of the study, and narrative interviews were held with participants and caregivers. A modified grounded theory approach was used for qualitative analysis. Quantitative analysis demonstrated a significant decrease in stress for the intervention group. Qualitative analysis identified three main pathways through which intergenerational volunteering affected QOL: perceived health benefits, sense of purpose and sense of usefulness, and relationships. Mixed methods evaluation demonstrated that intergenerational volunteering might enhance quality of life through several key pathways, most significantly reduced stress.

Wheelchair users' perceptions of and experiences with power assist wheels.

PubMed

Giacobbi, Peter R; Levy, Charles E; Dietrich, Frederick D; Winkler, Sandra Hubbard; Tillman, Mark D; Chow, John W

2010-03-01

To assess wheelchair users' perceptions of and experiences with power assist wheels using qualitative interview methods. Qualitative evaluations were conducted in a laboratory setting with a focus on users' experiences using power assist wheel in their naturalistic environments. Participants consisted of seven women and 13 men (M(age) = 42.75, SD = 14.68) that included one African American, one Hispanic, 17 whites, and one individual from Zambia. Qualitative interviews were conducted before, during, and after use of a power assist wheel. Main outcome measures included the wheelchair users' evaluations and experiences related to the use of power assist wheels. The primary evaluations included wheeling on challenging terrains, performance of novel activities, social/family aspects, fatigue, and pain. These descriptions indicated that most participants perceived positive experiences with the power assist wheels, including access to new and different activities. Secondary evaluations indicated that the unit was cumbersome and prohibitive for some participants because of difficulties with transport in and out of a vehicle and battery life. Most participants felt that power assist wheels provided more independence and social opportunities. The power assist wheel seems to offer physical and social benefits for most wheelers. Clinicians should consider users' home environment and overall life circumstances before prescribing.

Audiovisual quality estimation of mobile phone video cameras with interpretation-based quality approach

NASA Astrophysics Data System (ADS)

Radun, Jenni E.; Virtanen, Toni; Olives, Jean-Luc; Vaahteranoksa, Mikko; Vuori, Tero; Nyman, Göte

2007-01-01

We present an effective method for comparing subjective audiovisual quality and the features related to the quality changes of different video cameras. Both quantitative estimation of overall quality and qualitative description of critical quality features are achieved by the method. The aim was to combine two image quality evaluation methods, the quantitative Absolute Category Rating (ACR) method with hidden reference removal and the qualitative Interpretation- Based Quality (IBQ) method in order to see how they complement each other in audiovisual quality estimation tasks. 26 observers estimated the audiovisual quality of six different cameras, mainly mobile phone video cameras. In order to achieve an efficient subjective estimation of audiovisual quality, only two contents with different quality requirements were recorded with each camera. The results show that the subjectively important quality features were more related to the overall estimations of cameras' visual video quality than to the features related to sound. The data demonstrated two significant quality dimensions related to visual quality: darkness and sharpness. We conclude that the qualitative methodology can complement quantitative quality estimations also with audiovisual material. The IBQ approach is valuable especially, when the induced quality changes are multidimensional.

Qualitative and quantitative comparison of brand name and generic protein pharmaceuticals using isotope tags for relative and absolute quantification and matrix-assisted laser desorption/ionization tandem time-of-flight mass spectrometry.

PubMed

Ye, Hongping; Hill, John; Kauffman, John; Han, Xianlin

2010-05-01

The capability of iTRAQ (isotope tags for relative and absolute quantification) reagents coupled with matrix-assisted laser desorption/ionization tandem time-of-flight mass spectrometry (MALDI-TOF/TOF-MS) as a qualitative and quantitative technique for the analysis of complicated protein pharmaceutical mixtures was evaluated. Mixtures of Somavert and Miacalcin with a small amount of bovine serum albumin (BSA) as an impurity were analyzed. Both Somavert and Miacalcin were qualitatively identified, and BSA was detected at levels as low as 0.8mol%. Genotropin and Somavert were compared in a single experiment, and all of the distinct amino acid residues from the two proteins were readily identified. Four somatropin drug products (Genotropin, Norditropin, Jintropin, and Omnitrope) were compared using the iTRAQ/MALDI-MS method to determine the similarity between their primary structures and quantify the amount of protein in each product. All four product samples were well labeled and successfully compared when a filtration cleanup step preceded iTRAQ labeling. The quantitative accuracy of the iTRAQ method was evaluated. In all cases, the accuracy of experimentally determined protein ratios was higher than 90%, and the relative standard deviation (RSD) was less than 10%. The iTRAQ and global internal standard technology (GIST) methods were compared, and the iTRAQ method provided both higher sequence coverage and enhanced signal intensity. Published by Elsevier Inc.

Methods to estimate the transfer of contaminants into recycling products - A case study from Austria.

PubMed

Knapp, Julika; Allesch, Astrid; Müller, Wolfgang; Bockreis, Anke

2017-11-01

Recycling of waste materials is desirable to reduce the consumption of limited primary resources, but also includes the risk of recycling unwanted, hazardous substances. In Austria, the legal framework demands secondary products must not present a higher risk than comparable products derived from primary resources. However, the act provides no definition on how to assess this risk potential. This paper describes the development of different quantitative and qualitative methods to estimate the transfer of contaminants in recycling processes. The quantitative methods comprise the comparison of concentrations of harmful substances in recycling products to corresponding primary products and to existing limit values. The developed evaluation matrix, which considers further aspects, allows for the assessment of the qualitative risk potential. The results show that, depending on the assessed waste fraction, particular contaminants can be critical. Their concentrations were higher than in comparable primary materials and did not comply with existing limit values. On the other hand, the results show that a long-term, well-established quality control system can assure compliance with the limit values. The results of the qualitative assessment obtained with the evaluation matrix support the results of the quantitative assessment. Therefore, the evaluation matrix can be suitable to quickly screen waste streams used for recycling to estimate their potential environmental and health risks. To prevent the transfer of contaminants into product cycles, improved data of relevant substances in secondary resources are necessary. In addition, regulations for material recycling are required to assure adequate quality control measures, including limit values. Copyright © 2017 Elsevier Ltd. All rights reserved.

A quantitative and qualitative evaluation of trainee opinions of four methods of personality disorder diagnosis.

PubMed

Nelson, Sharon M; Huprich, Steven K; Shankar, Sneha; Sohnleitner, Aimee; Paggeot, Amy V

2017-07-01

Four methods of how to assess and diagnose personality disorders have received much attention within the literature: the Shedler-Westen Assessment Procedure (Shedler & Westen, 1998), the DSM-5 Section III Personality Disorders section (APA, 2011), the DSM-5 Section III trait model (APA, 2013), and the Psychodynamic Diagnostic Manual (PDM; PDM Task Force, 2006) descriptions of 15 personality disorders. Given that much of the debate has been driven by clinician concerns, it is important to consider clinical utility when evaluating the usefulness of each method. The present study compares the 4 models on ratings of several dimensions of clinical utility provided by 329 graduate student clinicians and psychology interns from across the United States. Findings suggest that participants rated the DSM-5 trait model significantly higher in most clinical utility domains. Additionally, qualitative analyses of the open-ended responses provided by participants indicated that each method had strengths and weaknesses. Most notably, participants commented positively on the PDM's level of comprehensiveness and appreciated the SWAP-II's inclusion of a health category, despite the ease of use not being as highly rated for these methods. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Evaluation methodology for comparing memory and communication of analytic processes in visual analytics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ragan, Eric D; Goodall, John R

2014-01-01

Provenance tools can help capture and represent the history of analytic processes. In addition to supporting analytic performance, provenance tools can be used to support memory of the process and communication of the steps to others. Objective evaluation methods are needed to evaluate how well provenance tools support analyst s memory and communication of analytic processes. In this paper, we present several methods for the evaluation of process memory, and we discuss the advantages and limitations of each. We discuss methods for determining a baseline process for comparison, and we describe various methods that can be used to elicit processmore » recall, step ordering, and time estimations. Additionally, we discuss methods for conducting quantitative and qualitative analyses of process memory. By organizing possible memory evaluation methods and providing a meta-analysis of the potential benefits and drawbacks of different approaches, this paper can inform study design and encourage objective evaluation of process memory and communication.« less

Barriers and facilitators to physical activity in people with hip or knee osteoarthritis: protocol for a systematic review of qualitative evidence

PubMed Central

Kanavaki, Archontissa M; Rushton, Alison; Klocke, Rainer; Abhishek, Abhishek; Duda, Joan L

2016-01-01

Introduction This protocol aims to describe the objective and methods to be followed in a systematic review of qualitative studies on barriers and facilitators to physical activity (PA) in people with hip or knee osteoarthritis (OA). Methods and analysis MEDLINE, EMBASE, PhychINFO, Web of Science, CINAHL, SPORTDiscus, Scopus and grey literature sources will be electronically searched. Hand search of qualitative research-centred journals, reference screening of relevant reviews and inquiries to researchers active in the field will complement the search. Studies will be selected if they apply qualitative or mixed-methods designs to directly explore factors that correspond to engagement in PA/exercise or, the perceptions regarding PA/exercise in people with hip or knee OA. The Critical Appraisal Skills Programme Qualitative Checklist and the evaluative criteria of credibility, transferability, dependability and confirmability will be applied for the study appraisal. 2 independent reviewers will perform the search, study selection and study appraisal. Thematic synthesis will be used for synthesising the findings of the primary studies and the process and product of the synthesis will be checked by a second researcher. ConQual approach will be used for assessing the confidence in the qualitative findings. Ethics and dissemination This systematic review will inform our understanding of the PA determinants and how to optimise behaviour change in people living with hip or knee OA. The review findings will be reported in a peer-reviewed journal and presented at national or international conferences. The study raises no ethical issues. Trial registration number CRD42016030024. PMID:27810971

Advancing student nurse knowledge of the biomedical sciences: A mixed methods study.

PubMed

Craft, Judy; Christensen, Martin; Bakon, Shannon; Wirihana, Lisa

2017-01-01

Nursing students' ability to learn, integrate and apply bioscience knowledge to their clinical practice remains a concern. To evaluate the implementation, influence, and student perspective of a team-teaching workshop to integrate bioscience theory with clinical nursing practice. The team-teaching workshop was offered prior to commencement of the university semester as a refresher course at an Australian university. This study employed a sequential explanatory mixed methods design incorporating both quantitative and qualitative items. An evaluation survey with quantitative and qualitative items and a focus group were employed. The qualitative data were analysed using a thematic approach. The quantitative data was combined with the emergent themes in the qualitative data. Participants were final year nursing students. Nine students attended the workshop. All students completed the evaluation (N=9) and 44.4% (N=4) attended the focus group. The results revealed six themes: (1) lectures are an inadequate teaching strategy for bioscience; (2) teaching strategies which incorporate active learning engage students; (3) the team-teaching workshop provides an effective learning environment; (4) the workshop content should be expanded; (5) pharmacology should relate to bioscience, and bioscience should relate to nursing; and (6) team-teaching was effective in integrating pharmacology with bioscience, and then translating this into nursing practice. Students had felt there was disjointedness between pharmacology and bioscience, and between bioscience and nursing care within their undergraduate studies. The workshop that was based on team-teaching bridged those gaps, utilised active learning strategies and provided an effective learning environment. Team-teaching that employs active learning strategies is an effective approach to assist nursing students to integrate bioscience knowledge into their nursing practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

The SCHEIE Visual Field Grading System

PubMed Central

Sankar, Prithvi S.; O’Keefe, Laura; Choi, Daniel; Salowe, Rebecca; Miller-Ellis, Eydie; Lehman, Amanda; Addis, Victoria; Ramakrishnan, Meera; Natesh, Vikas; Whitehead, Gideon; Khachatryan, Naira; O’Brien, Joan

2017-01-01

Objective No method of grading visual field (VF) defects has been widely accepted throughout the glaucoma community. The SCHEIE (Systematic Classification of Humphrey visual fields-Easy Interpretation and Evaluation) grading system for glaucomatous visual fields was created to convey qualitative and quantitative information regarding visual field defects in an objective, reproducible, and easily applicable manner for research purposes. Methods The SCHEIE grading system is composed of a qualitative and quantitative score. The qualitative score consists of designation in one or more of the following categories: normal, central scotoma, paracentral scotoma, paracentral crescent, temporal quadrant, nasal quadrant, peripheral arcuate defect, expansive arcuate, or altitudinal defect. The quantitative component incorporates the Humphrey visual field index (VFI), location of visual defects for superior and inferior hemifields, and blind spot involvement. Accuracy and speed at grading using the qualitative and quantitative components was calculated for non-physician graders. Results Graders had a median accuracy of 96.67% for their qualitative scores and a median accuracy of 98.75% for their quantitative scores. Graders took a mean of 56 seconds per visual field to assign a qualitative score and 20 seconds per visual field to assign a quantitative score. Conclusion The SCHEIE grading system is a reproducible tool that combines qualitative and quantitative measurements to grade glaucomatous visual field defects. The system aims to standardize clinical staging and to make specific visual field defects more easily identifiable. Specific patterns of visual field loss may also be associated with genetic variants in future genetic analysis. PMID:28932621

Methods for collecting algal samples as part of the National Water-Quality Assessment Program

USGS Publications Warehouse

Porter, Stephen D.; Cuffney, Thomas F.; Gurtz, Martin E.; Meador, Michael R.

1993-01-01

Benthic algae (periphyton) and phytoplankton communities are characterized in the U.S. Geological Survey's National Water-Quality Assessment Program as part of an integrated physical, chemical, and biological assessment of the Nation's water quality. This multidisciplinary approach provides multiple lines of evidence for evaluating water-quality status and trends, and for refining an understanding of the factors that affect water-quality conditions locally, regionally, and nationally. Water quality can be characterized by evaluating the results of qualitative and quantitative measurements of the algal community. Qualitative periphyton samples are collected to develop of list of taxa present in the sampling reach. Quantitative periphyton samples are collected to measure algal community structure within selected habitats. These samples of benthic algal communities are collected from natural substrates, using the sampling methods that are most appropriate for the habitat conditions. Phytoplankton samples may be collected in large nonwadeable streams and rivers to meet specific program objectives. Estimates of algal biomass (chlorophyll content and ash-free dry mass) also are optional measures that may be useful for interpreting water-quality conditions. A nationally consistent approach provides guidance on site, reach, and habitat selection, as well as information on methods and equipment for qualitative and quantitative sampling. Appropriate quality-assurance and quality-control guidelines are used to maximize the ability to analyze data locally, regionally, and nationally.

Developing medical educators – a mixed method evaluation of a teaching education program

PubMed Central

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) ‘Reaction’ on a professional and emotional level using standardized questionnaires; 2) ‘Learning’ applying a multiple choice test; 3) ‘Behavior’ by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) ‘Results’ from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (P<0.001) as deduced from a pre-post multiple-choice questionnaire, which was retained at 6 months (P<0.001). 3) Behavior: Peer-, self-, and expert-assessment indicated a transfer of learning into teaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students’ evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings. PMID:24679671

The Multilevel Mixed Intact Group Analysis: A Mixed Method to Seek, Detect, Describe, and Explain Differences Among Intact Groups

ERIC Educational Resources Information Center

Schoonenboom, Judith

2016-01-01

Educational innovations often involve intact subgroups, such as school classes or university departments. In small-scale educational evaluation research, typically involving 1 to 20 subgroups, differences among these subgroups are often neglected. This article presents a mixed method from a qualitative perspective, in which differences among…

Examination of Social Studies Curriculum and Course Books in the Context of Global Citizenship

ERIC Educational Resources Information Center

Karakus, Mehmet; Türkkan, Buket Turhan; Öztürk, Fikriye

2017-01-01

The document review method, which is a qualitative research method, was used in this study that aims to examine the social studies curriculum and course books in terms of attainments, teaching-learning process and measurement-evaluation process in the context of global citizenship. Furthermore, opinions of social studies teachers on the curriculum…

Legal Outcomes of Sexually Abused Children Evaluated at the Philippine General Hospital Child Protection Unit

ERIC Educational Resources Information Center

Sugue-Castillo, Mariella

2009-01-01

Objectives: To describe the legal outcomes and factors associated with case reaching court and conviction for sexual abuse of children seen at the Philippine General Hospital Child Protection Unit (PGH-CPU) from 1997 to 2000. Methods: Mixed transdisciplinary research design combined longitudinal cohort with qualitative methods. Data were obtained…

An Examination of Rater Performance on a Local Oral English Proficiency Test: A Mixed-Methods Approach

ERIC Educational Resources Information Center

Yan, Xun

2014-01-01

This paper reports on a mixed-methods approach to evaluate rater performance on a local oral English proficiency test. Three types of reliability estimates were reported to examine rater performance from different perspectives. Quantitative results were also triangulated with qualitative rater comments to arrive at a more representative picture of…

Non-destructive and fast identification of cotton-polyester blend fabrics by the portable near-infrared spectrometer.

PubMed

Li, Wen-xia; Li, Feng; Zhao, Guo-liang; Tang, Shi-jun; Liu, Xiao-ying

2014-12-01

A series of 376 cotton-polyester (PET) blend fabrics were studied by a portable near-infrared (NIR) spectrometer. A NIR semi-quantitative-qualitative calibration model was established by Partial Least Squares (PLS) method combined with qualitative identification coefficient. In this process, PLS method in a quantitative analysis was used as a correction method, and the qualitative identification coefficient was set by the content of cotton and polyester in blend fabrics. Cotton-polyester blend fabrics were identified qualitatively by the model and their relative contents were obtained quantitatively, the model can be used for semi-quantitative identification analysis. In the course of establishing the model, the noise and baseline drift of the spectra were eliminated by Savitzky-Golay(S-G) derivative. The influence of waveband selection and different pre-processing method was also studied in the qualitative calibration model. The major absorption bands of 100% cotton samples were in the 1400~1600 nm region, and the one for 100% polyester were around 1600~1800 nm, the absorption intensity was enhancing with the content increasing of cotton or polyester. Therefore, the cotton-polyester's major absorption region was selected as the base waveband, the optimal waveband (1100~2500 nm) was found by expanding the waveband in two directions (the correlation coefficient was 0.6, and wave-point number was 934). The validation samples were predicted by the calibration model, the results showed that the model evaluation parameters was optimum in the 1100~2500 nm region, and the combination of S-G derivative, multiplicative scatter correction (MSC) and mean centering was used as the pre-processing method. RC (relational coefficient of calibration) value was 0.978, RP (relational coefficient of prediction) value was 0.940, SEC (standard error of calibration) value was 1.264, SEP (standard error of prediction) value was 1.590, and the sample's recognition accuracy was up to 93.4%. It showed that the cotton-polyester blend fabrics could be predicted by the semi-quantitative-qualitative calibration model.

Mixed methods for telehealth research.

PubMed

Caffery, Liam J; Martin-Khan, Melinda; Wade, Victoria

2017-10-01

Mixed methods research is important to health services research because the integrated qualitative and quantitative investigation can give a more comprehensive understanding of complex interventions such as telehealth than can a single-method study. Further, mixed methods research is applicable to translational research and program evaluation. Study designs relevant to telehealth research are described and supported by examples. Quality assessment tools, frameworks to assist in the reporting and review of mixed methods research, and related methodologies are also discussed.

Identifying Obstacles and Research Gaps of Telemedicine Projects: Approach for a State-of-the-Art Analysis.

PubMed

Harst, Lorenz; Timpel, Patrick; Otto, Lena; Wollschlaeger, Bastian; Richter, Peggy; Schlieter, Hannes

2018-01-01

This paper presents an approach for an evaluation of finished telemedicine projects using qualitative methods. Telemedicine applications are said to improve the performance of health care systems. While there are countless telemedicine projects, the vast majority never makes the threshold from testing to implementation and diffusion. Projects were collected from German project databases in the area of telemedicine following systematically developed criteria. In a testing phase, ten projects were subject to a qualitative content analysis to identify limitations, need for further research, and lessons learned. Using Mayring's method of inductive category development, six categories of possible future research were derived. Thus, the proposed method is an important contribution to diffusion and translation research regarding telemedicine, as it is applicable to a systematic research of databases.

Design of a study evaluating the effects, health economics, and stakeholder perspectives of a multi-component occupational rehabilitation program with an added workplace intervention - a  study protocol.

PubMed

Rise, Marit B; Skagseth, Martin; Klevanger, Nina E; Aasdahl, Lene; Borchgrevink, Petter; Jensen, Chris; Tenggren, Hanne; Halsteinli, Vidar; Jacobsen, Trym N; Løland, Svein B; Johnsen, Roar; Fimland, Marius S

2018-02-05

Recent research has suggested that interventions at the workplace might be the most potent ingredient in return to work interventions, but few studies have investigated the different effects of workplace interventions as part of occupational rehabilitation programs. The comprehensive design described in this article includes effect (on return to work and health outcomes), and health economic evaluations of a workplace intervention added to a multicomponent rehabilitation program. Qualitative and mixed method studies will investigate sick-listed persons', rehabilitation therapists' and employers' perspectives on the usability and outcomes of the rehabilitation program and the workplace intervention. The program and intervention are provided to patients with musculoskeletal, psychological or general and unspecified diagnoses. The program is multi-component and includes Acceptance and Commitment Therapy, physical exercise, patient education and creating a plan for increased work participation. Persons who are employed, aged from 18 to 60 years, with a current sick leave status of 50% or more and a diagnosis within the musculoskeletal, psychological or general and unspecified chapters of International Classification of Primary Care-2 (ICPC-2) will be recruited to a researcher-blinded parallel-group randomized controlled trial. All participants take part in an in-patient occupational rehabilitation program, while the intervention group also takes part in an intervention at the workplace. The effect and economic evaluation will investigate the effect of the added workplace intervention. The primary outcome measures will be time until full sustainable return to work and total number of sickness absence days in the 12 months after inclusion. Health economic evaluations will investigate the cost-effectiveness and cost-utility. Qualitative studies will investigate rehabilitation therapists' experiences with working towards return to work within an ACT-approach and stakeholders' experiences with the workplace intervention. A mixed methods study will combine quantitative and qualitative findings on the participants' expectations and motivation for return to work. The outline of this comprehensive study could represent an important addition to the standard designs of return to work evaluation. The mixed methods design, with qualitative approaches as well as a rigorous randomized controlled trial, might prove useful to shed light on contextual factors. ClinicalTrials.gov : NCT02541890 . September 4, 2015.

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review. PMID:17325406

Cochrane Qualitative and Implementation Methods Group guidance series-paper 4: methods for assessing evidence on intervention implementation.

PubMed

Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Booth, Andrew; Harden, Angela; Hannes, Karin; Thomas, James; Flemming, Kate; Garside, Ruth; Noyes, Jane

2018-05-01

This article provides reviewers with guidance on methods for identifying and processing evidence to understand intervention implementation. Strategies, tools, and methods are applied to the systematic review process to illustrate how process and implementation can be addressed using quantitative, qualitative, and other sources of evidence (i.e., descriptive textual and nonempirical). Reviewers can take steps to navigate the heterogeneity and level of uncertainty present in the concepts, measures, and methods used to assess implementation. Activities can be undertaken in advance of a Cochrane quantitative review to develop program theory and logic models that situate implementation in the causal chain. Four search strategies are offered to retrieve process and implementation evidence. Recommendations are made for addressing rigor or risk of bias in process evaluation or implementation evidence. Strategies are recommended for locating and extracting data from primary studies. The basic logic is presented to assist reviewers to make initial review-level judgments about implementation failure and theory failure. Although strategies, tools, and methods can assist reviewers to address process and implementation using quantitative, qualitative, and other forms of evidence, few exemplar reviews exist. There is a need for further methodological development and trialing of proposed approaches. Copyright © 2017 Elsevier Inc. All rights reserved.

Conducting Configurational Comparative Research with Qualitative Comparative Analysis: A Hands-On Tutorial for Applied Evaluation Scholars and Practitioners

ERIC Educational Resources Information Center

Thiem, Alrik

2017-01-01

The search for necessary and sufficient causes of some outcome of interest, referred to as "configurational comparative research," has long been one of the main preoccupations of evaluation scholars and practitioners. However, only the last three decades have witnessed the evolution of a set of formal methods that are sufficiently…

Evaluation Criteria for Interactive E-Books for Open and Distance Learning

ERIC Educational Resources Information Center

Bozkurt, Aras; Bozkaya, Mujgan

2015-01-01

The aim of this mixed method study is to identify evaluation criteria for interactive e-books. To find answers for the research questions of the study, both quantitative and qualitative data were collected through a four-round Delphi study with a panel consisting of 30 experts. After that, a total of 20 interactive e-books were examined with…

Evaluation of the Course of the Flight Simulators from the Perspective of Students and University Teachers

ERIC Educational Resources Information Center

Kaysi, Feyzi; Bavli, Bünyamin; Gürol, Aysun

2016-01-01

The study evaluates the flight simulators course which was opened to fulfill the intermediate staff need of the sector. To collect data, Qualitative techniques were applied. Within this scope, the case study method was employed in the study. The study group consisted of students and instructors. In-depth and focus group interviews were conducted…

"Something to Smile About": An Evaluation of a Capacity-Building Oral Health Intervention for Staff Working with Homeless People

ERIC Educational Resources Information Center

Coles, Emma; Watt, Celia; Freeman, Ruth

2013-01-01

Objective: To use a qualitative exploration to evaluate whether "Something to Smile About" (STSA), an oral health intervention, had increased the oral health capacity of staff working with homeless people. Setting: A National Health Service board area in Scotland. Method: A purposive sample of 14 staff members from STSA-participating…

Elementary Teachers' Views on the Creative Writing Process: An Evaluation

ERIC Educational Resources Information Center

Akkaya, Nevin

2014-01-01

The goal of this study is to discover and evaluate both the areas of personal interest and the views of 4th and 5th grade classroom teachers regarding the creative writing process. In this study, one of the qualitative study methods, state study, and related to this, single state design which refers to the whole has been chosen. Research was…

What Do We Expect of School Principals? Congruence between Principal Evaluation and Performance Standards

ERIC Educational Resources Information Center

Catano, Nancy; Stronge, James H.

2007-01-01

This study used both quantitative and qualitative methods of content analysis to examine principal evaluation instruments and state and professional standards for principals in school districts located in a mid-Atlantic state in the USA. The purposes of this study were to (a) determine the degrees of emphasis that are placed upon leadership and…

Design, Development, and Formative Evaluation of a Smartphone Application for Recording and Monitoring Physical Activity Levels: The 10,000 Steps "iStepLog"

ERIC Educational Resources Information Center

Kirwan, Morwenna; Duncan, Mitch J.; Vandelanotte, Corneel; Mummery, W. Kerry

2013-01-01

Objectives: Limited research exists addressing the development of health-related smartphone apps, a new and potentially effective health promotion delivery strategy. This article describes the development and formative evaluation of a smartphone app associated with a physical activity promotion website. Methods: A combination of qualitative and…

77 FR 6471 - Bacillus thuringiensis Cry2Ae Protein in Cotton; Exemption from the Requirement of a Tolerance

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-08

... analytical method using enzyme- linked immunosorbent assay (ELISA) analyses for the qualitative detection of... study conducted by an independent third party laboratory to evaluate the ELISA test kit's performance as...

Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study

PubMed Central

O'Cathain, Alicia; Murphy, Elizabeth; Nicholl, Jon

2007-01-01

Background Recently, there has been a surge of international interest in combining qualitative and quantitative methods in a single study – often called mixed methods research. It is timely to consider why and how mixed methods research is used in health services research (HSR). Methods Documentary analysis of proposals and reports of 75 mixed methods studies funded by a research commissioner of HSR in England between 1994 and 2004. Face-to-face semi-structured interviews with 20 researchers sampled from these studies. Results 18% (119/647) of HSR studies were classified as mixed methods research. In the documentation, comprehensiveness was the main driver for using mixed methods research, with researchers wanting to address a wider range of questions than quantitative methods alone would allow. Interviewees elaborated on this, identifying the need for qualitative research to engage with the complexity of health, health care interventions, and the environment in which studies took place. Motivations for adopting a mixed methods approach were not always based on the intrinsic value of mixed methods research for addressing the research question; they could be strategic, for example, to obtain funding. Mixed methods research was used in the context of evaluation, including randomised and non-randomised designs; survey and fieldwork exploratory studies; and instrument development. Studies drew on a limited number of methods – particularly surveys and individual interviews – but used methods in a wide range of roles. Conclusion Mixed methods research is common in HSR in the UK. Its use is driven by pragmatism rather than principle, motivated by the perceived deficit of quantitative methods alone to address the complexity of research in health care, as well as other more strategic gains. Methods are combined in a range of contexts, yet the emerging methodological contributions from HSR to the field of mixed methods research are currently limited to the single context of combining qualitative methods and randomised controlled trials. Health services researchers could further contribute to the development of mixed methods research in the contexts of instrument development, survey and fieldwork, and non-randomised evaluations. PMID:17570838

Evaluating the long-term impact of the Trauma Team Training course in Guyana: an explanatory mixed-methods approach.

PubMed

Pemberton, Julia; Rambaran, Madan; Cameron, Brian H

2013-02-01

We evaluated the retention of trauma knowledge and skills after an interprofessional Trauma Team Training (TTT) course in Guyana and explored the course impact on participants. A mixed-methods design evaluated knowledge using a multiple-choice quiz test, skills and trauma moulage simulation with checklists, and course impact with qualitative interviews. Participants were evaluated at 3 time points; before, after, and 4 months after TTT. Forty-seven course participants included 20 physicians, 17 nurses, and 10 paramedical providers. All participants had improved multiple-choice quiz test scores after the course and retained knowledge after 4 months, with nonphysicians showing the most improved scores. Trauma skill and moulage scores declined slightly after 4 months, with the greatest decline observed in complex skills. Qualitatively, course participants self-reported impact of the TTT course included improved empowerment, knowledge, teamwork, and patient care. Interprofessional team-based training led to the retention of trauma knowledge and skills as well as the empowerment of nonphysicians. The decline in performance of some trauma skills indicates the need for a regular trauma update course. Copyright © 2013 Elsevier Inc. All rights reserved.

Cleanliness Policy Implementation: Evaluating Retribution Model to Rise Public Satisfaction

NASA Astrophysics Data System (ADS)

Dailiati, Surya; Hernimawati; Prihati; Chintia Utami, Bunga

2018-05-01

This research is based on the principal issues concerning the evaluation of cleanliness retribution policy which has not been optimally be able to improve the Local Revenue of Pekanbaru City and has not improved the cleanliness of Pekanbaru City. It was estimated to be caused by the performance of Garden and Sanitation Department are not in accordance with the requirement of society of Pekanbaru City. The research method used in this study is a mixed method with sequential exploratory strategy. The data collection used are observation, interview and documentation for qualitative research as well as questionnaires for quantitative research. The collected data were analyzed with interactive model of Miles and Huberman for qualitative research and multiple regression analysis for quantitative research. The research result indicated that the model of cleanliness policy implementation that can increase of PAD Pekanbaru City and be able to improve people’s satisfaction divided into two (2) which are the evaluation model and the society satisfaction model. The evaluation model influence by criteria/variable of effectiveness, efficiency, adequacy, equity, responsiveness, and appropriateness, while the society satisfaction model influence by variables of society satisfaction, intentions, goals, plans, programs, and appropriateness of cleanliness retribution collection policy.

Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory

PubMed Central

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-01-01

Objective To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. Data Sources and Design We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. Principle Findings We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Conclusions Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines. PMID:17286625

Qualitative data analysis for health services research: developing taxonomy, themes, and theory.

PubMed

Bradley, Elizabeth H; Curry, Leslie A; Devers, Kelly J

2007-08-01

To provide practical strategies for conducting and evaluating analyses of qualitative data applicable for health services researchers. DATA SOURCES AND DESIGN: We draw on extant qualitative methodological literature to describe practical approaches to qualitative data analysis. Approaches to data analysis vary by discipline and analytic tradition; however, we focus on qualitative data analysis that has as a goal the generation of taxonomy, themes, and theory germane to health services research. We describe an approach to qualitative data analysis that applies the principles of inductive reasoning while also employing predetermined code types to guide data analysis and interpretation. These code types (conceptual, relationship, perspective, participant characteristics, and setting codes) define a structure that is appropriate for generation of taxonomy, themes, and theory. Conceptual codes and subcodes facilitate the development of taxonomies. Relationship and perspective codes facilitate the development of themes and theory. Intersectional analyses with data coded for participant characteristics and setting codes can facilitate comparative analyses. Qualitative inquiry can improve the description and explanation of complex, real-world phenomena pertinent to health services research. Greater understanding of the processes of qualitative data analysis can be helpful for health services researchers as they use these methods themselves or collaborate with qualitative researchers from a wide range of disciplines.

Qualitative Parameters for Evaluation Procedures of Non-Formal and Informal Learning Achievements

ERIC Educational Resources Information Center

Stasiunaitiene, Egle; Kaminskiene, Lina

2009-01-01

The article introduces evaluation principles of non-formal and informal learning that determine the quality of evaluation, describes stages of the evaluation procedure, differentiates their qualitative parameters and defines their criteria and indicators. It also brings in the discussion that consideration of qualitative parameters for the…

Evaluation of a large scale implementation of disease management programmes in various Dutch regions: a study protocol

PubMed Central

2011-01-01

Background Disease management programmes (DMPs) have been developed to improve effectiveness and economic efficiency within chronic care delivery by combining patient-related, professional-directed, and organisational interventions. The benefits of DMPs within different settings, patient groups, and versions remain unclear. In this article we propose a protocol to evaluate a range of current DMPs by capturing them in a single conceptual framework, employing comparable structure, process, and outcome measures, and combining qualitative and quantitative research methods. Methods To assess DMP effectiveness a practical clinical trial will be conducted. Twenty-two disease management experiments will be studied in various Dutch regions consisting of a variety of collaborations between organisations and/or professionals. Patient cohorts include those with cardiovascular diseases, chronic obstructive pulmonary disease, diabetes, stroke, depression, psychotic diseases, and eating disorders. Our methodological approach combines qualitative and quantitative research methods to enable a comprehensive evaluation of complex programmes. Process indicators will be collected from health care providers' data registries and measured via physician and staff questionnaires. Patient questionnaires include health care experiences, health care utilisation, and quality of life. Qualitative data will be gathered by means of interviews and document analysis for an in depth description of project interventions and the contexts in which DMPs are embedded, and an ethnographic process evaluation in five DMPs. Such a design will provide insight into ongoing DMPs and demonstrate which elements of the intervention are potentially (cost)-effective for which patient populations. It will also enable sound comparison of the results of the different programmes. Discussion The study will lead to a better understanding of (1) the mechanisms of disease management, (2) the feasibility, and cost-effectiveness of a disease management approach to improving health care, and (3) the factors that determine success and failure of DMPs. Our study results will be relevant to decision makers and managers who confront the challenge of implementing and integrating DMPs into the health care system. Moreover, it will contribute to the search for methods to evaluate complex healthcare interventions. PMID:21219620

Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study.

PubMed

O'Cathain, Alicia; Murphy, Elizabeth; Nicholl, Jon

2007-06-14

Recently, there has been a surge of international interest in combining qualitative and quantitative methods in a single study--often called mixed methods research. It is timely to consider why and how mixed methods research is used in health services research (HSR). Documentary analysis of proposals and reports of 75 mixed methods studies funded by a research commissioner of HSR in England between 1994 and 2004. Face-to-face semi-structured interviews with 20 researchers sampled from these studies. 18% (119/647) of HSR studies were classified as mixed methods research. In the documentation, comprehensiveness was the main driver for using mixed methods research, with researchers wanting to address a wider range of questions than quantitative methods alone would allow. Interviewees elaborated on this, identifying the need for qualitative research to engage with the complexity of health, health care interventions, and the environment in which studies took place. Motivations for adopting a mixed methods approach were not always based on the intrinsic value of mixed methods research for addressing the research question; they could be strategic, for example, to obtain funding. Mixed methods research was used in the context of evaluation, including randomised and non-randomised designs; survey and fieldwork exploratory studies; and instrument development. Studies drew on a limited number of methods--particularly surveys and individual interviews--but used methods in a wide range of roles. Mixed methods research is common in HSR in the UK. Its use is driven by pragmatism rather than principle, motivated by the perceived deficit of quantitative methods alone to address the complexity of research in health care, as well as other more strategic gains. Methods are combined in a range of contexts, yet the emerging methodological contributions from HSR to the field of mixed methods research are currently limited to the single context of combining qualitative methods and randomised controlled trials. Health services researchers could further contribute to the development of mixed methods research in the contexts of instrument development, survey and fieldwork, and non-randomised evaluations.

Evaluation of vegetables in Tsukuba for contamination with radioactive materials from the accident at Fukushima Daiichi nuclear power plant.

PubMed

Isobe, Tomonori; Mori, Yutaro; Takada, Kenta; Sato, Eisuke; Takahashi, Hideki; Sekiguchi, Takao; Yoshimura, Yousuke; Sakurai, Hideyuki; Sakae, Takeji

2013-10-01

A large amount of radioactive material was released into the atmosphere after the accident of the Fukushima Daiichi Nuclear Power Plant following the Tohoku earthquake on 11 March 2011, and traces of these materials were detected in Tsukuba. Because radioactive materials can adhere to vegetables, the authors made a qualitative evaluation of vegetables in Tsukuba, estimated internal exposure dose based on quantitative measurement results, and investigated several decontamination methods. Qualitative analysis of vegetable contamination was done by autoradiography. Quantitative analysis was done using a high-purity germanium detector. To assess decontamination, two methods were tested: one with running water and the other with boiling water. In addition, boiled soup stock was measured. In the qualitative evaluation by autoradiography, radioactive materials were not uniformly distributed but adhered to vegetables in clumps and hot spots. In the quantitative evaluation to measure contamination of outer and inner leaves of sanchu lettuce, it was observed that the concentration of I was 8,031.35 ± 764.79 Bq kg in the outer leaves and 115.28 ± 20.63 Bq kg in the inner leaves. In addition, the concentration of Cs was 1,371.93 ± 366.45 Bq kg in the outer leaves and 9.68 ± 15.03 Bq kg in the inner leaves. This suggests that one can greatly reduce internal exposure dose by removing the outer leaves if one has to eat vegetables just after a nuclear accident. In the decontamination assessment, a decontamination efficiency of up to 70% was achieved by boiling vegetables for 20 min.

Academic Impact of Qualitative Studies in Healthcare: Bibliometric Analysis

PubMed Central

Mori, Hiroko; Nakayama, Takeo

2013-01-01

Context Although qualitative studies are becoming more appreciated in healthcare, the number of publications of quality studies remains low. Little is known about the frequency and characteristics of citation in qualitative studies. Objective To compare the academic impact of qualitative studies to that of two quantitative studies: systematic reviews and randomized controlled trials. Methods Publications in BMJ between 1997 and 2006 (BMJ’s median impact factor was 7.04 during this period) employing qualitative methods were matched to two quantitative studies appearing the same year using PubMed. Using Web of Science, citations within a 24-month publication period were determined. Additionally, three hypotheses were examined: qualitative studies are 1) infrequently cited in original articles or reviews; 2) rarely cited by authors in non-English-speaking countries; and 3) more frequently cited in non-medical disciplines (e.g., psychology or sociology). Results A total of 121 qualitative studies, 270 systematic reviews, and 515 randomised controlled trials were retrieved. Qualitative studies were cited a total of 1,089 times, with a median of 7.00 times (range, 0–34) for each study. Matched systematic reviews and randomized controlled trials were cited 2,411times and 1,600 times, respectively. With respect to citing documents, original articles and reviews exceeded 60% for each study design. Relative to quantitative studies, qualitative studies were cited more often by authors in English-speaking countries. With respect to subject area, medical disciplines were more frequently cited than non-medical disciplines for all three study designs (>80%). Conclusion The median number of citations for qualitative studies was almost the same as the median of BMJ’s impact factor during the survey period. For a suitable evaluation of qualitative studies in healthcare, it will be necessary to develop a reporting framework and include explicit discussions of clinical implications when reporting findings. Coordination between researchers and editors will be needed to achieve this goal. PMID:23516404

Promoting and evaluating scientific rigour in qualitative research.

PubMed

Baillie, Lesley

2015-07-15

This article explores perspectives on qualitative research and the variety of views concerning rigour in the research process. Evaluating and ensuring the quality of research are essential considerations for practitioners who are appraising evidence to inform their practice or research. Several criteria and principles for evaluating quality in qualitative research are presented, recognising that their application in practice is influenced by the qualitative methodology used. The article examines a range of techniques that a qualitative researcher can use to promote rigour and apply it to practice.

Qualitative and quantitative analysis of an alkaloid fraction from Piper longum L. using ultra-high performance liquid chromatography-diode array detector-electrospray ionization mass spectrometry.

PubMed

Li, Kuiyong; Fan, Yunpeng; Wang, Hui; Fu, Qing; Jin, Yu; Liang, Xinmiao

2015-05-10

In a previous research, an alkaloid fraction and 18 alkaloid compounds were prepared from Piper longum L. by series of purification process. In this paper, a qualitative and quantitative analysis method using ultra-high performance liquid chromatography-diode array detector-mass spectrometry (UHPLC-DAD-MS) was developed to evaluate the alkaloid fraction. Qualitative analysis of the alkaloid fraction was firstly completed by UHPLC-DAD method and 18 amide alkaloid compounds were identified. A further qualitative analysis of the alkaloid fraction was accomplished by UHPLC-MS/MS method. Another 25 amide alkaloids were identified according to their characteristic ions and neutral losses. At last, a quantitative method for the alkaloid fraction was established using four marker compounds including piperine, pipernonatine, guineensine and N-isobutyl-2E,4E-octadecadienamide. After the validation of this method, the contents of above four marker compounds in the alkaloid fraction were 57.5mg/g, 65.6mg/g, 17.7mg/g and 23.9mg/g, respectively. Moreover, the relative response factors of other three compounds to piperine were calculated. A comparative study between external standard quantification and relative response factor quantification proved no remarkable difference. UHPLC-DAD-MS method was demonstrated to be a powerful tool for the characterization of the alkaloid fraction from P. longum L. and the result proved that the quality of alkaloid fraction was efficiently improved after appropriate purification. Copyright © 2015. Published by Elsevier B.V.

Automatic identification of the reference system based on the fourth ventricular landmarks in T1-weighted MR images.

PubMed

Fu, Yili; Gao, Wenpeng; Chen, Xiaoguang; Zhu, Minwei; Shen, Weigao; Wang, Shuguo

2010-01-01

The reference system based on the fourth ventricular landmarks (including the fastigial point and ventricular floor plane) is used in medical image analysis of the brain stem. The objective of this study was to develop a rapid, robust, and accurate method for the automatic identification of this reference system on T1-weighted magnetic resonance images. The fully automated method developed in this study consisted of four stages: preprocessing of the data set, expectation-maximization algorithm-based extraction of the fourth ventricle in the region of interest, a coarse-to-fine strategy for identifying the fastigial point, and localization of the base point. The method was evaluated on 27 Brain Web data sets qualitatively and 18 Internet Brain Segmentation Repository data sets and 30 clinical scans quantitatively. The results of qualitative evaluation indicated that the method was robust to rotation, landmark variation, noise, and inhomogeneity. The results of quantitative evaluation indicated that the method was able to identify the reference system with an accuracy of 0.7 +/- 0.2 mm for the fastigial point and 1.1 +/- 0.3 mm for the base point. It took <6 seconds for the method to identify the related landmarks on a personal computer with an Intel Core 2 6300 processor and 2 GB of random-access memory. The proposed method for the automatic identification of the reference system based on the fourth ventricular landmarks was shown to be rapid, robust, and accurate. The method has potentially utility in image registration and computer-aided surgery.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example

PubMed Central

Mair, Frances S; Dowrick, Christopher; Brún, Mary O’Reilly-de; de Brún, Tomas; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; van den Muijsenbergh, Maria; van Weel-Baumgarten, Evelyn; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-01-01

Objectives To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Design Participatory research approach using qualitative methods. Setting Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. Participants RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Primary outcome measures Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Results Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE’s methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork. Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. Conclusion A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. PMID:28827231

Comparison between qualitative and real-time polymerase chain reaction to evaluate minimal residual disease in children with acute lymphoblastic leukemia.

PubMed

Paula, Francisco Danilo Ferreira; Elói-Santos, Silvana Maria; Xavier, Sandra Guerra; Ganazza, Mônica Aparecida; Jotta, Patricia Yoshioka; Yunes, José Andrés; Viana, Marcos Borato; Assumpção, Juliana Godoy

2015-01-01

Minimal residual disease is an important independent prognostic factor that can identify poor responders among patients with acute lymphoblastic leukemia. The aim of this study was to analyze minimal residual disease using immunoglobulin (Ig) and T-cell receptor (TCR) gene rearrangements by conventional polymerase chain reaction followed by homo-heteroduplex analysis and to compare this with real-time polymerase chain reaction at the end of the induction period in children with acute lymphoblastic leukemia. Seventy-four patients diagnosed with acute lymphoblastic leukemia were enrolled. Minimal residual disease was evaluated by qualitative polymerase chain reaction in 57 and by both tests in 44. The Kaplan-Meier and multivariate Cox methods and the log-rank test were used for statistical analysis. Nine patients (15.8%) were positive for minimal residual disease by qualitative polymerase chain reaction and 11 (25%) by real-time polymerase chain reaction considering a cut-off point of 1×10(-3) for precursor B-cell acute lymphoblastic leukemia and 1×10(-2) for T-cell acute lymphoblastic leukemia. Using the qualitative method, the 3.5-year leukemia-free survival was significantly higher in children negative for minimal residual disease compared to those with positive results (84.1%±5.6% versus 41.7%±17.3%, respectively; p-value=0.004). There was no significant association between leukemia-free survival and minimal residual disease by real-time polymerase chain reaction. Minimal residual disease by qualitative polymerase chain reaction was the only variable significantly correlated to leukemia-free survival. Given the difficulties in the implementation of minimal residual disease monitoring by real-time polymerase chain reaction in most treatment centers in Brazil, the qualitative polymerase chain reaction strategy may be a cost-effective alternative. Copyright © 2015 Associação Brasileira de Hematologia, Hemoterapia e Terapia Celular. Published by Elsevier Editora Ltda. All rights reserved.

[Development of non-invasive clinical examination methods for the anterior segment of the eye and their clinical significance].

PubMed

Sawa, Mitsuru

2011-03-01

1. Slit-lamp microscopy is a principal ophthalmic clinical method, because it provides microscopic findings of the anterior segment of the eye noninvasively. Its findings, however, are qualitative and there are large inter-observer variations in their evaluation. Furthermore, slit-lamp microscopy provides morphological findings, but a functional evaluation is difficult. We developed two novel methods that establish a qualitative methodology of the slit-lamp microscope and the pathophysiology of the anterior segment of the eye. One is the flare-cell photometer to evaluate flare and cells in the aqueous humor of the eye and the other is an immunohistochemical examination method using tear fluid to evaluate ocular surface disorders. The comprehensive evaluation of these studies is herein overviewed. 2. INNOVATION OF THE FLARE-CELL PHOTOMETER AND ITS CLINICAL SIGNIFICANCE: The breakdown of the blood-aqueous barrier (BAB) causes an increase in protein (flare) and leakage of blood cells (cell) into the aqueous humor of the eye and the severity of BAB breakdown has a positive correlation with the intensity of flare and cells. The flare and cells in the aqueous can be observed qualitatively by slit-lamp microscopy. These findings are primarily distinguished in optics by light scattering. Therefore, detection of the intensity of light scattering due to flare and cells can evaluate the BAB function. The flare-cell photometer comprises 3 novel components: a laser beam system as an incident light, a photomultiplier to detect scattered light intensity and a computer-assisted system to operate the whole system and analyze detected scattered light signals due to flare and cells. The instrument enables us to quantitatively analyze the flare and cells non-invasively and accurately with a wide dynamic measurement range, resulting in a repeated examination of each individual case. It also enables the evaluation of inflammation in the aqueous not only postoperatively but also in endogenous uveitis, evaluation of the effects of anti-inflammatory drugs on BAB and evaluation of aqueous humor dynamics. Furthermore, repeating the examination can minimize inter-individual variations and reduce the number of animals in animal experiments. 3. Sampling of tears can be performed noninvasively, but the obtainable volume is limited. Therefore, a determination of targeting biomarkers and a development of their micro-volume analysis methods play a crucial role in pathophysiological studies of the ocular surface. Targeting biomarkers should be determined according to the various specified bioactive substances such as eosinophil cationic protein (ECP), cytokines and others. A number of microvolume analysis methods, such as chemiluminescent enzyme immunoassay, immunochromatography, micro-array system and polymerase chain reaction method are used. Objective disorders in the studies include allergic conjunctivitis and infectious diseases such as herpetic keratitis. Quantitative evaluation methods for ECP concentration, antigen-specific secretory IgA in allergic diseases and herpetic keratitis, herpes simplex virus-DNA and cytokine and chemokine profile in tear fluid sampled by filter paper method were investigated. We developed a clinically applicable quantitative immunochemical method for ECP concentration in tear fluid. The results revealed that tear fluid analysis using the above mentioned methods is a clinically useful to investigate the pathophysiology of the ocular surface. 4. Laser flare-cell photometer and tear fluid analysis are potent clinical quantitative methods to investigate the pathophysiology of the anterior segment of the eye.

Proteus mirabilis biofilm - qualitative and quantitative colorimetric methods-based evaluation.

PubMed

Kwiecinska-Piróg, Joanna; Bogiel, Tomasz; Skowron, Krzysztof; Wieckowska, Ewa; Gospodarek, Eugenia

2014-01-01

Proteus mirabilis strains ability to form biofilm is a current topic of a number of research worldwide. In this study the biofilm formation of P. mirabilis strains derived from urine of the catheterized and non-catheterized patients has been investigated. A total number of 39 P. mirabilis strains isolated from the urine samples of the patients of dr Antoni Jurasz University Hospital No. 1 in Bydgoszcz clinics between 2011 and 2012 was used. Biofilm formation was evaluated using two independent quantitative and qualitative methods with TTC (2,3,5-triphenyl-tetrazolium chloride) and CV (crystal violet) application. The obtained results confirmed biofilm formation by all the examined strains, except quantitative method with TTC, in which 7.7% of the strains did not have this ability. It was shown that P. mirabilis rods have the ability to form biofilm on the surfaces of both biomaterials applied, polystyrene and polyvinyl chloride (Nelaton catheters). The differences in ability to form biofilm observed between P. mirabilis strains derived from the urine of the catheterized and non-catheterized patients were not statistically significant.

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Introduction Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Methods Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Results Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. Conclusions The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Evaluation of board performance in Iran's universities of medical sciences.

PubMed

Sajadi, Haniye Sadat; Maleki, Mohammadreza; Ravaghi, Hamid; Farzan, Homayoun; Aminlou, Hasan; Hadi, Mohammad

2014-10-01

The critical role that the board plays in governance of universities clarifies the necessity of evaluating its performance. This study was aimed to evaluate the performance of the boards of medical universities and provide solutions to enhance its performance. The first phase of present study was a qualitative research in which data were collected through face-to-face semi-structured interviews. Data were analyzed by thematic approach. The second phase was a mixed qualitative and quantitative study, with quantitative part in cross-sectional format and qualitative part in content analysis format. In the quantitative part, data were collected through Ministry of Health and Medical Education (MoHME). In the qualitative part, the content of 2,148 resolutions that were selected by using stratified sampling method were analyzed. Participants believed that the boards had no acceptable performance for a long time.RESULTS also indicated the increasing number of meetings and resolutions of the boards in these 21 years. The boards' resolutions were mostly operational in domain and administrative in nature. The share of specific resolutions was more than the general ones. Given the current pace of change and development and the need to timely respond them, it is recommended to accelerate the slow pace of improvement process of the boards. It appears that more delegation and strengthening the position of the boards are the effective strategies to speed up this process.

Assessment of cultural competence in Texas nursing faculty.

PubMed

Marzilli, Collen

2016-10-01

Cultural competence [CC] is an essential component of nursing education and nursing practice yet there is a gap in the research evaluating CC in faculty and how to practically develop this skillset for faculty members. To explore CC in faculty as evaluated with the Nurses' Cultural Competence Scale [NCCS] and apply the findings to the Purnell Model of Cultural Competence [PMCC] to guide professional development opportunities for faculty members. This was a concurrent mixed-methods study. Faculty members teaching in Texas nursing programs were recruited for the study. Quantitative data was collected using an online survey tool and qualitative data was collected over the phone. 89 Texas faculty members completed the quantitative strand and a subset of 10 faculty members completed the qualitative strand. Descriptive statistics were used to examine the quantitative data and Strauss and Corbin's methodology guided the evaluation of the qualitative data. These two strands were used to support the results. Faculty in Texas are moderately culturally competent. The qualitative findings support the application of the PMCC to the areas identified by the NCCS. The PMCC may be applied to the application of culture and values in nursing professional education as supported by the NCCS. Recommendations are to include the PMCC as a structure for the creation of professional development opportunities for faculty. Copyright © 2016 Elsevier Ltd. All rights reserved.

Multi-Laboratory Validation of Estrone (E1) ELISA Methods

EPA Science Inventory

This project is a round-robin evaluation of commercially available Enzyme-Linked Immunosorbent Assay (ELISA) technology to quantitatively or qualitatively measure the hormone estrone (E1) in combined animal feeding operation (CAFO) receiving streams. ELISA is meant to be a simpl...

Program Performance Inventory: Six Juvenile Offender Programs.

ERIC Educational Resources Information Center

Thomalla, Terri Groff; Dougherty, Victoria J.

This report describes the performance of 6 Connecticut juvenile justice alternative sanction programs in 14 qualitative areas: community reintegration; outcomes and evaluation; assessment methods; risk factors; escalation of criminal activity; family involvement; community involvement; work ethic and vocational training; education and life skills;…

Living Lab as an Agile Approach in Developing User-Friendly Welfare Technology.

PubMed

Holappa, Niina; Sirkka, Andrew

2017-01-01

This paper discusses living lab as a method of developing user-friendly welfare technology, and presents a qualitative evaluation research of how living lab tested technologies impacted on the life of healthcare customers and professionals over test periods.

[Qualitative research in health services research - discussion paper, Part 1: What is the idea?].

PubMed

Meyer, T; Karbach, U; Holmberg, C; Güthlin, C; Patzelt, C; Stamer, M

2012-08-01

In this first part of a 3-part discussion paper the working group "Qualitative Methods" in the German Network of Health Services Research (DNVF) identifies the potentials and opportunities qualitative research methods provide for health services research. Many research questions relevant for health services research require the use of qualitative methods. However, the potential of and need for qualitative research in health services research has not yet received sufficient attention from funding bodies. We discuss the applicability and importance of qualitative research for the field of health services research. We then move on to describe the key characteristics of qualitative research that need to be taken into account in health services research. We discuss characteristics such as open-ended (qualitative) data, interpretation of meanings, the search for contradictions, closeness to everyday life, openness towards change or modification of the research question and processes in the context of health services research. To ensure a high-quality approach in qualitative methods for the health services research, sufficient competency in methods and appropriate settings that account for the peculiarities of qualitative methods need to be developed. These include an appropriate time frame and sufficient and qualified personnel to conduct qualitative research. Qualitative research is not a research paradigm in itself rather it comprises of many different and diverging approaches. The goal of this paper is to show the diversity of qualitative research methods, its importance for health services research, and to open up the discussion on strategies for integrating qualitative methods into health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Ambivalence and Fluidity in the Teenage Smoking and Quitting Experience: Lessons from a Qualitative Study at an English Secondary School

ERIC Educational Resources Information Center

Buswell, Marina; Duncan, Peter

2013-01-01

Objective: To evaluate a school-based stop smoking pilot project and to understand the teenage experience of smoking and quitting within that context. Design: Flexible design methods. Setting: A Kent (United Kingdom [UK]) secondary school. Methods: Semi-structured interviews analyzed following a grounded theory approach. Results: The main themes…

Enzymatic browning reactions in apple and apple products.

PubMed

Nicolas, J J; Richard-Forget, F C; Goupy, P M; Amiot, M J; Aubert, S Y

1994-01-01

This review examines the parameters of enzymatic browning in apple and apple products that is, phenolic compounds, polyphenoloxidases, and other factors (ascorbic acid and peroxidases), both qualitatively and quantitatively. Then the relationships between intensity of browning and the browning parameters are discussed, including a paragraph on the methods used for browning evaluation. Finally, the different methods for the control of browning are presented.

Evaluation of the Distance Education Pre-Service Teachers' Opinions about Teaching Practice Course (Case of Izmir City)

ERIC Educational Resources Information Center

Guven, Meral; Kurum, Dilruba; Saglam, Mustafa

2012-01-01

The aim of this study was to determine the distance education pre-service teachers' opinions about the teaching practice course. The study was conducted with descriptive method. For data collection, analysis and interpretation, qualitative research method was used. Out of the students enrolled at Open Education Faculty, Department of Pre-school…

"We Are like Dictionaries, Miss, You Can Look Things up in Us": Evaluating Child-Centred Research Methods

ERIC Educational Resources Information Center

Elton-Chalcraft, Sally

2011-01-01

Research concerning children is often presented with only a brief comment on the research methods adopted. This paper takes a "behind the scenes" view and I discuss my adoption of a non-hierarchical "least adult role" adapted from Mandell's work in 1991 to undertake qualitative research in the sensitive area of children's…

Techniques and Methods for Testing the Postural Function in Healthy and Pathological Subjects

PubMed Central

Paillard, Thierry; Noé, Frédéric

2015-01-01

The different techniques and methods employed as well as the different quantitative and qualitative variables measured in order to objectify postural control are often chosen without taking into account the population studied, the objective of the postural test, and the environmental conditions. For these reasons, the aim of this review was to present and justify the different testing techniques and methods with their different quantitative and qualitative variables to make it possible to precisely evaluate each sensory, central, and motor component of the postural function according to the experiment protocol under consideration. The main practical and technological methods and techniques used in evaluating postural control were explained and justified according to the experimental protocol defined. The main postural conditions (postural stance, visual condition, balance condition, and test duration) were also analyzed. Moreover, the mechanistic exploration of the postural function often requires implementing disturbing postural conditions by using motor disturbance (mechanical disturbance), sensory stimulation (sensory manipulation), and/or cognitive disturbance (cognitive task associated with maintaining postural balance) protocols. Each type of disturbance was tackled in order to facilitate understanding of subtle postural control mechanisms and the means to explore them. PMID:26640800

Techniques and Methods for Testing the Postural Function in Healthy and Pathological Subjects.

PubMed

Paillard, Thierry; Noé, Frédéric

2015-01-01

The different techniques and methods employed as well as the different quantitative and qualitative variables measured in order to objectify postural control are often chosen without taking into account the population studied, the objective of the postural test, and the environmental conditions. For these reasons, the aim of this review was to present and justify the different testing techniques and methods with their different quantitative and qualitative variables to make it possible to precisely evaluate each sensory, central, and motor component of the postural function according to the experiment protocol under consideration. The main practical and technological methods and techniques used in evaluating postural control were explained and justified according to the experimental protocol defined. The main postural conditions (postural stance, visual condition, balance condition, and test duration) were also analyzed. Moreover, the mechanistic exploration of the postural function often requires implementing disturbing postural conditions by using motor disturbance (mechanical disturbance), sensory stimulation (sensory manipulation), and/or cognitive disturbance (cognitive task associated with maintaining postural balance) protocols. Each type of disturbance was tackled in order to facilitate understanding of subtle postural control mechanisms and the means to explore them.

Combined qualitative and quantitative research designs.

PubMed

Seymour, Jane

2012-12-01

Mixed methods research designs have been recognized as important in addressing complexity and are recommended particularly in the development and evaluation of complex interventions. This article reports a review of studies in palliative care published between 2010 and March 2012 that combine qualitative and quantitative approaches. A synthesis of approaches to mixed methods research taken in 28 examples of published research studies of relevance to palliative and supportive care is provided, using a typology based on a classic categorization put forward in 1992. Mixed-method studies are becoming more frequently employed in palliative care research and resonate with the complexity of the palliative care endeavour. Undertaking mixed methods research requires a sophisticated understanding of the research process and recognition of some of the underlying complexities encountered when working with different traditions and perspectives on issues of: sampling, validity, reliability and rigour, different sources of data and different data collection and analysis techniques.

The acoustical design of vehicles-a challenge for qualitative evaluation

NASA Astrophysics Data System (ADS)

Schulte-Fortkamp, Brigitte; Genuit, Klaus; Fiebig, Andre

2005-09-01

Whenever the acoustical design of vehicles is explored, the crucial question about the appropriate method of evaluation arises. Research shows that not only acoustic but also non-acoustic parameters have a major influence on the way sounds are evaluated. Therefore, new methods of evaluation have to be implemented. Methods are needed which give the opportunity to test the quality of the given ambience and to register the effects and evaluations in their functional interdependence as well as the influence of personal and contextual factors. Moreover, new methods have to give insight into processes of evaluation and their contextual parameters. In other words, the task of evaluating acoustical ambiences consists of designating a set of social, psychological, and cultural conditions which are important to determine particular individual and collective behavior, attitudes, and also emotions relative to the given ambience. However, no specific recommendations exist yet which comprise particular descriptions of how to assess those specific sound effects. That is why there is a need to develop alternative methods of evaluation with whose help effects of acoustical ambiences can be better predicted. A method of evaluation will be presented which incorporates a new sensitive approach for the evaluation of vehicle sounds.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

Using quantitative and qualitative data in health services research - what happens when mixed method findings conflict? [ISRCTN61522618].

PubMed

Moffatt, Suzanne; White, Martin; Mackintosh, Joan; Howel, Denise

2006-03-08

In this methodological paper we document the interpretation of a mixed methods study and outline an approach to dealing with apparent discrepancies between qualitative and quantitative research data in a pilot study evaluating whether welfare rights advice has an impact on health and social outcomes among a population aged 60 and over. Quantitative and qualitative data were collected contemporaneously. Quantitative data were collected from 126 men and women aged over 60 within a randomised controlled trial. Participants received a full welfare benefits assessment which successfully identified additional financial and non-financial resources for 60% of them. A range of demographic, health and social outcome measures were assessed at baseline, 6, 12 and 24 month follow up. Qualitative data were collected from a sub-sample of 25 participants purposively selected to take part in individual interviews to examine the perceived impact of welfare rights advice. Separate analysis of the quantitative and qualitative data revealed discrepant findings. The quantitative data showed little evidence of significant differences of a size that would be of practical or clinical interest, suggesting that the intervention had no impact on these outcome measures. The qualitative data suggested wide-ranging impacts, indicating that the intervention had a positive effect. Six ways of further exploring these data were considered: (i) treating the methods as fundamentally different; (ii) exploring the methodological rigour of each component; (iii) exploring dataset comparability; (iv) collecting further data and making further comparisons; (v) exploring the process of the intervention; and (vi) exploring whether the outcomes of the two components match. The study demonstrates how using mixed methods can lead to different and sometimes conflicting accounts and, using this six step approach, how such discrepancies can be harnessed to interrogate each dataset more fully. Not only does this enhance the robustness of the study, it may lead to different conclusions from those that would have been drawn through relying on one method alone and demonstrates the value of collecting both types of data within a single study. More widespread use of mixed methods in trials of complex interventions is likely to enhance the overall quality of the evidence base.

Solving a methodological challenge in work stress evaluation with the Stress Assessment and Research Toolkit (StART): a study protocol.

PubMed

Guglielmi, Dina; Simbula, Silvia; Vignoli, Michela; Bruni, Ilaria; Depolo, Marco; Bonfiglioli, Roberta; Tabanelli, Maria Carla; Violante, Francesco Saverio

2013-06-22

Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers' stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands.

Solving a methodological challenge in work stress evaluation with the Stress Assessment and Research Toolkit (StART): a study protocol

PubMed Central

2013-01-01

Background Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. Design This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. Discussion The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers’ stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands. PMID:23799950

Qualitative data collection and analysis methods: the INSTINCT trial.

PubMed

Meurer, William J; Frederiksen, Shirley M; Majersik, Jennifer J; Zhang, Lingling; Sandretto, Annette; Scott, Phillip A

2007-11-01

Patient care practices often lag behind current scientific evidence and professional guidelines. The failure of such knowledge translation (KT) efforts may reflect inadequate assessment and management of specific barriers confronting both physicians and patients at the point of treatment level. Effective KT in this setting may benefit from the use of qualitative methods to identify and overcome these barriers. Qualitative methodology allows in-depth exploration of the barriers involved in adopting practice change and has been infrequently used in emergency medicine research. The authors describe the methodology for qualitative analysis within the INcreasing Stroke Treatment through INteractive behavioral Change Tactics (INSTINCT) trial. This includes processes for valid data collection and reliable analysis of the textual data from focus group and interview transcripts. INSTINCT is a 24-hospital, randomized, controlled study that is designed to evaluate a system-based barrier assessment and interactive educational intervention to increase appropriate tissue plasminogen activator (tPA) use in ischemic stroke. Intervention hospitals undergo baseline barrier assessment using both qualitative as well as quantitative (survey) techniques. Investigators obtain data on local barriers to tPA use, as well as information on local attitudes, knowledge, and beliefs regarding acute stroke treatment. Targeted groups at each site include emergency physicians, emergency nurses, neurologists, radiologists, and hospital administrators. Transcript analysis using NVivo7 with a predefined barrier taxonomy is described. This will provide both qualitative insight on thrombolytic use and importance of specific barrier types for each site. The qualitative findings subsequently direct the form of professional education efforts and system interventions at treatment sites.

Screening of 485 Pesticide Residues in Fruits and Vegetables by Liquid Chromatography-Quadrupole-Time-of-Flight Mass Spectrometry Based on TOF Accurate Mass Database and QTOF Spectrum Library.

PubMed

Pang, Guo-Fang; Fan, Chun-Lin; Chang, Qiao-Ying; Li, Jian-Xun; Kang, Jian; Lu, Mei-Ling

2018-03-22

This paper uses the LC-quadrupole-time-of-flight MS technique to evaluate the behavioral characteristics of MSof 485 pesticides under different conditions and has developed an accurate mass database and spectra library. A high-throughput screening and confirmation method has been developed for the 485 pesticides in fruits and vegetables. Through the optimization of parameters such as accurate mass number, time of retention window, ionization forms, etc., the method has improved the accuracy of pesticide screening, thus avoiding the occurrence of false-positive and false-negative results. The method features a full scan of fragments, with 80% of pesticide qualitative points over 10, which helps increase pesticide qualitative accuracy. The abundant differences of fragment categories help realize the effective separation and qualitative identification of isomer pesticides. Four different fruits and vegetables-apples, grapes, celery, and tomatoes-were chosen to evaluate the efficiency of the method at three fortification levels of 5, 10, and 20 μg/kg, and satisfactory results were obtained. With this method, a national survey of pesticide residues was conducted between 2012 and 2015 for 12 551 samples of 146 different fruits and vegetables collected from 638 sampling points in 284 counties across 31 provincial capitals/cities directly under the central government, which provided scientific data backup for ensuring pesticide residue safety of the fruits and vegetables consumed daily by the public. Meanwhile, the big data statistical analysis of the new technique also further proves it to be of high speed, high throughput, high accuracy, high reliability, and high informatization.

Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

ERIC Educational Resources Information Center

Goodwin, Laura D.; Goodwin, William L.

1984-01-01

The views of prominant qualitative methodologists on the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations are summarized. A case is made for the relevance of validity and reliability estimation. Definitions of validity and reliability for qualitative measurement are presented…

Using a theory-driven conceptual framework in qualitative health research.

PubMed

Macfarlane, Anne; O'Reilly-de Brún, Mary

2012-05-01

The role and merits of highly inductive research designs in qualitative health research are well established, and there has been a powerful proliferation of grounded theory method in the field. However, tight qualitative research designs informed by social theory can be useful to sensitize researchers to concepts and processes that they might not necessarily identify through inductive processes. In this article, we provide a reflexive account of our experience of using a theory-driven conceptual framework, the Normalization Process Model, in a qualitative evaluation of general practitioners' uptake of a free, pilot, language interpreting service in the Republic of Ireland. We reflect on our decisions about whether or not to use the Model, and describe our actual use of it to inform research questions, sampling, coding, and data analysis. We conclude with reflections on the added value that the Model and tight design brought to our research.

Pre-Service Teachers' Evaluations of Practices in Teaching English to Young Learners in Terms of 21st Century Teacher Qualifications

ERIC Educational Resources Information Center

Çakir, Abdulvahit; Güngör, Müzeyyen Nazli

2017-01-01

This study investigates the 3rd year and 4th year pre-service teachers' evaluations of the practices in teaching English to young learners in terms of 21st century teacher qualifications. Employing a mixed methods design, this study includes the qualitative data that come from semi-structured interviewed questions administered to pre-service…

Curriculum Evaluation in Online Education: The Case of Teacher Candidates Preparing Online for Public Personnel Selection Examination

ERIC Educational Resources Information Center

Karacaoglu, Ömer Cem

2018-01-01

The aim of the present study is to evaluate the efficiency of an online curriculum based on the views of lecturers and students enrolled in the program. The study is mainly based on survey method. In order to collect qualitative data, interviews forms developed by the researcher were used. The reliability and validity of the interview forms were…

Evaluating Current Status of MS Educational Technology Curriculum in Iran from Viewpoint of Experts and Professors in Order to Offering a Desirable Curriculum

ERIC Educational Resources Information Center

Rahmanpour, Mohammad; Liaghatdar, Mohammad-Javad; Sharifian, Fereydoon; Rezaee, Mehran

2016-01-01

The aim of this research is evaluating status of MS field of educational technology in Iran. This research is qualitative and it is conducted based on survey method. The statistical community of this research is expert professors in educational technology area. Accordingly, 15 persons were chosen among this statistical community as statistical…

Use of qualitative methods in published health services and management research: a 10-year review.

PubMed

Weiner, Bryan J; Amick, Halle R; Lund, Jennifer L; Lee, Shoou-Yih Daniel; Hoff, Timothy J

2011-02-01

Over the past 10 years, the field of health services and management research has seen renewed interest in the use of qualitative research methods. This article examines the volume and characteristics of qualitative research articles published in nine major health services and management journals between 1998 and 2008. Qualitative research articles comprise 9% of research articles published in these journals. Although the publication rate of qualitative research articles has not kept pace with that of quantitative research articles, citation analysis suggests that qualitative research articles contribute comparably to the field's knowledge base. A wide range of policy and management topics has been examined using qualitative methods. Case study designs, interviews, and documentary sources were the most frequently used methods. Half of qualitative research articles provided little or no detail about key aspects the study's methods. Implications are discussed and recommendations are offered for promoting the publication of qualitative research.

Development and field testing of a decision support tool to facilitate shared decision making in contraceptive counseling.

PubMed

Dehlendorf, Christine; Fitzpatrick, Judith; Steinauer, Jody; Swiader, Lawrence; Grumbach, Kevin; Hall, Cara; Kuppermann, Miriam

2017-07-01

We developed and formatively evaluated a tablet-based decision support tool for use by women prior to a contraceptive counseling visit to help them engage in shared decision making regarding method selection. Drawing upon formative work around women's preferences for contraceptive counseling and conceptual understanding of health care decision making, we iteratively developed a storyboard and then digital prototypes, based on best practices for decision support tool development. Pilot testing using both quantitative and qualitative data and cognitive testing was conducted. We obtained feedback from patient and provider advisory groups throughout the development process. Ninety-six percent of women who used the tool in pilot testing reported that it helped them choose a method, and qualitative interviews indicated acceptability of the tool's content and presentation. Compared to the control group, women who used the tool demonstrated trends toward increased likelihood of complete satisfaction with their method. Participant responses to cognitive testing were used in tool refinement. Our decision support tool appears acceptable to women in the family planning setting. Formative evaluation of the tool supports its utility among patients making contraceptive decisions, which can be further evaluated in a randomized controlled trial. Copyright © 2017 Elsevier B.V. All rights reserved.

Evaluating the Effects of Gamma-Irradiation for Decontamination of Medicinal Cannabis.

PubMed

Hazekamp, Arno

2016-01-01

In several countries with a National medicinal cannabis program, pharmaceutical regulations specify that herbal cannabis products must adhere to strict safety standards regarding microbial contamination. Treatment by gamma irradiation currently seems the only method available to meet these requirements. We evaluated the effects of irradiation treatment of four different cannabis varieties covering different chemical compositions. Samples were compared before and after standard gamma-irradiation treatment by performing quantitative UPLC analysis of major cannabinoids, as well as qualitative GC analysis of full cannabinoid and terpene profiles. In addition, water content and microscopic appearance of the cannabis flowers was evaluated. This study found that treatment did not cause changes in the content of THC and CBD, generally considered as the most important therapeutically active components of medicinal cannabis. Likewise, the water content and the microscopic structure of the dried cannabis flowers were not altered by standard irradiation protocol in the cannabis varieties studied. The effect of gamma-irradiation was limited to a reduction of some terpenes present in the cannabis, but keeping the terpene profile qualitatively the same. Based on the results presented in this report, gamma irradiation of herbal cannabis remains the recommended method of decontamination, at least until other more generally accepted methods have been developed and validated.

Evaluating the Effects of Gamma-Irradiation for Decontamination of Medicinal Cannabis

PubMed Central

Hazekamp, Arno

2016-01-01

In several countries with a National medicinal cannabis program, pharmaceutical regulations specify that herbal cannabis products must adhere to strict safety standards regarding microbial contamination. Treatment by gamma irradiation currently seems the only method available to meet these requirements. We evaluated the effects of irradiation treatment of four different cannabis varieties covering different chemical compositions. Samples were compared before and after standard gamma-irradiation treatment by performing quantitative UPLC analysis of major cannabinoids, as well as qualitative GC analysis of full cannabinoid and terpene profiles. In addition, water content and microscopic appearance of the cannabis flowers was evaluated. This study found that treatment did not cause changes in the content of THC and CBD, generally considered as the most important therapeutically active components of medicinal cannabis. Likewise, the water content and the microscopic structure of the dried cannabis flowers were not altered by standard irradiation protocol in the cannabis varieties studied. The effect of gamma-irradiation was limited to a reduction of some terpenes present in the cannabis, but keeping the terpene profile qualitatively the same. Based on the results presented in this report, gamma irradiation of herbal cannabis remains the recommended method of decontamination, at least until other more generally accepted methods have been developed and validated. PMID:27199751

The norm and the text: Denzin and Lincoln's handbooks of qualitative method.

PubMed

Fielding, N G

1999-09-01

Qualitative methods have lately enjoyed enhanced legitimacy and are increasingly used in academic and applied social research. Yet the field is marked by controversy about virtually every key tenet of qualitative inquiry, from matters of epistemology to purely practical matters of relations with research subjects. Not only is the practice of qualitative research hotly contested, consensus is lacking about the purpose of qualitative research and whether it has a distinctive role to play relative to other approaches to the study of social phenomena. Against this context, the handbooks of qualitative method edited by Norman Denzin and Yvonna Lincoln represent a significant attempt to capture the breadth of contemporary approaches to qualitative method. The article examines key contributions from the handbooks, drawing on these to develop a view of qualitative method from a pragmatic, realist perspective. Among the issues considered are the significance of relativism, subjectivity, post-modernism and feminist method, the politicization of the purposes of qualitative research, the debate over criteria of validity, and the move to treat qualitative research as an entertainment rather than a scientific practice.

Contextual Factors Related to Stereotype Threat and Student Success in Science Technology Engineering Mathematics Education: A Mixed Methods Study

NASA Astrophysics Data System (ADS)

Leker, Lindsey Beth

Stereotype threat is a widely researched phenomenon shown to impact performance in testing and evaluation situations (Katz, Roberts, & Robinson, 1965; Steele & Aronson, 1995). When related to gender, stereotype threat can lead women to score lower than men on standardized math exams (Spencer, Steele, & Quinn, 1999). Stereotype threat may be one reason women have lower enrollment in most science, technology, engineering, and mathematics (STEM) majors, hold a smaller number of STEM careers than men, and have a higher attrition rate in STEM professions (Hill, Corbet, & Rose, 2010; Picho & Brown 2011; Sorby & Baartmans, 2000). Most research has investigated stereotype threat using experiments yielding mixed results (Stoet & Geary, 2012). Thus, there is a need to explore stereotype threat using quantitative surveys and qualitative methods to examine other contextual factors that contribute to gender difference in STEM fields. This dissertation outlined a mixed methods study designed to, first, qualitatively explore stereotype threat and contextual factors related to high achieving women in STEM fields, as well as women who have failed and/or avoided STEM fields. Then, the quantitative portion of the study used the themes from the qualitative phase to create a survey that measured stereotype threat and other contextual variables related to STEM success and failure/avoidance. Fifteen participants were interviewed for the qualitative phase of the study and six themes emerged. The quantitative survey was completed 242 undergraduate participants. T-tests, correlations, regressions, and mediation analyses were used to analyze the data. There were significant relationships between stereotype threat and STEM confidence, STEM anxiety, giving up in STEM, and STEM achievement. Overall, this mixed methods study advanced qualitative research on stereotype threat, developed a much-needed scale for the measurement of stereotype threat, and tested the developed scale.

Assessment of acute myocarditis by cardiac magnetic resonance imaging: Comparison of qualitative and quantitative analysis methods.

PubMed

Imbriaco, Massimo; Nappi, Carmela; Puglia, Marta; De Giorgi, Marco; Dell'Aversana, Serena; Cuocolo, Renato; Ponsiglione, Andrea; De Giorgi, Igino; Polito, Maria Vincenza; Klain, Michele; Piscione, Federico; Pace, Leonardo; Cuocolo, Alberto

2017-10-26

To compare cardiac magnetic resonance (CMR) qualitative and quantitative analysis methods for the noninvasive assessment of myocardial inflammation in patients with suspected acute myocarditis (AM). A total of 61 patients with suspected AM underwent coronary angiography and CMR. Qualitative analysis was performed applying Lake-Louise Criteria (LLC), followed by quantitative analysis based on the evaluation of edema ratio (ER) and global relative enhancement (RE). Diagnostic performance was assessed for each method by measuring the area under the curves (AUC) of the receiver operating characteristic analyses. The final diagnosis of AM was based on symptoms and signs suggestive of cardiac disease, evidence of myocardial injury as defined by electrocardiogram changes, elevated troponin I, exclusion of coronary artery disease by coronary angiography, and clinical and echocardiographic follow-up at 3 months after admission to the chest pain unit. In all patients, coronary angiography did not show significant coronary artery stenosis. Troponin I levels and creatine kinase were higher in patients with AM compared to those without (both P < .001). There were no significant differences among LLC, T2-weighted short inversion time inversion recovery (STIR) sequences, early (EGE), and late (LGE) gadolinium-enhancement sequences for diagnosis of AM. The AUC for qualitative (T2-weighted STIR 0.92, EGE 0.87 and LGE 0.88) and quantitative (ER 0.89 and global RE 0.80) analyses were also similar. Qualitative and quantitative CMR analysis methods show similar diagnostic accuracy for the diagnosis of AM. These findings suggest that a simplified approach using a shortened CMR protocol including only T2-weighted STIR sequences might be useful to rule out AM in patients with acute coronary syndrome and normal coronary angiography.

Leading for the long haul: a mixed-method evaluation of the Sustainment Leadership Scale (SLS).

PubMed

Ehrhart, Mark G; Torres, Elisa M; Green, Amy E; Trott, Elise M; Willging, Cathleen E; Moullin, Joanna C; Aarons, Gregory A

2018-01-19

Despite our progress in understanding the organizational context for implementation and specifically the role of leadership in implementation, its role in sustainment has received little attention. This paper took a mixed-method approach to examine leadership during the sustainment phase of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Utilizing the Implementation Leadership Scale as a foundation, we sought to develop a short, practical measure of sustainment leadership that can be used for both applied and research purposes. Data for this study were collected as a part of a larger mixed-method study of evidence-based intervention, SafeCare®, sustainment. Quantitative data were collected from 157 providers using web-based surveys. Confirmatory factor analysis was used to examine the factor structure of the Sustainment Leadership Scale (SLS). Qualitative data were collected from 95 providers who participated in one of 15 focus groups. A framework approach guided qualitative data analysis. Mixed-method integration was also utilized to examine convergence of quantitative and qualitative findings. Confirmatory factor analysis supported the a priori higher order factor structure of the SLS with subscales indicating a single higher order sustainment leadership factor. The SLS demonstrated excellent internal consistency reliability. Qualitative analyses offered support for the dimensions of sustainment leadership captured by the quantitative measure, in addition to uncovering a fifth possible factor, available leadership. This study found qualitative and quantitative support for the pragmatic SLS measure. The SLS can be used for assessing leadership of first-level leaders to understand how staff perceive leadership during sustainment and to suggest areas where leaders could direct more attention in order to increase the likelihood that EBIs are institutionalized into the normal functioning of the organization.

Evaluating digital libraries in the health sector. Part 2: measuring impacts and outcomes.

PubMed

Cullen, Rowena

2004-03-01

This is the second part of a two-part paper which explores methods that can be used to evaluate digital libraries in the health sector. Part 1 focuses on approaches to evaluation that have been proposed for mainstream digital information services. This paper investigates evaluative models developed for some innovative digital library projects, and some major national and international electronic health information projects. The value of ethnographic methods to provide qualitative data to explore outcomes, adding to quantitative approaches based on inputs and outputs is discussed. The paper concludes that new 'post-positivist' models of evaluation are needed to cover all the dimensions of the digital library in the health sector, and some ways of doing this are outlined.

76 FR 28102 - Notice of Issuance of Regulatory Guide

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-13

..., Probabilistic Risk Assessment Branch, Division of Risk Analysis, Office of Nuclear Regulatory Research, U.S... approaches and methods (whether quantitative or qualitative, deterministic or probabilistic), data, and... uses in evaluating specific problems or postulated accidents, and data that the staff needs in its...

Dilemmas in Quality Assessment

ERIC Educational Resources Information Center

Patry, Jean-Luc; Gastager, Angela

2004-01-01

A taxonomy of potential values conflicts in evaluations is presented. Basis is the distinction of types of conflict (aims vs. means conflicts; qualitative vs. quantitative conflicts). Six areas of values are discussed: the ethical, methodical, social and interactive, legal, economic, and personal values. The taxonomy of conflicts between these…

Cardiac Rehabilitation Online Pilot: Extending Reach of Cardiac Rehabilitation.

PubMed

Higgins, Rosemary O; Rogerson, Michelle; Murphy, Barbara M; Navaratnam, Hema; Butler, Michael V; Barker, Lauren; Turner, Alyna; Lefkovits, Jeffrey; Jackson, Alun C

While cardiac rehabilitation (CR) is recommended for all patients after an acute cardiac event, limitations exist in reach. The purpose of the current study was to develop and pilot a flexible online CR program based on self-management principles "Help Yourself Online." The program was designed as an alternative to group-based CR as well as to complement traditional CR. The program was based on existing self-management resources developed previously by the Heart Research Centre. Twenty-one patients admitted to Cabrini Health for an acute cardiac event were recruited to test the program. The program was evaluated using qualitative and quantitative methods. Quantitative results demonstrated that patients believed the program would assist them in their self-management. Qualitative evaluation, using focus group and interview methods with 15 patients, showed that patients perceived the online CR approach to be a useful instrument for self-management. Broader implications of the data include the acceptability of the intervention, timing of intervention delivery, and patients' desire for additional online community support.

The qualitative research proposal.

PubMed

Klopper, H

2008-12-01

Qualitative research in the health sciences has had to overcome many prejudices and a number of misunderstandings, but today qualitative research is as acceptable as quantitative research designs and is widely funded and published. Writing the proposal of a qualitative study, however, can be a challenging feat, due to the emergent nature of the qualitative research design and the description of the methodology as a process. Even today, many sub-standard proposals at post-graduate evaluation committees and application proposals to be considered for funding are still seen. This problem has led the researcher to develop a framework to guide the qualitative researcher in writing the proposal of a qualitative study based on the following research questions: (i) What is the process of writing a qualitative research proposal? and (ii) What does the structure and layout of a qualitative proposal look like? The purpose of this article is to discuss the process of writing the qualitative research proposal, as well as describe the structure and layout of a qualitative research proposal. The process of writing a qualitative research proposal is discussed with regards to the most important questions that need to be answered in your research proposal with consideration of the guidelines of being practical, being persuasive, making broader links, aiming for crystal clarity and planning before you write. While the structure of the qualitative research proposal is discussed with regards to the key sections of the proposal, namely the cover page, abstract, introduction, review of the literature, research problem and research questions, research purpose and objectives, research paradigm, research design, research method, ethical considerations, dissemination plan, budget and appendices.

Strategies for Managing Nursing Students’ Incivility as Experienced by Nursing Educators: a Qualitative Study

PubMed Central

Rad, Mostafa; Karimi Moonaghi, Hossein

2016-01-01

Introduction: Students’ incivility is an impolite and disturbing behavior in education and if ignored could lead to behavioral complexities and eventually violence and aggression in classrooms. This study aimed to reveal the experiences of Iranian educators regarding the management of such behaviors. Methods: In this qualitative study, qualitative content analysis method was used to evaluate the experiences and perceptions of nursing educators and students. A total of 22 persons (14 educators and 8 students) were selected through purposive sampling and individually interviewed. Results: Categories of unification of educators regarding behavioral management, teaching-learning strategy, friendship strategy and training through role playing, authority, appropriative decision-making and freedom, stronger relationships between students, reflection, and interactive educational environment were some strategies used by teachers for management of incivility. Conclusion: Educators suggested some strategies which could be used depending on uniqueness of behaviors and given situation. Educators and managers of medical fields can use these approaches in their classrooms to control uncivil behaviors. PMID:26989663

Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis

PubMed Central

2014-01-01

Background Caring for a young person experiencing first-episode psychosis is challenging and can affect carers’ well-being adversely. While some face-to-face approaches have achieved promising outcomes, they are costly and resource-intensive to provide, restricting their reach and penetration. Guided self-help in book-form (or bibliotherapy) is an alternative but untested approach in these circumstances. In this study, we aimed to evaluate carers’ beliefs about the usefulness of problem-solving guided self-help manual for primary carers of young people with first-episode psychosis. Methods A qualitative process evaluation nested in a randomised controlled trial, conducted across two early intervention psychosis services in Melbourne, Australia. 124 carers were randomised to problem-solving guided self-help intervention or treatment as usual. We also undertook a qualitative process evaluation, using individual interviews, with a random sample of 24 of the intervention group. A thematic analysis of the qualitative data was undertaken, which is the subject of this paper. Interviews were conducted between January 2009 and September 2010. Results Three themes were abstracted from the data, reflecting carers’ beliefs about the usefulness of the manual: promoting carers’ well-being, increasing carers’ understanding of and support for the young person with first-episode psychosis, and accessibility and delivery modes of the programme. Conclusion This process evaluation highlights that guided self-help is useful in informing and supporting carers of affected young people. While there is scope for broadening the delivery modes, the approach is easy to use and accessible, and can be used as a cost-effective adjunct to standard support provided to carers, by community mental health nurses and other clinicians. Trial registration ACTRN12609000064202 PMID:24906392

Content Validity of National Post Marriage Educational Program Using Mixed Methods

PubMed Central

MOHAJER RAHBARI, Masoumeh; SHARIATI, Mohammad; KERAMAT, Afsaneh; YUNESIAN, Masoud; ESLAMI, Mohammad; MOUSAVI, Seyed Abbas; MONTAZERI, Ali

2015-01-01

Background: Although the validity of content of program is mostly conducted with qualitative methods, this study used both qualitative and quantitative methods for the validation of content of post marriage training program provided for newly married couples. Content validity is a preliminary step of obtaining authorization required to install the program in country's health care system. Methods: This mixed methodological content validation study carried out in four steps with forming three expert panels. Altogether 24 expert panelists were involved in 3 qualitative and quantitative panels; 6 in the first item development one; 12 in the reduction kind, 4 of them were common with the first panel, and 10 executive experts in the last one organized to evaluate psychometric properties of CVR and CVI and Face validity of 57 educational objectives. Results: The raw data of post marriage program had been written by professional experts of Ministry of Health, using qualitative expert panel, the content was more developed by generating 3 topics and refining one topic and its respective content. In the second panel, totally six other objectives were deleted, three for being out of agreement cut of point and three on experts' consensus. The validity of all items was above 0.8 and their content validity indices (0.8–1) were completely appropriate in quantitative assessment. Conclusion: This study provided a good evidence for validation and accreditation of national post marriage program planned for newly married couples in health centers of the country in the near future. PMID:26056672

Using learning theory, interprofessional facilitation competencies, and behavioral indicators to evaluate facilitator training.

PubMed

LeGros, Theresa A; Amerongen, Helen M; Cooley, Janet H; Schloss, Ernest P

2015-01-01

Despite the increasing need for faculty and preceptors skilled in interprofessional facilitation (IPF), the relative novelty of the field poses a challenge to the development and evaluation of IPF programs. We use learning theory and IPF competencies with associated behavioral indicators to develop and evaluate six key messages in IPF training and experience. Our mixed methods approach included two phases: quantitative data collection with embedded qualitative data, followed by qualitative data collection in explanatory sequential fashion. This enabled triangulated analyses of both data types and of facilitation behaviors from facilitator and student perspectives. Results indicate the competency-based training was effective. Facilitators felt comfortable performing behaviors associated with IPF competencies; student observations of those behaviors supported facilitator self-reported performance. Overall, students perceived more facilitation opportunities than facilitators. Findings corroborate the importance of recruiting seasoned facilitators and establishing IPF guidelines that acknowledge variable team dynamics and help facilitators recognize teachable moments.

Qualitative Analysis of Written Reflections during a Teaching Certificate Program

PubMed Central

Castleberry, Ashley N.; Payakachat, Nalin; Ashby, Sarah; Nolen, Amanda; Carle, Martha; Neill, Kathryn K.

2016-01-01

Objective. To evaluate the success of a teaching certificate program by qualitatively evaluating the content and extent of participants’ reflections. Methods. Two investigators independently identified themes within midpoint and final reflection essays across six program years. Each essay was evaluated to determine the extent of reflection in prompted teaching-related topic areas (strengths, weaknesses, assessment, feedback). Results. Twenty-eight themes were identified within 132 essays. Common themes encompassed content delivery, student assessment, personal successes, and challenges encountered. Deep reflection was exhibited, with 48% of essays achieving the highest level of critical reflection. Extent of reflection trended higher from midpoint to final essays, with significant increases in the strengths and feedback areas. Conclusion. The teaching certificate program fostered critical reflection and self-reported positive behavior change in teaching, thus providing a high-quality professional development opportunity. Such programs should strongly consider emphasizing critical reflection through required reflective exercises at multiple points within program curricula. PMID:26941436

Supplementary search methods were more effective and offered better value than bibliographic database searching: A case study from public health and environmental enhancement.

PubMed

Cooper, Chris; Lovell, Rebecca; Husk, Kerryn; Booth, Andrew; Garside, Ruth

2018-06-01

We undertook a systematic review to evaluate the health benefits of environmental enhancement and conservation activities. We were concerned that a conventional process of study identification, focusing on exhaustive searches of bibliographic databases as the primary search method, would be ineffective, offering limited value. The focus of this study is comparing study identification methods. We compare (1) an approach led by searches of bibliographic databases with (2) an approach led by supplementary search methods. We retrospectively assessed the effectiveness and value of both approaches. Effectiveness was determined by comparing (1) the total number of studies identified and screened and (2) the number of includable studies uniquely identified by each approach. Value was determined by comparing included study quality and by using qualitative sensitivity analysis to explore the contribution of studies to the synthesis. The bibliographic databases approach identified 21 409 studies to screen and 2 included qualitative studies were uniquely identified. Study quality was moderate, and contribution to the synthesis was minimal. The supplementary search approach identified 453 studies to screen and 9 included studies were uniquely identified. Four quantitative studies were poor quality but made a substantive contribution to the synthesis; 5 studies were qualitative: 3 studies were good quality, one was moderate quality, and 1 study was excluded from the synthesis due to poor quality. All 4 included qualitative studies made significant contributions to the synthesis. This case study found value in aligning primary methods of study identification to maximise location of relevant evidence. Copyright © 2017 John Wiley & Sons, Ltd.

Adapting and enhancing PAX Good Behavior Game for First Nations communities: a mixed-methods study protocol developed with Swampy Cree Tribal Council communities in Manitoba

PubMed Central

Fortier, Janique; Chartier, Mariette; Turner, Sarah; Murdock, Nora; Turner, Frank; Sareen, Jitender; Afifi, Tracie O; Katz, Laurence Y; Brownell, Marni; Bolton, James; Elias, Brenda; Isaak, Corinne; Woodgate, Roberta; Jiang, Depeng

2018-01-01

Introduction High rates of mental health problems, such as suicidal behaviours, among First Nations youth in Canada are a major public health concern. The Good Behavior Game (GBG) is a school-based intervention that provides a nurturing environment for children and has been shown to promote positive outcomes. PAX Good Behavior Game (PAX GBG) is an adaptation and enhancement of the GBG. While PAX GBG has been implemented in Indigenous communities, little research exists examining the cultural and contextual appropriateness and effectiveness of the intervention in First Nations communities. Methods and analysis The present paper describes a protocol of the mixed-methods approach guided by an Indigenous ethical engagement model adopted to implement, adapt and evaluate PAX GBG in First Nations communities in Manitoba, Canada. First, implementation outcomes (eg, acceptability, adoption) of PAX GBG will be evaluated using qualitative interviews with teachers, principals and community members from Swampy Cree Tribal Council (SCTC) communities. Second, by linking administrative databases to programme data from schools in 38 First Nations communities, we will compare PAX GBG and control groups to evaluate whether PAX GBG is associated with improved mental health and academic outcomes. Third, the qualitative results will help inform a cultural and contextual adaptation of PAX GBG called First Nations PAX (FN PAX). Fourth, FN PAX will be implemented in a few SCTC communities and evaluated using surveys and qualitative interviews followed by the remaining communities the subsequent year. Ethics and dissemination Ethical approval was obtained from the University of Manitoba Health Research Ethics Board and will be obtained from the Health Information Privacy Committee and respective data providers for the administrative database linkages. Dissemination and knowledge translation will include community and stakeholder engagement throughout the research process, reports and presentations for policymakers and community members, presentations at scientific conferences and journal publications. PMID:29449291

Genetic toxicology at the crossroads-from qualitative hazard evaluation to quantitative risk assessment.

PubMed

White, Paul A; Johnson, George E

2016-05-01

Applied genetic toxicology is undergoing a transition from qualitative hazard identification to quantitative dose-response analysis and risk assessment. To facilitate this change, the Health and Environmental Sciences Institute (HESI) Genetic Toxicology Technical Committee (GTTC) sponsored a workshop held in Lancaster, UK on July 10-11, 2014. The event included invited speakers from several institutions and the contents was divided into three themes-1: Point-of-departure Metrics for Quantitative Dose-Response Analysis in Genetic Toxicology; 2: Measurement and Estimation of Exposures for Better Extrapolation to Humans and 3: The Use of Quantitative Approaches in Genetic Toxicology for human health risk assessment (HHRA). A host of pertinent issues were discussed relating to the use of in vitro and in vivo dose-response data, the development of methods for in vitro to in vivo extrapolation and approaches to use in vivo dose-response data to determine human exposure limits for regulatory evaluations and decision-making. This Special Issue, which was inspired by the workshop, contains a series of papers that collectively address topics related to the aforementioned themes. The Issue includes contributions that collectively evaluate, describe and discuss in silico, in vitro, in vivo and statistical approaches that are facilitating the shift from qualitative hazard evaluation to quantitative risk assessment. The use and application of the benchmark dose approach was a central theme in many of the workshop presentations and discussions, and the Special Issue includes several contributions that outline novel applications for the analysis and interpretation of genetic toxicity data. Although the contents of the Special Issue constitutes an important step towards the adoption of quantitative methods for regulatory assessment of genetic toxicity, formal acceptance of quantitative methods for HHRA and regulatory decision-making will require consensus regarding the relationships between genetic damage and disease, and the concomitant ability to use genetic toxicity results per se. © Her Majesty the Queen in Right of Canada 2016. Reproduced with the permission of the Minister of Health.

Evaluation of UK Integrated Care Pilots: research protocol

PubMed Central

Ling, Tom; Bardsley, Martin; Adams, John; Lewis, Richard; Roland, Martin

2010-01-01

Background In response to concerns that the needs of the aging population for well-integrated care were increasing, the English National Health Service (NHS) appointed 16 Integrated Care Pilots following a national competition. The pilots have a range of aims including development of new organisational structures to support integration, changes in staff roles, reducing unscheduled emergency hospital admissions, reduced length of hospital stay, increasing patient satisfaction, and reducing cost. This paper describes the evaluation of the initiative which has been commissioned. Study design and data collection methods A mixed methods approach has been adopted including interviews with staff and patients, non-participant observation of meetings, structured written feedback from sites, questionnaires to patients and staff, and analysis of routinely collected hospital utilisation data for patients/service users. The qualitative analysis aims to identify the approaches taken to integration by the sites, the benefits which result, the context in which benefits have resulted, and the mechanisms by which they occur. Methods of analysis The quantitative analysis adopts a ‘difference in differences’ approach comparing health care utilisation before and after the intervention with risk-matched controls. The qualitative data analysis adopts a ‘theory of change’ approach in which we triangulate data from the quantitative analysis with qualitative data in order to describe causal effects (what happens when an independent variable changes) and causal mechanisms (what connects causes to their effects). An economic analysis will identify what incremental resources are required to make integration succeed and how they can be combined efficiently to produce better outcomes for patients. Conclusion This evaluation will produce a portfolio of evidence aimed at strengthening the evidence base for integrated care, and in particular identifying the context in which interventions are likely to be effective. These data will support a series of evaluation judgements aimed at reducing uncertainties about the role of integrated care in improving the efficient and effective delivery of healthcare. PMID:20922068

Self-calibrating models for dynamic monitoring and diagnosis

NASA Technical Reports Server (NTRS)

Kuipers, Benjamin

1994-01-01

The present goal in qualitative reasoning is to develop methods for automatically building qualitative and semiquantitative models of dynamic systems and to use them for monitoring and fault diagnosis. The qualitative approach to modeling provides a guarantee of coverage while our semiquantitative methods support convergence toward a numerical model as observations are accumulated. We have developed and applied methods for automatic creation of qualitative models, developed two methods for obtaining tractable results on problems that were previously intractable for qualitative simulation, and developed more powerful methods for learning semiquantitative models from observations and deriving semiquantitative predictions from them. With these advances, qualitative reasoning comes significantly closer to realizing its aims as a practical engineering method.

Teaching Qualitative Research Methods Using "Undercover Boss"

ERIC Educational Resources Information Center

Graham, LaKresha; Schuwerk, Tara J.

2017-01-01

Course(s): Research Methods, Qualitative Research Methods, Organizational Communication, Business Communication. Objectives: After completing this class exercise, students should be able to identify the major components of a qualitative research study, along with the ethical dilemmas that come with doing qualitative research.

"Can't We Just Have Some Sazón?" Student, Family, and Staff Perspectives on a New School Food Program at a Boston High School

ERIC Educational Resources Information Center

Chatterjee, Avik; Daftary, Genevieve; Campbell, Meg; Gatison, Lenward; Day, Liam; Ramsey, Kibret; Goldman, Roberta; Gillman, Matthew W.

2016-01-01

Background: In September 2013, a Massachusetts high school launched a nutrition program in line with 2013 United States Department of Agriculture requirements. We sought to understand attitudes of stakeholders toward the new program. Methods: We employed community-based participatory research methods in a qualitative evaluation of the food program…

Using multiple PCR and CE with chemiluminescence detection for simultaneous qualitative and quantitative analysis of genetically modified organism.

PubMed

Guo, Longhua; Qiu, Bin; Chi, Yuwu; Chen, Guonan

2008-09-01

In this paper, an ultrasensitive CE-CL detection system coupled with a novel double-on-column coaxial flow detection interface was developed for the detection of PCR products. A reliable procedure based on this system had been demonstrated for qualitative and quantitative analysis of genetically modified organism-the detection of Roundup Ready Soy (RRS) samples was presented as an example. The promoter, terminator, function and two reference genes of RRS were amplified with multiplex PCR simultaneously. After that, the multiplex PCR products were labeled with acridinium ester at the 5'-terminal through an amino modification and then analyzed by the proposed CE-CL system. Reproducibility of analysis times and peak heights for the CE-CL analysis were determined to be better than 0.91 and 3.07% (RSD, n=15), respectively, for three consecutive days. It was shown that this method could accurately and qualitatively detect RRS standards and the simulative samples. The evaluation in terms of quantitative analysis of RRS provided by this new method was confirmed by comparing our assay results with those of the standard real-time quantitative PCR (RT-QPCR) using SYBR Green I dyes. The results showed a good coherence between the two methods. This approach demonstrated the possibility for accurate qualitative and quantitative detection of GM plants in a single run.

Burnout in Nurses Working With Youth With Chronic Pain: A Mixed-Methods Analysis.

PubMed

Rodrigues, Nikita P; Cohen, Lindsey L; Swartout, Kevin M; Trotochaud, Karen; Murray, Eileen

2018-05-01

Nursing is a rewarding but also challenging profession. Nurses are at risk for burnout and premature exit from the profession, which is detrimental to them, their patients, and the healthcare system. There are few studies examining the unique correlates of burnout in nurses working with pediatric populations. The current 2-study project used mixed-methods (qualitative and then quantitative) analysis to explore burnout in nurses working in an inpatient unit with youth with chronic pain. Study I participants included all of the 32 nurses who worked in an inpatient pediatric unit, which admits patients with chronic pain. Qualitative analyses of focus groups were used to extract themes. These themes were examined via a quantitative battery completed by 41 nurses from 2 inpatient pediatric units with youth with chronic pain. The themes were burnout, moral distress, negative beliefs about chronic pain, barriers to pain management, fear of losing compassion, coworker support as a coping method, time worked in the unit, professional self-efficacy, and negative views of the hospital environment. Quantitative results supported most of the qualitative findings, and taken together, the findings supported a model of burnout in nurses working with youth with chronic pain. Conclusions We integrated qualitative and quantitative findings to develop a model of nurse burnout. This model provides a framework for evaluating and targeting burnout in nurses working with pediatric patients with chronic pain.

Young adult conservation jobs and worker health

Treesearch

Kathleen L. Wolf; Elizabeth Housley

2017-01-01

Decades of research studies demonstrate links between healthy environment, healthy lifestyles, and healthy people. This study evaluated the correlations between young adult conservation workers’ perceived stress, personal effectiveness, and nature experience using quantitative and qualitative social science methods. The study cohort numbered nearly 300 individuals...

Evaluating the Fine Arts Program at the Center for Excellence in Disabilities

ERIC Educational Resources Information Center

Schlosnagle, Leo; McBean, Amanda L.; Cutlip, Milisa; Panzironi, Helen; Jarmolowicz, David P.

2014-01-01

Art programs for people with disabilities may encourage creativity, promote engagement, emphasize inclusion, and extend access and opportunities for community involvement. This mixed methods study utilized quantitative and qualitative data, repeated measures, action research, and stakeholder collaboration to develop and implement an evaluation…

Frameworks for evaluating health research capacity strengthening: a qualitative study

PubMed Central

2013-01-01

Background Health research capacity strengthening (RCS) projects are often complex and hard to evaluate. In order to inform health RCS evaluation efforts, we aimed to describe and compare key characteristics of existing health RCS evaluation frameworks: their process of development, purpose, target users, structure, content and coverage of important evaluation issues. A secondary objective was to explore what use had been made of the ESSENCE framework, which attempts to address one such issue: harmonising the evaluation requirements of different funders. Methods We identified and analysed health RCS evaluation frameworks published by seven funding agencies between 2004 and 2012, using a mixed methods approach involving structured qualitative analyses of documents, a stakeholder survey and consultations with key contacts in health RCS funding agencies. Results The frameworks were intended for use predominantly by the organisations themselves, and most were oriented primarily towards funders’ internal organisational performance requirements. The frameworks made limited reference to theories that specifically concern RCS. Generic devices, such as logical frameworks, were typically used to document activities, outputs and outcomes, but with little emphasis on exploring underlying assumptions or contextual constraints. Usage of the ESSENCE framework appeared limited. Conclusions We believe that there is scope for improving frameworks through the incorporation of more accessible information about how to do evaluation in practice; greater involvement of stakeholders, following evaluation capacity building principles; greater emphasis on explaining underlying rationales of frameworks; and structuring frameworks so that they separate generic and project-specific aspects of health RCS evaluation. The third and fourth of these improvements might assist harmonisation. PMID:24330628

Methodology Series Module 10: Qualitative Health Research

PubMed Central

Setia, Maninder Singh

2017-01-01

Although quantitative designs are commonly used in clinical research, some studies require qualitative methods. These designs are different from quantitative methods; thus, researchers should be aware of data collection methods and analyses for qualitative research. Qualitative methods are particularly useful to understand patient experiences with the treatment or new methods of management or to explore issues in detail. These methods are useful in social and behavioral research. In qualitative research, often, the main focus is to understand the issue in detail rather than generalizability; thus, the sampling methods commonly used are purposive sampling; quota sampling; and snowball sampling (for hard to reach groups). Data can be collected using in-depth interviews (IDIs) or focus group discussions (FGDs). IDI is a one-to-one interview with the participant. FGD is a method of group interview or discussion, in which more than one participant is interviewed at the same time and is usually led by a facilitator. The commonly used methods for data analysis are: thematic analysis; grounded theory analysis; and framework analysis. Qualitative data collection and analysis require special expertise. Hence, if the reader plans to conduct qualitative research, they should team up with a qualitative researcher. PMID:28794545

Methodology Series Module 10: Qualitative Health Research.

PubMed

Setia, Maninder Singh

2017-01-01

Although quantitative designs are commonly used in clinical research, some studies require qualitative methods. These designs are different from quantitative methods; thus, researchers should be aware of data collection methods and analyses for qualitative research. Qualitative methods are particularly useful to understand patient experiences with the treatment or new methods of management or to explore issues in detail. These methods are useful in social and behavioral research. In qualitative research, often, the main focus is to understand the issue in detail rather than generalizability; thus, the sampling methods commonly used are purposive sampling; quota sampling; and snowball sampling (for hard to reach groups). Data can be collected using in-depth interviews (IDIs) or focus group discussions (FGDs). IDI is a one-to-one interview with the participant. FGD is a method of group interview or discussion, in which more than one participant is interviewed at the same time and is usually led by a facilitator. The commonly used methods for data analysis are: thematic analysis; grounded theory analysis; and framework analysis. Qualitative data collection and analysis require special expertise. Hence, if the reader plans to conduct qualitative research, they should team up with a qualitative researcher.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Use of Qualitative Methods in Published Health Services and Management Research: A 10-Year Review

PubMed Central

Weiner, Bryan J.; Amick, Halle R.; Lund, Jennifer L.; Lee, Shoou-Yih Daniel; Hoff, Timothy J.

2011-01-01

Over the past 10 years, the field of health services and management research has seen renewed interest in the use of qualitative research methods. This article examines the volume and characteristics of qualitative research articles published in nine major health services and management journals between 1998 and 2008. Qualitative research articles comprise 9% of research articles published in these journals. Although the publication rate of qualitative research articles has not kept pace with that of quantitative research articles, citation analysis suggests that qualitative research articles contribute comparably to the field’s knowledge base. A wide range of policy and management topics has been examined using qualitative methods. Case study designs, interviews, and documentary sources were the most frequently used methods. Half of qualitative research articles provided little or no detail about key aspects the study’s methods. Implications are discussed and recommendations are offered for promoting the publication of qualitative research. PMID:20675353

How qualitative research can contribute to research in the intensive care unit.

PubMed

Sinuff, Tasnim; Cook, Deborah J; Giacomini, Mita

2007-06-01

A qualitative research design can provide unique contributions to research in the intensive care unit. Qualitative research includes the entire process of research: the methodology (conceptualization of the research question, choosing the appropriate qualitative strategy, designing the protocol), methods (conducting the research using qualitative methods within the chosen qualitative strategy, analysis of the data, verification of the findings), and writing the narrative. The researcher is the instrument and the data are the participants' words and experiences that are collected and coded to present experiences, discover themes, or build theories. A number of strategies are available to conduct qualitative research and include grounded theory, phenomenology, case study, and ethnography. Qualitative methods can be used to understand complex phenomena that do not lend themselves to quantitative methods of formal hypothesis testing. Qualitative research may be used to gain insights about organizational and cultural issues within the intensive care unit and to improve our understanding of social interaction and processes of health care delivery. In this article, we outline the rationale for, and approaches to, using qualitative research to inform critical care issues. We provide an overview of qualitative methods available and how they can be used alone or in concert with quantitative methods. To illustrate how our understanding of social phenomena such as patient safety and behavior change has been enhanced we use recent qualitative studies in acute care medicine.

Teacher Educator's and Guidance Teachers' Evaluation of Student Teachers' Teaching Practice: A Qualitative Study = Procjena nastavne prakse studenata--buducih ucitelja--od mentora i savjetnika (kvalitativna studija)

ERIC Educational Resources Information Center

Göçer, Ali

2013-01-01

The aim of this study was to determine whether student teachers are sufficiently prepared for teaching practice in primary schools. In this study, student teachers' teaching practice in real classrooms was evaluated by using observation and interview methods. For this purpose, interviews were conducted with seven guidance teachers, and each…

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Using quantitative and qualitative data in health services research – what happens when mixed method findings conflict? [ISRCTN61522618

PubMed Central

Moffatt, Suzanne; White, Martin; Mackintosh, Joan; Howel, Denise

2006-01-01

Background In this methodological paper we document the interpretation of a mixed methods study and outline an approach to dealing with apparent discrepancies between qualitative and quantitative research data in a pilot study evaluating whether welfare rights advice has an impact on health and social outcomes among a population aged 60 and over. Methods Quantitative and qualitative data were collected contemporaneously. Quantitative data were collected from 126 men and women aged over 60 within a randomised controlled trial. Participants received a full welfare benefits assessment which successfully identified additional financial and non-financial resources for 60% of them. A range of demographic, health and social outcome measures were assessed at baseline, 6, 12 and 24 month follow up. Qualitative data were collected from a sub-sample of 25 participants purposively selected to take part in individual interviews to examine the perceived impact of welfare rights advice. Results Separate analysis of the quantitative and qualitative data revealed discrepant findings. The quantitative data showed little evidence of significant differences of a size that would be of practical or clinical interest, suggesting that the intervention had no impact on these outcome measures. The qualitative data suggested wide-ranging impacts, indicating that the intervention had a positive effect. Six ways of further exploring these data were considered: (i) treating the methods as fundamentally different; (ii) exploring the methodological rigour of each component; (iii) exploring dataset comparability; (iv) collecting further data and making further comparisons; (v) exploring the process of the intervention; and (vi) exploring whether the outcomes of the two components match. Conclusion The study demonstrates how using mixed methods can lead to different and sometimes conflicting accounts and, using this six step approach, how such discrepancies can be harnessed to interrogate each dataset more fully. Not only does this enhance the robustness of the study, it may lead to different conclusions from those that would have been drawn through relying on one method alone and demonstrates the value of collecting both types of data within a single study. More widespread use of mixed methods in trials of complex interventions is likely to enhance the overall quality of the evidence base. PMID:16524479

Positive Effects of a Stress Reduction Program Based on Mindfulness Meditation in Brazilian Nursing Professionals: Qualitative and Quantitative Evaluation.

PubMed

dos Santos, Teresa Maria; Kozasa, Elisa Harumi; Carmagnani, Isabel Sampaio; Tanaka, Luiza Hiromi; Lacerda, Shirley Silva; Nogueira-Martins, Luiz Antonio

2016-01-01

Mindfulness meditation has been shown to effectively mitigate the negative effects of stress among nursing professionals, but in countries like Brazil, these practices are relatively unexplored. To evaluate the effects of a Stress Reduction Program (SRP) including mindfulness and loving kindness meditation among nursing professionals working in a Brazilian hospital setting. Pilot study with a mixed model using quantitative and qualitative methods was used to evaluate a group of participants. The quantitative data were analyzed at three different time points: pre-intervention, post-intervention, and follow-up. The qualitative data were analyzed at post-intervention. Hospital São Paulo (Brazil). Sample 13 nursing professionals, including nurses, technicians, and nursing assistants working in a hospital. Participants underwent mindfulness and loving kindness meditation during a period of six weeks. Perceived Stress Scale (PSS), Maslach Burnout Inventory (MBI), Beck Depression Inventory (BDI), State-Trait Anxiety Inventory (STAI), Satisfaction With Life Scale (SWLS), Self-Compassion Scale (SCS), WHOQOL-BREF quality of life assessment, and Work Stress Scale (WSS). Qualitative data were collected via a group interview following six weeks participation in the SRP. The quantitative analyses revealed a significant reduction (P < .05) between pre-intervention and post-intervention scores for perceived stress, burnout, depression, and anxiety (trait). These variables showed no significant differences between post-intervention and follow-up scores. The WHOQOL-BREF revealed significant increase (P < .05) just in the physical and psychological domains at post-intervention scores, which remained at the follow-up. Qualitative results showed improvement in the reactivity to inner experience; a more attentive perception of internal and external experiences; greater attention and awareness of actions and attitudes at every moment; and a positive influence of the SRP in nursing activities. Copyright © 2016 Elsevier Inc. All rights reserved.

Using Qualitative Research Methods in Higher Education

ERIC Educational Resources Information Center

Savenye, Wilhelmina C.; Robinson, Rhonda S.

2005-01-01

Researchers investigating issues related to computing in higher education are increasingly using qualitative research methods to conduct their investigations. However, they may have little training or experience in qualitative research. The purpose of this paper is to introduce researchers to the appropriate use of qualitative methods. It begins…

Evaluation of a hydrophilic interaction liquid chromatography design space for sugars and sugar alcohols.

PubMed

Hetrick, Evan M; Kramer, Timothy T; Risley, Donald S

2017-03-17

Based on a column-screening exercise, a column ranking system was developed for sample mixtures containing any combination of 26 sugar and sugar alcohol analytes using 16 polar stationary phases in the HILIC mode with acetonitrile/water or acetone/water mobile phases. Each analyte was evaluated on the HILIC columns with gradient elution and the subsequent chromatography data was compiled into a statistical software package where any subset of the analytes can be selected and the columns are then ranked by the greatest separation. Since these analytes lack chromophores, aerosol-based detectors, including an evaporative light scattering detector (ELSD) and a charged aerosol detector (CAD) were employed for qualitative and quantitative detection. Example qualitative applications are provided to illustrate the practicality and efficiency of this HILIC column ranking. Furthermore, the design-space approach was used as a starting point for a quantitative method for the trace analysis of glucose in trehalose samples in a complex matrix. Knowledge gained from evaluating the design-space led to rapid development of a capable method as demonstrated through validation of the following parameters: specificity, accuracy, precision, linearity, limit of quantitation, limit of detection, and range. Copyright © 2017 Elsevier B.V. All rights reserved.

Identification of design features to enhance utilization and acceptance of systems for Internet-based decision support at the point of care.

PubMed

Gadd, C S; Baskaran, P; Lobach, D F

1998-01-01

Extensive utilization of point-of-care decision support systems will be largely dependent on the development of user interaction capabilities that make them effective clinical tools in patient care settings. This research identified critical design features of point-of-care decision support systems that are preferred by physicians, through a multi-method formative evaluation of an evolving prototype of an Internet-based clinical decision support system. Clinicians used four versions of the system--each highlighting a different functionality. Surveys and qualitative evaluation methodologies assessed clinicians' perceptions regarding system usability and usefulness. Our analyses identified features that improve perceived usability, such as telegraphic representations of guideline-related information, facile navigation, and a forgiving, flexible interface. Users also preferred features that enhance usefulness and motivate use, such as an encounter documentation tool and the availability of physician instruction and patient education materials. In addition to identifying design features that are relevant to efforts to develop clinical systems for point-of-care decision support, this study demonstrates the value of combining quantitative and qualitative methods of formative evaluation with an iterative system development strategy to implement new information technology in complex clinical settings.

Plethora or paucity: a systematic search and bibliometric study of the application and design of qualitative methods in nursing research 2008-2010.

PubMed

Ball, Elaine; McLoughlin, Moira; Darvill, Angela

2011-04-01

Qualitative methodology has increased in application and acceptability in all research disciplines. In nursing, it is appropriate that a plethora of qualitative methods can be found as nurses pose real-world questions to clinical, cultural and ethical issues of patient care (Johnson, 2007; Long and Johnson, 2007), yet the methods nurses readily use in pursuit of answers remains under intense scrutiny. One of the problems with qualitative methodology for nursing research is its place in the hierarchy of evidence (HOE); another is its comparison to the positivist constructs of what constitutes good research and the measurement of qualitative research against this. In order to position and strengthen its evidence base, nursing may well seek to distance itself from a qualitative perspective and utilise methods at the top of the HOE; yet given the relation of qualitative methods to nursing this would constrain rather than broaden the profession in search of answers and an evidence base. The comparison between qualitative and quantitative can be both mutually exclusive and rhetorical, by shifting the comparison this study takes a more reflexive position and critically appraises qualitative methods against the standards set by qualitative researchers. By comparing the design and application of qualitative methods in nursing over a two year period, the study examined how qualitative stands up to independent rather than comparative scrutiny. For the methods, a four-step mixed methods approach newly constructed by the first author was used to define the scope of the research question and develop inclusion criteria. 2. Synthesis tables were constructed to organise data, 3. Bibliometrics configured data. 4. Studies selected for inclusion in the review were critically appraised using a critical interpretive synthesis (Dixon-Woods et al., 2006). The paper outlines the research process as well as findings. Results showed of the 240 papers analysed, 27% used ad hoc or no references to qualitative; methodological terms such as thematic analysis or constant comparative methods were used inconsistently; qualitative was a catch-all panacea rather than a methodology with well-argued terms or contextual definition. Copyright © 2010 Elsevier Ltd. All rights reserved.

Improving Culturally Appropriate Care Using a Community-Based Participatory Research Approach: Evaluation of a Multicomponent Cultural Competency Training Program, Arkansas, 2015–2016

PubMed Central

Long, Christopher R.; Rowland, Brett; Moore, Sarah; Wilmoth, Ralph; Ayers, Britni

2017-01-01

Introduction The United States continues to become more racially and ethnically diverse, and racial/ethnic minority communities encounter sociocultural barriers to quality health care, including implicit racial/ethnic bias among health care providers. In response, health care organizations are developing and implementing cultural competency curricula. Using a community-based participatory research (CBPR) approach, we developed and evaluated a cultural competency training program to improve the delivery of culturally appropriate care in Marshallese and Hispanic communities. Methods We used a mixed-methods evaluation approach based on the Kirkpatrick model of training evaluation. We collected quantitative evaluation data immediately after each training session (March 19, 2015–November 30, 2016) and qualitative data about implementation at 2 points: immediately after each session and 6 months after training. Individuals and organizational units provided qualitative data. Results We delivered 1,250 units of in-person training at 25 organizations. Participants reported high levels of changes in knowledge (91.2%), competence (86.6%), and performance (87.2%) as a result of the cultural competency training. Organizations reported making policy and environmental changes. Conclusion Initial outcomes demonstrate the value of developing and implementing cultural competency training programs using a CBPR approach. Additional research is needed to determine the effect on long-term patient outcomes. PMID:28771402

78 FR 77679 - Agency Information Collection Activities: Submission for OMB Review; Comment Request Re...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-24

... providers through qualitative research methods such as focus groups, in-depth interviews, and/or qualitative... qualitative research methods will also contribute to the FDIC's understanding of how consumers, including... collection method based on the objectives of each qualitative research effort. It is likely that each...

A new qualitative pattern classification of shear wave elastograghy for solid breast mass evaluation.

PubMed

Cong, Rui; Li, Jing; Guo, Song

2017-02-01

To examine the efficacy of qualitative shear wave elastography (SWE) in the classification and evaluation of solid breast masses, and to compare this method with conventional ultrasonograghy (US), quantitative SWE parameters and qualitative SWE classification proposed before. From April 2015 to March 2016, 314 consecutive females with 325 breast masses who decided to undergo core needle biopsy and/or surgical biopsy were enrolled. Conventional US and SWE were previously performed in all enrolled subjects. Each mass was classified by two different qualitative classifications. One was established in our study, herein named the Qual1. Qual1 could classify the SWE images into five color patterns by the visual evaluations: Color pattern 1 (homogeneous pattern); Color pattern 2 (comparative homogeneous pattern); Color pattern 3 (irregularly heterogeneous pattern); Color pattern 4 (intralesional echo pattern); and Color pattern 5 (the stiff rim sign pattern). The second qualitative classification was named Qual2 here, and included a four-color overlay pattern classification (Tozaki and Fukuma, Acta Radiologica, 2011). The Breast Imaging Reporting and Data System (BI-RADS) assessment and quantitative SWE parameters were recorded. Diagnostic performances of conventional US, SWE parameters, and combinations of US and SWE parameters were compared. With pathological results as the gold standard, of the 325 examined breast masses, 139 (42.77%) samples were malignant and 186 (57.23%) were benign. The Qual1 showed a higher Az value than the Qual2 and quantitative SWE parameters (all P<0.05). When applying Qual1=Color pattern 1 for downgrading and Qual1=Color pattern 5 for upgrading the BI-RADS categories, we obtained the highest Az value (0.951), and achieved a significantly higher specificity (86.56%, P=0.002) than that of the US (81.18%) with the same sensitivity (94.96%). The qualitative classification proposed in this study may be representative of SWE parameters and has potential to be relevant assistance in breast mass diagnoses. Copyright © 2016. Published by Elsevier B.V.

Portfolio as a Teaching Method: A Capstone Project to Promote Recognition of Professional Growth

ERIC Educational Resources Information Center

Wolffe, Robert; Crowe, Helja Antola; Evens, Wayne; McConnaughay, Kelly

2013-01-01

A reflective portfolio as a capstone assignment was selected to accomplish recognition by teachers completing a science, technology, mathematics, engineering master's program for elementary teachers about their professional and personal changes and to provide program evaluators additional qualitative data regarding attainment of program goals. As…

Peer Instruction: An Evaluation of Its Theory, Application, and Contribution

ERIC Educational Resources Information Center

Gok, Tolga; Gok, Ozge

2017-01-01

Many qualitative and quantitative studies performed on peer instruction based on interactive engagement method used in many different disciplines and courses were reviewed in the present study. The researchers examined the effects of peer instruction on students' cognitive skills (conceptual learning, problem solving, reasoning ability, etc.) and…

What Canadian Youth Tell Us about Disclosing Abuse

ERIC Educational Resources Information Center

Ungar, Michael; Tutty, Leslie M.; McConnell, Sheri; Barter, Ken; Fairholm, Judi

2009-01-01

Objective: To report findings from a study of anonymous disclosures of abuse experiences among a national sample of youth in Canada who participated in violence prevention programming. Methods: A qualitative analysis was done of a purposeful sample of 1,099 evaluation forms completed following Red Cross RespectED violence prevention programming…

Social Validity: Perceptions of Check and Connect with Early Literacy Support

ERIC Educational Resources Information Center

Miltich Lyst, Aimee; Gabriel, Stacey; O'Shaughnessy, Tam E.; Meyers, Joel; Meyers, Barbara

2005-01-01

This article underscores the potential advantages of qualitative methods to illustrate the depth and complexity of social validity. This investigation evaluates the social validity of Check and Connect with Early Literacy Support (CCEL), through the perspectives of teachers and caregivers whose children participated in the intervention. Teachers…

Using Reflection Documents to Assess Student Learning

ERIC Educational Resources Information Center

Powell, Larkin A.

2009-01-01

Traditional assessment methods such as tests and essays may not be adequate to evaluate students' ability to solve problems and think critically. I developed a qualitative assessment technique for a junior-level Wildlife Management Techniques course that incorporated written responses in a pre- and post-course reflection exercise. I provided the…

Ecological Development and Validation of a Music Performance Rating Scale for Five Instrument Families

ERIC Educational Resources Information Center

Wrigley, William J.; Emmerson, Stephen B.

2013-01-01

This study investigated ways to improve the quality of music performance evaluation in an effort to address the accountability imperative in tertiary music education. An enhanced scientific methodology was employed incorporating ecological validity and using recognized qualitative methods involving grounded theory and quantitative methods…

Improving Intelligibility: Guided Reflective Journals in Action

ERIC Educational Resources Information Center

Lear, Emmaline L.

2014-01-01

This study explores the effectiveness of guided reflective journals to improve intelligibility in a Japanese higher educational context. Based on qualitative and quantitative methods, the paper evaluates changes in speech over the duration of one semester. In particular, this study focuses on changes in prosodic features such as stress, intonation…

Content Appraisal as a Method for Measuring the Effectiveness & Usability of Online Content

ERIC Educational Resources Information Center

Nadeau, Jenifer; Heidorn, Neely; Broady, Nick; Whittle, Jennifer

2012-01-01

Content appraisal is a simple, qualitative system to identify modifications to make website material more useful to clientele. This system provides a comprehensive evaluation of content, focuses on content strategy, identifies weaknesses, and provides recommendations for improvement. The criteria examined included knowledge level,…

Pedagogical Documentation and Its Relation to Everyday Activities in Early Years

ERIC Educational Resources Information Center

Rintakorpi, Kati; Reunamo, Jyrki

2017-01-01

Documentation in early childhood education and care (ECEC) institutions has been developed for decades in various contexts. Today, documentation is preferred as an inclusive method of evaluating, planning, and developing ECEC in the curricula of many countries. Qualitative research on documentation has increased in past years, but quantitative…

Educational Innovations as Staff Development: An Evaluative Approach.

ERIC Educational Resources Information Center

Marcelo, Carlos; And Others

1996-01-01

Reports a study that analyzed the processes of educational innovation in seven projects in the Andalusian region of Spain. Using qualitative and quantitative methods, the study determined that the quality of the impact of innovation on students, teachers, schools, and communities was determined by the original source, the relationship to perceived…

Secondary Teachers' Understanding and Use of Reflection: An Exploratory Study

ERIC Educational Resources Information Center

Laverick, Vincent T.

2017-01-01

As teachers are examining methods to improve their practices due to teacher evaluation systems that incorporate student growth, a renewed focus has been placed on teacher effectiveness. Because reflective teachers have been shown to be more effective, this qualitative study examined the understanding of reflection among five secondary school…

An Analysis of the Effect of Mobile Learning on Lebanese Higher Education

ERIC Educational Resources Information Center

Jabbour, Khayrazad Kari

2014-01-01

This research explores the effect of mobile technology in Lebanese higher education classrooms. Three components were utilized to evaluate the impact: student attitudes, student achievements, and educational process. This study used both quantitative and qualitative methods to examine the research questions. The main sources for data collection…

Evaluation of a large scale implementation of disease management programmes in various Dutch regions: a study protocol.

PubMed

Lemmens, Karin M M; Rutten-Van Mölken, Maureen P M H; Cramm, Jane M; Huijsman, Robbert; Bal, Roland A; Nieboer, Anna P

2011-01-10

Disease management programmes (DMPs) have been developed to improve effectiveness and economic efficiency within chronic care delivery by combining patient-related, professional-directed, and organisational interventions. The benefits of DMPs within different settings, patient groups, and versions remain unclear. In this article we propose a protocol to evaluate a range of current DMPs by capturing them in a single conceptual framework, employing comparable structure, process, and outcome measures, and combining qualitative and quantitative research methods. To assess DMP effectiveness a practical clinical trial will be conducted. Twenty-two disease management experiments will be studied in various Dutch regions consisting of a variety of collaborations between organisations and/or professionals. Patient cohorts include those with cardiovascular diseases, chronic obstructive pulmonary disease, diabetes, stroke, depression, psychotic diseases, and eating disorders. Our methodological approach combines qualitative and quantitative research methods to enable a comprehensive evaluation of complex programmes. Process indicators will be collected from health care providers' data registries and measured via physician and staff questionnaires. Patient questionnaires include health care experiences, health care utilisation, and quality of life. Qualitative data will be gathered by means of interviews and document analysis for an in depth description of project interventions and the contexts in which DMPs are embedded, and an ethnographic process evaluation in five DMPs. Such a design will provide insight into ongoing DMPs and demonstrate which elements of the intervention are potentially (cost)-effective for which patient populations. It will also enable sound comparison of the results of the different programmes. The study will lead to a better understanding of (1) the mechanisms of disease management, (2) the feasibility, and cost-effectiveness of a disease management approach to improving health care, and (3) the factors that determine success and failure of DMPs. Our study results will be relevant to decision makers and managers who confront the challenge of implementing and integrating DMPs into the health care system. Moreover, it will contribute to the search for methods to evaluate complex healthcare interventions.

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

Students Explaining Science—Assessment of Science Communication Competence

NASA Astrophysics Data System (ADS)

Kulgemeyer, Christoph; Schecker, Horst

2013-12-01

Science communication competence (SCC) is an important educational goal in the school science curricula of several countries. However, there is a lack of research about the structure and the assessment of SCC. This paper specifies the theoretical framework of SCC by a competence model. We developed a qualitative assessment method for SCC that is based on an expert-novice dialog: an older student (explainer, expert) explains a physics phenomenon to a younger peer (addressee, novice) in a controlled test setting. The explanations are video-recorded and analysed by qualitative content analysis. The method was applied in a study with 46 secondary school students as explainers. Our aims were (a) to evaluate whether our model covers the relevant features of SCC, (b) to validate the assessment method and (c) to find characteristics of addressee-adequate explanations. A performance index was calculated to quantify the explainers' levels of competence on an ordinal scale. We present qualitative and quantitative evidence that the index is adequate for assessment purposes. It correlates with results from a written SCC test and a perspective taking test (convergent validity). Addressee-adequate explanations can be characterized by use of graphical representations and deliberate switches between scientific and everyday language.

Sustainability of three modified soil conservation methods in agriculture area

NASA Astrophysics Data System (ADS)

Setiawan, M. A.; Sara, F. H.; Christanto, N.; Sartohadi, J.; Samodra, G.; Widicahyono, A.; Ardiana, N.; Widiyati, C. N.; Astuti, E. M.; Martha, G. K.; Malik, R. F.; Sambodo, A. P.; Rokhmaningtyas, R. P.; Swastanto, G. A.; Gomez, C.

2018-04-01

Recent innovations in soil conservation methods do not present any breakthrough. Providing more attractive soil conservation methods from the farmer’s perspective is however still of critical importance. Contributing to this soil research gap we attempt to evaluate the sustainable use of three modified conservation methods, namely JALAPA (Jala Sabut Kelapa - geotextile made of coconut fibres), wood sediment trap, and polybag system compared to traditional tillage without conservation method. This research provides both qualitative and quantitative analysis on the performance of each conservation measures. Therefore, in addition to the total sediment yield value and investment cost – as quantitative analysis, we also evaluate qualitatively the indicator of soil loss, installation, maintenance, and the durability of conservation medium. Those criteria define the sustainability use of each conservation method. The results show that JALAPA is the most effective method for controlling soil loss, but it also requires the most expensive cost for installation. However, our finding confirms that geotextile is sensitive to sun heating by which the coconut fibre can become dry and shrink. Wood sediment trap is the cheapest and easiest to install; however it is easily damaged by termite. Polybag method results in the highest productivity, but requires more time during the first installation. In terms of the farmer’s perspective, soil conservation using polybag system was the most accepted technique due to its high benefits; even if it is less effective at reducing soil loss compared to JALAPA.

Simple and ultra-fast recognition and quantitation of compounded monoclonal antibodies: Application to flow injection analysis combined to UV spectroscopy and matching method.

PubMed

Jaccoulet, E; Schweitzer-Chaput, A; Toussaint, B; Prognon, P; Caudron, E

2018-09-01

Compounding of monoclonal antibody (mAbs) constantly increases in hospital. Quality control (QC) of the compounded mAbs based on quantification and identification is required to prevent potential errors and fast method is needed to manage outpatient chemotherapy administration. A simple and ultra-fast (less than 30 s) method using flow injection analysis associated to least square matching method issued from the analyzer software was performed and evaluated for the routine hospital QC of three compounded mAbs: bevacizumab, infliximab and rituximab. The method was evaluated through qualitative and quantitative parameters. Preliminary analysis of the UV absorption and second derivative spectra of the mAbs allowed us to adapt analytical conditions according to the therapeutic range of the mAbs. In terms of quantitative QC, linearity, accuracy and precision were assessed as specified in ICH guidelines. Very satisfactory recovery was achieved and the RSD (%) of the intermediate precision were less than 1.1%. Qualitative analytical parameters were also evaluated in terms of specificity, sensitivity and global precision through a matrix of confusion. Results showed to be concentration and mAbs dependant and excellent (100%) specificity and sensitivity were reached within specific concentration range. Finally, routine application on "real life" samples (n = 209) from different batch of the three mAbs complied with the specifications of the quality control i.e. excellent identification (100%) and ± 15% of targeting concentration belonging to the calibration range. The successful use of the combination of second derivative spectroscopy and partial least square matching method demonstrated the interest of FIA for the ultra-fast QC of mAbs after compounding using matching method. Copyright © 2018 Elsevier B.V. All rights reserved.

Critically appraising qualitative research: a guide for clinicians more familiar with quantitative techniques.

PubMed

Kisely, Stephen; Kendall, Elizabeth

2011-08-01

Papers using qualitative methods are increasingly common in psychiatric journals. This overview is an introduction to critically appraising a qualitative paper for clinicians who are more familiar with quantitative methods. Qualitative research uses data from interviews (semi-structured or unstructured), focus groups, observations or written materials. Data analysis is inductive, allowing meaning to emerge from the data, rather than the more deductive, hypothesis centred approach of quantitative research. This overview compares and contrasts quantitative and qualitative research methods. Quantitative concepts such as reliability, validity, statistical power, bias and generalisability have qualitative equivalents. These include triangulation, trustworthiness, saturation, reflexivity and applicability. Reflexivity also shares features of transference. Qualitative approaches include: ethnography, action-assessment, grounded theory, case studies and mixed methods. Qualitative research can complement quantitative approaches. An understanding of both is useful in critically appraising the psychiatric literature.

Qualitative and quantitative evaluation of human dental enamel after bracket debonding: a noncontact three-dimensional optical profilometry analysis.

PubMed

Ferreira, Fabiano G; Nouer, Darcy F; Silva, Nelson P; Garbui, Ivana U; Correr-Sobrinho, Lourenço; Nouer, Paulo R A

2014-09-01

The aim of this study was to undertake a qualitative and quantitative evaluation of changes on enamel surfaces after debonding of brackets followed by finishing procedures, using a high-resolution three-dimensional optical profiler and to investigate the accuracy of the technique. The labial surfaces of 36 extracted upper central incisors were examined. Before bonding, the enamel surfaces were subjected to profilometry, recording four amplitude parameters. Brackets were then bonded using two types of light-cured orthodontic adhesive: composite resin and resin-modified glass ionomer cement. Finishing was performed by three different methods: pumice on a rubber cup, fine and ultrafine aluminum oxide discs, and microfine diamond cups followed by silicon carbide brushes. The samples were subsequently re-analyzed by profilometry. Wilcoxon signed-rank test, Kruskal-Wallis test (p < 0.05) and a posteriori Mann-Whitney U test with Bonferroni correction (p < 0.0167) revealed a significant reduction of enamel roughness when diamond cups followed by silicon carbide brushes were used to finish surfaces that had remnants of resin-modified glass ionomer adhesive and when pumice was used to finish surfaces that had traces of composite resin. Enamel loss was minimal. The 3D optical profilometry technique was able to provide accurate qualitative and quantitative assessment of changes on the enamel surface after debonding. Morphological changes in the topography of dental surfaces, especially if related to enamel loss and roughness, are of considerable clinical importance. The quantitative evaluation method used herein enables a more comprehensive understanding of the effects of orthodontic bonding on teeth.

Field Worker Evaluation of Dengue Vector Surveillance Methods: Factors That Determine Perceived Ease, Difficulty, Value, and Time Effectiveness in Australia and Malaysia.

PubMed

Azil, Aishah H; Ritchie, Scott A; Williams, Craig R

2015-10-01

This qualitative study aimed to describe field worker perceptions, evaluations of worth, and time costs of routine dengue vector surveillance methods in Cairns (Australia), Kuala Lumpur and Petaling District (Malaysia). In Cairns, the BG-Sentinel trap is a favored method for field workers because of its user-friendliness, but is not as cost-efficient as the sticky ovitrap. In Kuala Lumpur, the Mosquito Larvae Trapping Device is perceived as a solution for the inaccessibility of premises to larval surveys. Nonetheless, the larval survey method is retained in Malaysia for prompt detection of dengue vectors. For dengue vector surveillance to be successful, there needs to be not only technical, quantitative evaluations of method performance but also an appreciation of how amenable field workers are to using particular methods. Here, we report novel field worker perceptions of dengue vector surveillance methods in addition to time analysis for each method. © 2014 APJPH.

Evaluating the dynamic response of in-flight thrust calculation techniques during throttle transients

NASA Technical Reports Server (NTRS)

Ray, Ronald J.

1994-01-01

New flight test maneuvers and analysis techniques for evaluating the dynamic response of in-flight thrust models during throttle transients have been developed and validated. The approach is based on the aircraft and engine performance relationship between thrust and drag. Two flight test maneuvers, a throttle step and a throttle frequency sweep, were developed and used in the study. Graphical analysis techniques, including a frequency domain analysis method, were also developed and evaluated. They provide quantitative and qualitative results. Four thrust calculation methods were used to demonstrate and validate the test technique. Flight test applications on two high-performance aircraft confirmed the test methods as valid and accurate. These maneuvers and analysis techniques were easy to implement and use. Flight test results indicate the analysis techniques can identify the combined effects of model error and instrumentation response limitations on the calculated thrust value. The methods developed in this report provide an accurate approach for evaluating, validating, or comparing thrust calculation methods for dynamic flight applications.

Qualitative research methods for medical educators.

PubMed

Hanson, Janice L; Balmer, Dorene F; Giardino, Angelo P

2011-01-01

This paper provides a primer for qualitative research in medical education. Our aim is to equip readers with a basic understanding of qualitative research and prepare them to judge the goodness of fit between qualitative research and their own research questions. We provide an overview of the reasons for choosing a qualitative research approach and potential benefits of using these methods for systematic investigation. We discuss developing qualitative research questions, grounding research in a philosophical framework, and applying rigorous methods of data collection, sampling, and analysis. We also address methods to establish the trustworthiness of a qualitative study and introduce the reader to ethical concerns that warrant special attention when planning qualitative research. We conclude with a worksheet that readers may use for designing a qualitative study. Medical educators ask many questions that carefully designed qualitative research would address effectively. Careful attention to the design of qualitative studies will help to ensure credible answers that will illuminate many of the issues, challenges, and quandaries that arise while doing the work of medical education. Copyright © 2011 Academic Pediatric Association. All rights reserved.

Prediction of pump cavitation performance

NASA Technical Reports Server (NTRS)

Moore, R. D.

1974-01-01

A method for predicting pump cavitation performance with various liquids, liquid temperatures, and rotative speeds is presented. Use of the method requires that two sets of test data be available for the pump of interest. Good agreement between predicted and experimental results of cavitation performance was obtained for several pumps operated in liquids which exhibit a wide range of properties. Two cavitation parameters which qualitatively evaluate pump cavitation performance are also presented.

The Implementation of an MCDM Tool for the Acquisition of Military Equipment

DTIC Science & Technology

2009-10-01

combined use of two different types of outranking methods PROMETHEE and ORESTE. The choice of all technical parameters is assisted by interactive...the Royal Military Academy to use PROMETHEE or ORESTE outranking methods not only as part of teaching OR (Operation Research) but also as consultants... PROMETHEE considers that all evaluations of criteria are treated as purely quantitative where ORESTE only allows rankings (qualitative criteria). The

A three-dimensional finite-volume Eulerian-Lagrangian Localized Adjoint Method (ELLAM) for solute-transport modeling

USGS Publications Warehouse

Heberton, C.I.; Russell, T.F.; Konikow, Leonard F.; Hornberger, G.Z.

2000-01-01

This report documents the U.S. Geological Survey Eulerian-Lagrangian Localized Adjoint Method (ELLAM) algorithm that solves an integral form of the solute-transport equation, incorporating an implicit-in-time difference approximation for the dispersive and sink terms. Like the algorithm in the original version of the U.S. Geological Survey MOC3D transport model, ELLAM uses a method of characteristics approach to solve the transport equation on the basis of the velocity field. The ELLAM algorithm, however, is based on an integral formulation of conservation of mass and uses appropriate numerical techniques to obtain global conservation of mass. The implicit procedure eliminates several stability criteria required for an explicit formulation. Consequently, ELLAM allows large transport time increments to be used. ELLAM can produce qualitatively good results using a small number of transport time steps. A description of the ELLAM numerical method, the data-input requirements and output options, and the results of simulator testing and evaluation are presented. The ELLAM algorithm was evaluated for the same set of problems used to test and evaluate Version 1 and Version 2 of MOC3D. These test results indicate that ELLAM offers a viable alternative to the explicit and implicit solvers in MOC3D. Its use is desirable when mass balance is imperative or a fast, qualitative model result is needed. Although accurate solutions can be generated using ELLAM, its efficiency relative to the two previously documented solution algorithms is problem dependent.

Evaluation of an innovative tool for child sexual abuse education.

PubMed

Davis, Deborah Winders; Pressley-McGruder, Gloria; Jones, V Faye; Potter, Deborah; Rowland, Michael; Currie, Melissa; Gale, Bruce

2013-01-01

Child sexual abuse poses a serious threat to public health and is often unreported, unrecognized, and untreated. Prevention, early recognition, and treatment are critically important to reduce long-term effects. Little data are available on effective methods of preventing child sexual abuse. The current research demonstrates a unique approach to promoting awareness and stimulating discussion about child sexual abuse. Qualitative methods have rarely been used to study child sexual abuse prevention. Qualitative inductive analyses of interviews from 20 key informants identified both positive and negative assessments with six emergent themes. The themes revealed inherent tensions in using narrative accounts to represent the complex cultural context within which child sexual abuse occurs. More research is needed, but the program shows potential as a methodology to raise awareness of child sexual abuse.

Flame Movement and Pressure Development in an Engine Cylinder

NASA Technical Reports Server (NTRS)

Marvin, Charles F , Jr; Best, Robert D

1932-01-01

This investigation describes a visual method for making stroboscopic observations, through a large number of small windows, of the spread of flame throughout the combustion chamber of a gasoline engine. Data, secured by this method on a small engine burning gaseous fuels, are given to show the effects of mixture ratio, spark advance, engine speed, charge density, degree of dilution, compression ratio, and fuel composition on flame movement in the cylinder. Partial indicator diagrams showing pressure development during the combustion period are included. Although present knowledge is not sufficient to permit qualitative evaluation of the separate effects on flame movement of chemical reaction velocity, thermal expansion of burned gases, resonance, turbulence, and piston movement, the qualitative influence of certain of these factors on some of the diagrams is indicated.

Qualitative Research in Group Work: Status, Synergies, and Implementation

ERIC Educational Resources Information Center

Rubel, Deborah; Okech, Jane E. Atieno

2017-01-01

The article aims to advance the use of qualitative research methods to understand group work. The first part of this article situates the use of qualitative research methods in relationship to group work research. The second part examines recent qualitative group work research using a framework informed by scoping and systematic review methods and…

The evaluation of (social-)psychological comfort in clothing, a possible approach

NASA Astrophysics Data System (ADS)

Matté, L. L.; Broega, A. C.

2017-10-01

This paper presents the first results of a PhD research on psychological comfort of clothing. In order to understand and conceptualize the psychological aspects of clothing comfort, a variation of the Delphi Method was used to seek opinions from experts. This method was chosen because of its consensus-building features. The results were obtained from a qualitative text analysis, conducted over the experts’ responses to the first round of questions. The analytic process shed some light on the formation of the psychological comfort concept as well as the potential attributes to be evaluated when assessing this comfort dimension.

Toward a Mixed-Methods Research Approach to Content Analysis in The Digital Age: The Combined Content-Analysis Model and its Applications to Health Care Twitter Feeds

PubMed Central

Hamad, Eradah O; Savundranayagam, Marie Y; Holmes, Jeffrey D; Kinsella, Elizabeth Anne

2016-01-01

Background Twitter’s 140-character microblog posts are increasingly used to access information and facilitate discussions among health care professionals and between patients with chronic conditions and their caregivers. Recently, efforts have emerged to investigate the content of health care-related posts on Twitter. This marks a new area for researchers to investigate and apply content analysis (CA). In current infodemiology, infoveillance and digital disease detection research initiatives, quantitative and qualitative Twitter data are often combined, and there are no clear guidelines for researchers to follow when collecting and evaluating Twitter-driven content. Objective The aim of this study was to identify studies on health care and social media that used Twitter feeds as a primary data source and CA as an analysis technique. We evaluated the resulting 18 studies based on a narrative review of previous methodological studies and textbooks to determine the criteria and main features of quantitative and qualitative CA. We then used the key features of CA and mixed-methods research designs to propose the combined content-analysis (CCA) model as a solid research framework for designing, conducting, and evaluating investigations of Twitter-driven content. Methods We conducted a PubMed search to collect studies published between 2010 and 2014 that used CA to analyze health care-related tweets. The PubMed search and reference list checks of selected papers identified 21 papers. We excluded 3 papers and further analyzed 18. Results Results suggest that the methods used in these studies were not purely quantitative or qualitative, and the mixed-methods design was not explicitly chosen for data collection and analysis. A solid research framework is needed for researchers who intend to analyze Twitter data through the use of CA. Conclusions We propose the CCA model as a useful framework that provides a straightforward approach to guide Twitter-driven studies and that adds rigor to health care social media investigations. We provide suggestions for the use of the CCA model in elder care-related contexts. PMID:26957477

Including mixed methods research in systematic reviews: examples from qualitative syntheses in TB and malaria control.

PubMed

Atkins, Salla; Launiala, Annika; Kagaha, Alexander; Smith, Helen

2012-04-30

Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research.

Evaluation of Patient Centered Medical Home Practice Transformation Initiatives

PubMed Central

Crabtree, Benjamin F.; Chase, Sabrina M.; Wise, Christopher G.; Schiff, Gordon D.; Schmidt, Laura A.; Goyzueta, Jeanette R.; Malouin, Rebecca A.; Payne, Susan M. C.; Quinn, Michael T.; Nutting, Paul A.; Miller, William L.; Jaén, Carlos Roberto

2011-01-01

Background The patient-centered medical home (PCMH) has become a widely cited solution to the deficiencies in primary care delivery in the United States. To achieve the magnitude of change being called for in primary care, quality improvement interventions must focus on whole-system redesign, and not just isolated parts of medical practices. Methods Investigators participating in 9 different evaluations of Patient Centered Medical Home implementation shared experiences, methodological strategies, and evaluation challenges for evaluating primary care practice redesign. Results A year-long iterative process of sharing and reflecting on experiences produced consensus on 7 recommendations for future PCMH evaluations: (1) look critically at models being implemented and identify aspects requiring modification; (2) include embedded qualitative and quantitative data collection to detail the implementation process; (3) capture details concerning how different PCMH components interact with one another over time; (4) understand and describe how and why physician and staff roles do, or do not evolve; (5) identify the effectiveness of individual PCMH components and how they are used; (6) capture how primary care practices interface with other entities such as specialists, hospitals, and referral services; and (7) measure resources required for initiating and sustaining innovations. Conclusions Broad-based longitudinal, mixed-methods designs that provide for shared learning among practice participants, program implementers, and evaluators are necessary to evaluate the novelty and promise of the PCMH model. All PCMH evaluations should as comprehensive as possible, and at a minimum should include a combination of brief observations and targeted qualitative interviews along with quantitative measures. PMID:21079525

Methods for assessing geodiversity

NASA Astrophysics Data System (ADS)

Zwoliński, Zbigniew; Najwer, Alicja; Giardino, Marco

2017-04-01

The accepted systematics of geodiversity assessment methods will be presented in three categories: qualitative, quantitative and qualitative-quantitative. Qualitative methods are usually descriptive methods that are suited to nominal and ordinal data. Quantitative methods use a different set of parameters and indicators to determine the characteristics of geodiversity in the area being researched. Qualitative-quantitative methods are a good combination of the collection of quantitative data (i.e. digital) and cause-effect data (i.e. relational and explanatory). It seems that at the current stage of the development of geodiversity research methods, qualitative-quantitative methods are the most advanced and best assess the geodiversity of the study area. Their particular advantage is the integration of data from different sources and with different substantive content. Among the distinguishing features of the quantitative and qualitative-quantitative methods for assessing geodiversity are their wide use within geographic information systems, both at the stage of data collection and data integration, as well as numerical processing and their presentation. The unresolved problem for these methods, however, is the possibility of their validation. It seems that currently the best method of validation is direct filed confrontation. Looking to the next few years, the development of qualitative-quantitative methods connected with cognitive issues should be expected, oriented towards ontology and the Semantic Web.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example.

PubMed

O'Donnell, Catherine A; Mair, Frances S; Dowrick, Christopher; Brún, Mary O'Reilly-de; Brún, Tomas de; Burns, Nicola; Lionis, Christos; Saridaki, Aristoula; Papadakaki, Maria; Muijsenbergh, Maria van den; Weel-Baumgarten, Evelyn van; Gravenhorst, Katja; Cooper, Lucy; Princz, Christine; Teunissen, Erik; Mareeuw, Francine van den Driessen; Vlahadi, Maria; Spiegel, Wolfgang; MacFarlane, Anne

2017-08-21

To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study. Participatory research approach using qualitative methods. Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland. RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers. Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session. Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE's methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork.Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data. A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Advancing the study of violence against women using mixed methods: integrating qualitative methods into a quantitative research program.

PubMed

Testa, Maria; Livingston, Jennifer A; VanZile-Tamsen, Carol

2011-02-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women's sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided.

Qualitative methods: what are they and why use them?

PubMed Central

Sofaer, S

1999-01-01

OBJECTIVE: To provide an overview of reasons why qualitative methods have been used and can be used in health services and health policy research, to describe a range of specific methods, and to give examples of their application. DATA SOURCES: Classic and contemporary descriptions of the underpinnings and applications of qualitative research methods and studies that have used such methods to examine important health services and health policy issues. PRINCIPAL FINDINGS: Qualitative research methods are valuable in providing rich descriptions of complex phenomena; tracking unique or unexpected events; illuminating the experience and interpretation of events by actors with widely differing stakes and roles; giving voice to those whose views are rarely heard; conducting initial explorations to develop theories and to generate and even test hypotheses; and moving toward explanations. Qualitative and quantitative methods can be complementary, used in sequence or in tandem. The best qualitative research is systematic and rigorous, and it seeks to reduce bias and error and to identify evidence that disconfirms initial or emergent hypotheses. CONCLUSIONS: Qualitative methods have much to contribute to health services and health policy research, especially as such research deals with rapid change and develops a more fully integrated theory base and research agenda. However, the field must build on the best traditions and techniques of qualitative methods and must recognize that special training and experience are essential to the application of these methods. PMID:10591275

Indicators of Family Care for Development for Use in Multicountry Surveys

PubMed Central

Kariger, Patricia; Engle, Patrice; Britto, Pia M. Rebello; Sywulka, Sara M.; Menon, Purnima

2012-01-01

Indicators of family care for development are essential for ascertaining whether families are providing their children with an environment that leads to positive developmental outcomes. This project aimed to develop indicators from a set of items, measuring family care practices and resources important for caregiving, for use in epidemiologic surveys in developing countries. A mixed method (quantitative and qualitative) design was used for item selection and evaluation. Qualitative and quantitative analyses were conducted to examine the validity of candidate items in several country samples. Qualitative methods included the use of global expert panels to identify and evaluate the performance of each candidate item as well as in-country focus groups to test the content validity of the items. The quantitative methods included analyses of item-response distributions, using bivariate techniques. The selected items measured two family care practices (support for learning/stimulating environment and limit-setting techniques) and caregiving resources (adequacy of the alternate caregiver when the mother worked). Six play-activity items, indicative of support for learning/stimulating environment, were included in the core module of UNICEF's Multiple Cluster Indictor Survey 3. The other items were included in optional modules. This project provided, for the first time, a globally-relevant set of items for assessing family care practices and resources in epidemiological surveys. These items have multiple uses, including national monitoring and cross-country comparisons of the status of family care for development used globally. The obtained information will reinforce attention to efforts to improve the support for development of children. PMID:23304914

The use of mixed methods in studying a chronic illness.

PubMed

Jason, Leonard A; Reed, Jordan

This article explores mixed methods approaches with an illness called Myalgic Encephalomyelitis (ME) and Chronic Fatigue Syndrome (CFS). Qualitative and Quantitative data were used to investigate the epidemiology of this illness, as well as explore attributions based on the name of the illness, and finally treatment approaches. In each of the domains within the ME and CFS research reviewed, our analyses were richer and our findings ultimately more impactful when we integrated qualitative and quantitative research methods. The use of a multiphase mixed methods research program provided our team unique vantage points for better understanding social and community issues involving this controversial chronic illness. Further, this approach allowed us to implement the insights gained through an advocacy lens to change policy, recommend and evaluate treatments, and amplify voices within the patient population. In this way, we believe that the practice of methodological pluralism is especially applicable and effective to the study of chronic illness, and believe other investigators will benefit from the use of these approaches with similar disenfranchised and unfairly treated populations.

Qualitative Methods in Patient-Centered Outcomes Research.

PubMed

Vandermause, Roxanne; Barg, Frances K; Esmail, Laura; Edmundson, Lauren; Girard, Samantha; Perfetti, A Ross

2017-02-01

The Patient-Centered Outcomes Research Institute (PCORI), created to fund research guided by patients, caregivers, and the broader health care community, offers a new research venue. Many (41 of 50) first funded projects involved qualitative research methods. This study was completed to examine the current state of the science of qualitative methodologies used in PCORI-funded research. Principal investigators participated in phenomenological interviews to learn (a) how do researchers using qualitative methods experience seeking funding for, implementing and disseminating their work; and (b) how may qualitative methods advance the quality and relevance of evidence for patients? Results showed the experience of doing qualitative research in the current research climate as "Being a bona fide qualitative researcher: Staying true to research aims while negotiating challenges," with overlapping patterns: (a) researching the elemental, (b) expecting surprise, and (c) pushing boundaries. The nature of qualitative work today was explicitly described and is rendered in this article.

How are qualitative methods used in diabetes research? A 30-year systematic review.

PubMed

Hennink, Monique M; Kaiser, Bonnie N; Sekar, Swathi; Griswold, Emily P; Ali, Mohammed K

2017-02-01

We aimed to describe how qualitative methods are used in global research on diabetes and identify opportunities whereby qualitative methods could further benefit our understanding of the human experience of diabetes and interventions to address it. We conducted a systematic review of National Library of Medicine, EMBASE, and Web of Science electronic databases to identify original research articles that used qualitative methods to study diabetes between 1980 and 2011. We identified 554 eligible articles and categorised these by geographic region, year of publication, study population, study design, research question, qualitative data collection methods, and journal type. Results show low use of qualitative methods in diabetes research over the past 30 years. The majority of articles (75%) reported using substantive qualitative research, while mixed-methods research has remained underutilised. Eighty-five per cent of articles reported studies conducted in North America or Europe, with few studies in developing countries. Most articles reported recruiting clinic-based populations (58%). Over half (54%) of research questions focused on patient experience and 24% on diabetes management. Qualitative methods can provide important insights about socio-cultural aspects of disease to improve disease management. However, they remain underutilised for understanding the diabetes experience, especially in Africa and Asia and amongst non-clinic populations.

A qualitative and quantitative laser-based computer-aided flow visualization method. M.S. Thesis, 1992 Final Report

NASA Technical Reports Server (NTRS)

Canacci, Victor A.; Braun, M. Jack

1994-01-01

The experimental approach presented here offers a nonintrusive, qualitative and quantitative evaluation of full field flow patterns applicable in various geometries in a variety of fluids. This Full Flow Field Tracking (FFFT) Particle Image Velocimetry (PIV) technique, by means of particle tracers illuminated by a laser light sheet, offers an alternative to Laser Doppler Velocimetry (LDV), and intrusive systems such as Hot Wire/Film Anemometry. The method makes obtainable the flow patterns, and allows quantitative determination of the velocities, accelerations, and mass flows of an entire flow field. The method uses a computer based digitizing system attached through an imaging board to a low luminosity camera. A customized optical train allows the system to become a long distance microscope (LDM), allowing magnifications of areas of interest ranging up to 100 times. Presented in addition to the method itself, are studies in which the flow patterns and velocities were observed and evaluated in three distinct geometries, with three different working fluids. The first study involved pressure and flow analysis of a brush seal in oil. The next application involved studying the velocity and flow patterns in a cowl lip cooling passage of an air breathing aircraft engine using water as the working fluid. Finally, the method was extended to a study in air to examine the flows in a staggered pin arrangement located on one side of a branched duct.

Tackling reliability and construct validity: the systematic development of a qualitative protocol for skill and incident analysis.

PubMed

Savage, Trevor Nicholas; McIntosh, Andrew Stuart

2017-03-01

It is important to understand factors contributing to and directly causing sports injuries to improve the effectiveness and safety of sports skills. The characteristics of injury events must be evaluated and described meaningfully and reliably. However, many complex skills cannot be effectively investigated quantitatively because of ethical, technological and validity considerations. Increasingly, qualitative methods are being used to investigate human movement for research purposes, but there are concerns about reliability and measurement bias of such methods. Using the tackle in Rugby union as an example, we outline a systematic approach for developing a skill analysis protocol with a focus on improving objectivity, validity and reliability. Characteristics for analysis were selected using qualitative analysis and biomechanical theoretical models and epidemiological and coaching literature. An expert panel comprising subject matter experts provided feedback and the inter-rater reliability of the protocol was assessed using ten trained raters. The inter-rater reliability results were reviewed by the expert panel and the protocol was revised and assessed in a second inter-rater reliability study. Mean agreement in the second study improved and was comparable (52-90% agreement and ICC between 0.6 and 0.9) with other studies that have reported inter-rater reliability of qualitative analysis of human movement.

Quality dimensions in health evaluation: manager's conceptions.

PubMed

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

Focused Group Interviews as an Innovative Quanti-Qualitative Methodology (QQM): Integrating Quantitative Elements into a Qualitative Methodology

ERIC Educational Resources Information Center

Grim, Brian J.; Harmon, Alison H.; Gromis, Judy C.

2006-01-01

There is a sharp divide between quantitative and qualitative methodologies in the social sciences. We investigate an innovative way to bridge this gap that incorporates quantitative techniques into a qualitative method, the "quanti-qualitative method" (QQM). Specifically, our research utilized small survey questionnaires and experiment-like…

Atherosclerosis imaging using 3D black blood TSE SPACE vs 2D TSE

PubMed Central

Wong, Stephanie K; Mobolaji-Iawal, Motunrayo; Arama, Leron; Cambe, Joy; Biso, Sylvia; Alie, Nadia; Fayad, Zahi A; Mani, Venkatesh

2014-01-01

AIM: To compare 3D Black Blood turbo spin echo (TSE) sampling perfection with application-optimized contrast using different flip angle evolution (SPACE) vs 2D TSE in evaluating atherosclerotic plaques in multiple vascular territories. METHODS: The carotid, aortic, and femoral arterial walls of 16 patients at risk for cardiovascular or atherosclerotic disease were studied using both 3D black blood magnetic resonance imaging SPACE and conventional 2D multi-contrast TSE sequences using a consolidated imaging approach in the same imaging session. Qualitative and quantitative analyses were performed on the images. Agreement of morphometric measurements between the two imaging sequences was assessed using a two-sample t-test, calculation of the intra-class correlation coefficient and by the method of linear regression and Bland-Altman analyses. RESULTS: No statistically significant qualitative differences were found between the 3D SPACE and 2D TSE techniques for images of the carotids and aorta. For images of the femoral arteries, however, there were statistically significant differences in all four qualitative scores between the two techniques. Using the current approach, 3D SPACE is suboptimal for femoral imaging. However, this may be due to coils not being optimized for femoral imaging. Quantitatively, in our study, higher mean total vessel area measurements for the 3D SPACE technique across all three vascular beds were observed. No significant differences in lumen area for both the right and left carotids were observed between the two techniques. Overall, a significant-correlation existed between measures obtained between the two approaches. CONCLUSION: Qualitative and quantitative measurements between 3D SPACE and 2D TSE techniques are comparable. 3D-SPACE may be a feasible approach in the evaluation of cardiovascular patients. PMID:24876923

Integrating service development with evaluation in telehealthcare: an ethnographic study.

PubMed

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-11-22

To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties-dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Clinicians, managers, technical experts, and researchers involved in the projects. Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS.

ADVANCING THE STUDY OF VIOLENCE AGAINST WOMEN USING MIXED METHODS: INTEGRATING QUALITATIVE METHODS INTO A QUANTITATIVE RESEARCH PROGRAM

PubMed Central

Testa, Maria; Livingston, Jennifer A.; VanZile-Tamsen, Carol

2011-01-01

A mixed methods approach, combining quantitative with qualitative data methods and analysis, offers a promising means of advancing the study of violence. Integrating semi-structured interviews and qualitative analysis into a quantitative program of research on women’s sexual victimization has resulted in valuable scientific insight and generation of novel hypotheses for testing. This mixed methods approach is described and recommendations for integrating qualitative data into quantitative research are provided. PMID:21307032

Qualitative tools and experimental philosophy.

PubMed

Andow, James

2016-11-16

Experimental philosophy brings empirical methods to philosophy. These methods are used to probe how people think about philosophically interesting things such as knowledge, morality, and freedom. This paper explores the contribution that qualitative methods have to make in this enterprise. I argue that qualitative methods have the potential to make a much greater contribution than they have so far. Along the way, I acknowledge a few types of resistance that proponents of qualitative methods in experimental philosophy might encounter, and provide reasons to think they are ill-founded.

Traditional and nontraditional evaluations of student outcomes in a practical final examination of veterinary radiology.

PubMed

Koskinen, Heli I

2010-01-01

The Faculty of Veterinary Medicine at the University of Helsinki recognized the lack of systems to measure the quality of education. At the department level, this meant lack of systems to measure the quality of students' outcomes. The aim of this article was to compare the quality of outcomes of a final examination in veterinary radiology by calculating the correlations between traditional (quantitative scores traditionally given by veterinary teachers) and nontraditional (qualitative Structure of the Observed Learning Outcome, or SOLO, method) grading results. Evaluation of the quality of the questions is also included. The results indicate that SOLO offers criteria for quality evaluation, especially for questions. A correlation of 0.60 (p<0.01) existed between qualitative and quantitative estimations, and a correlation of 0.79 (p<0.01) existed between evaluators, both using traditional scores. Two suggestions for a better system to evaluate quality in the future: First, development of problem-solving skills during the learning process should also be assessed. Second, both the scoring of factual correctness of answers (knowledge) and the grammatical structure of an answer and the quality of presentation should be included in the quality evaluation process.

Multicriteria Personnel Selection by the Modified Fuzzy VIKOR Method

PubMed Central

Alguliyev, Rasim M.; Aliguliyev, Ramiz M.; Mahmudova, Rasmiyya S.

2015-01-01

Personnel evaluation is an important process in human resource management. The multicriteria nature and the presence of both qualitative and quantitative factors make it considerably more complex. In this study, a fuzzy hybrid multicriteria decision-making (MCDM) model is proposed to personnel evaluation. This model solves personnel evaluation problem in a fuzzy environment where both criteria and weights could be fuzzy sets. The triangular fuzzy numbers are used to evaluate the suitability of personnel and the approximate reasoning of linguistic values. For evaluation, we have selected five information culture criteria. The weights of the criteria were calculated using worst-case method. After that, modified fuzzy VIKOR is proposed to rank the alternatives. The outcome of this research is ranking and selecting best alternative with the help of fuzzy VIKOR and modified fuzzy VIKOR techniques. A comparative analysis of results by fuzzy VIKOR and modified fuzzy VIKOR methods is presented. Experiments showed that the proposed modified fuzzy VIKOR method has some advantages over fuzzy VIKOR method. Firstly, from a computational complexity point of view, the presented model is effective. Secondly, compared to fuzzy VIKOR method, it has high acceptable advantage compared to fuzzy VIKOR method. PMID:26516634

Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research.

PubMed

Gentles, Stephen J; Charles, Cathy; Nicholas, David B; Ploeg, Jenny; McKibbon, K Ann

2016-10-11

Overviews of methods are potentially useful means to increase clarity and enhance collective understanding of specific methods topics that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness. This type of review represents a distinct literature synthesis method, although to date, its methodology remains relatively undeveloped despite several aspects that demand unique review procedures. The purpose of this paper is to initiate discussion about what a rigorous systematic approach to reviews of methods, referred to here as systematic methods overviews, might look like by providing tentative suggestions for approaching specific challenges likely to be encountered. The guidance offered here was derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research. The guidance is organized into several principles that highlight specific objectives for this type of review given the common challenges that must be overcome to achieve them. Optional strategies for achieving each principle are also proposed, along with discussion of how they were successfully implemented in the overview on sampling. We describe seven paired principles and strategies that address the following aspects: delimiting the initial set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology used to describe specific methods topics, and generating rigorous verifiable analytic interpretations. Since a broad aim in systematic methods overviews is to describe and interpret the relevant literature in qualitative terms, we suggest that iterative decision making at various stages of the review process, and a rigorous qualitative approach to analysis are necessary features of this review type. We believe that the principles and strategies provided here will be useful to anyone choosing to undertake a systematic methods overview. This paper represents an initial effort to promote high quality critical evaluations of the literature regarding problematic methods topics, which have the potential to promote clearer, shared understandings, and accelerate advances in research methods. Further work is warranted to develop more definitive guidance.

Qualitative and mixed methods research in dissemination and implementation science: introduction to the special issue.

PubMed

Southam-Gerow, Michael A; Dorsey, Shannon

2014-01-01

This special issue provides examples of how qualitative and mixed methods research approaches can be used in dissemination and implementation science. In this introductory article, we provide a brief rationale for why and how qualitative and mixed methods approaches can be useful in moving the field forward. Specifically, we provide a brief primer on common qualitative methods, including a review of guidelines provided by the National Institutes of Health. Next, we introduce the six articles in the issue. The first of the articles by Palinkas represents a more thorough and authoritative discussion related to qualitative methods, using the other five articles in the issue (and other published works) as examples. The remaining five articles are empirical and/or descriptive articles of recently completed or ongoing qualitative or mixed methods studies related to dissemination and implementation of evidence-based practices for children and adolescents.

Malaysian Students' Perceptions of Flipped Classroom: A Case Study

ERIC Educational Resources Information Center

Zainuddin, Zamzami; Attaran, Mohammad

2016-01-01

The purpose of this study was to evaluate a class in University of Malaya where flipped learning was applied, and to examine students' perceptions and feedback towards flipped classroom. Data were collected using both quantitative and qualitative methods, i.e. survey, focus group and individual interviews. The results indicated that most students…

Telling Their Stories: Primary Care Practitioners' Experience Evaluating and Reporting Injuries Caused by Child Abuse

ERIC Educational Resources Information Center

Flaherty, Emalee G.; Jones, Rise; Sege, Robert

2004-01-01

Objective: To learn about primary care physicians' experiences in identifying and reporting injuries caused by physical abuse. Method: Two qualitative analysts facilitated a focus group of six Chicago area, primary care physicians. Physicians representing diverse practice settings were selected to participate in the discussion. The analysts…

Identifying Perceived Barriers and Facilitators to Culturally Competent Practice for School Social Workers

ERIC Educational Resources Information Center

Teasley, Martell; Gourdine, Ruby; Canfield, James

2010-01-01

This study presents descriptive findings from self-reported qualitative and quantitative data on barriers and facilitators to culturally competent school social work practice. The study highlights the need for the development of evaluative methods for the purpose of examining how elements within the practice environment affect school social work…

Developing qualitative ecosystem service relationships with the Driver-Pressure-State-Impact-Response framework: A case study on Cape Cod, Massachusetts

EPA Science Inventory

Understanding the effects of environmental management strategies on society and the environment is critical for evaluating their effectiveness but is often impeded by limited data availability. In this article, we present a method that can help scientists to support environmental...

Private Agricultural Extension System in Kenya: Practice and Policy Lessons

ERIC Educational Resources Information Center

Muyanga, Milu; Jayne, T. S.

2008-01-01

Private extension system has been at the centre of a debate triggered by inefficient public agricultural extension. The debate is anchored on the premise that the private sector is more efficient in extension service delivery. This study evaluates the private extension system in Kenya. It employs qualitative and quantitative methods. The results…

In-Depth Analysis of Handwriting Curriculum and Instruction in Four Kindergarten Classrooms

ERIC Educational Resources Information Center

Vander Hart, Nanho; Fitzpatrick, Paula; Cortesa, Cathryn

2010-01-01

The quality of handwriting curriculum and instructional practices in actual classrooms was investigated in an in-depth case study of four inner city kindergarten classrooms using quantitative and qualitative methods. The handwriting proficiency of students was also evaluated to assess the impact of the instructional practices observed. The…

Conflicts Management Model in School: A Mixed Design Study

ERIC Educational Resources Information Center

Dogan, Soner

2016-01-01

The object of this study is to evaluate the reasons for conflicts occurring in school according to perceptions and views of teachers and resolution strategies used for conflicts and to build a model based on the results obtained. In the research, explanatory design including quantitative and qualitative methods has been used. The quantitative part…

School-Based Health Promotion Intervention: Parent and School Staff Perspectives

ERIC Educational Resources Information Center

Patino-Fernandez, Anna M.; Hernandez, Jennifer; Villa, Manuela; Delamater, Alan

2013-01-01

Background: The prevalence of childhood obesity is high, particularly among minority youth. The objective of this article was to evaluate parent and school staff perspectives of childhood health and weight qualitatively to guide the development of a school-based obesity prevention program for minority youth. Methods: Hispanic parents (N?=?9) of…

Services for Children with Autism Spectrum Disorder in Three, Large Urban School Districts: Perspectives of Parents and Educators

ERIC Educational Resources Information Center

Iadarola, Suzannah; Hetherington, Susan; Clinton, Christopher; Dean, Michelle; Reisinger, Erica; Huynh, Linh; Locke, Jill; Conn, Kelly; Heinert, Sara; Kataoka, Sheryl; Harwood, Robin; Smith, Tristram; Mandell, David S.; Kasari, Connie

2015-01-01

This study used qualitative methods to evaluate the perceptions of parents, educators, and school administrators in three large, urban school districts (Los Angeles, Philadelphia, and Rochester) regarding services for children with autism spectrum disorder within the context of limited district resources. Facilitators followed a standard…

Effectiveness of Solution-Focused Brief Therapy: A Systematic Qualitative Review of Controlled Outcome Studies

ERIC Educational Resources Information Center

Gingerich, Wallace J.; Peterson, Lance T.

2013-01-01

Objective: We review all available controlled outcome studies of solution-focused brief therapy (SFBT) to evaluate evidence of its effectiveness. Method: Forty-three studies were located and key data abstracted on problem, setting, SFBT intervention, design characteristics, and outcomes. Results: Thirty-two (74%) of the studies reported…

"A Really Nice Spot": Evaluating Place, Space, and Technology in Academic Libraries

ERIC Educational Resources Information Center

Khoo, Michael J.; Rozaklis, Lily; Hall, Catherine; Kusunoki, Diana

2016-01-01

This article describes a qualitative mixed-method study of students' perceptions of place and space in an academic library. The approach is informed by Scott Bennett's model of library design, which posits a shift from a "book-centered" to a technology supported "learning centered" paradigm of library space. Two surveys…

Depth of penetration of a 785nm laser for Raman spectral measurement in food powders.

USDA-ARS?s Scientific Manuscript database

Raman spectroscopy is a useful, rapid, and non-destructive method for both qualitative and quantitative evaluation of chemical composition. However it is important to measure the depth of penetration of the laser light to ensure that chemical particles at the very bottom of a sample volume are detec...

Accessing Multicultural Issues through Critical Thinking, Critical Inquiry, and the Student Research Process

ERIC Educational Resources Information Center

Hawkins, Judith

2006-01-01

This qualitative study describes and evaluates a pedagogical procedure that allows multicultural college freshmen to devise and research topics indigenous to their communal backgrounds. The researcher wishes to ascertain whether a method delineated by an academic procedure and limited to a classroom setting can have extended social implications…

Strategies for Using Peer-Assisted Learning Effectively in an Undergraduate Bioinformatics Course

ERIC Educational Resources Information Center

Shapiro, Casey; Ayon, Carlos; Moberg-Parker, Jordan; Levis-Fitzgerald, Marc; Sanders, Erin R.

2013-01-01

This study used a mixed methods approach to evaluate hybrid peer-assisted learning approaches incorporated into a bioinformatics tutorial for a genome annotation research project. Quantitative and qualitative data were collected from undergraduates who enrolled in a research-based laboratory course during two different academic terms at UCLA.…

Education about Hallucinations Using an Internet Virtual Reality System: A Qualitative Survey

ERIC Educational Resources Information Center

Yellowlees, Peter M.; Cook, James N.

2006-01-01

Objective: The authors evaluate an Internet virtual reality technology as an education tool about the hallucinations of psychosis. Method: This is a pilot project using Second Life, an Internet-based virtual reality system, in which a virtual reality environment was constructed to simulate the auditory and visual hallucinations of two patients…

The Children's Perceived Locus of Causality Scale for Physical Education

ERIC Educational Resources Information Center

Pannekoek, Linda; Piek, Jan P.; Hagger, Martin S.

2014-01-01

A mixed methods design was applied to evaluate the application of the Perceived Locus of Causality scale (PLOC) to preadolescent samples in physical education settings. Subsequent to minor item adaptations to accommodate the assessment of younger samples, qualitative pilot tests were performed (N = 15). Children's reports indicated the need…

A brief measure of attitudes toward mixed methods research in psychology.

PubMed

Roberts, Lynne D; Povee, Kate

2014-01-01

The adoption of mixed methods research in psychology has trailed behind other social science disciplines. Teaching psychology students, academics, and practitioners about mixed methodologies may increase the use of mixed methods within the discipline. However, tailoring and evaluating education and training in mixed methodologies requires an understanding of, and way of measuring, attitudes toward mixed methods research in psychology. To date, no such measure exists. In this article we present the development and initial validation of a new measure: Attitudes toward Mixed Methods Research in Psychology. A pool of 42 items developed from previous qualitative research on attitudes toward mixed methods research along with validation measures was administered via an online survey to a convenience sample of 274 psychology students, academics and psychologists. Principal axis factoring with varimax rotation on a subset of the sample produced a four-factor, 12-item solution. Confirmatory factor analysis on a separate subset of the sample indicated that a higher order four factor model provided the best fit to the data. The four factors; 'Limited Exposure,' '(in)Compatibility,' 'Validity,' and 'Tokenistic Qualitative Component'; each have acceptable internal reliability. Known groups validity analyses based on preferred research orientation and self-rated mixed methods research skills, and convergent and divergent validity analyses based on measures of attitudes toward psychology as a science and scientist and practitioner orientation, provide initial validation of the measure. This brief, internally reliable measure can be used in assessing attitudes toward mixed methods research in psychology, measuring change in attitudes as part of the evaluation of mixed methods education, and in larger research programs.

Simulation of the regional groundwater-flow system of the Menominee Indian Reservation, Wisconsin

USGS Publications Warehouse

Juckem, Paul F.; Dunning, Charles P.

2015-01-01

The likely extent of the Neopit wastewater plume was simulated by using the groundwater-flow model and Monte Carlo techniques to evaluate the sensitivity of predictive simulations to a range of model parameter values. Wastewater infiltrated from the currently operating lagoons flows predominantly south toward Tourtillotte Creek. Some of the infiltrated wastewater is simulated as having a low probability of flowing beneath Tourtillotte Creek to the nearby West Branch Wolf River. Results for the probable extent of the wastewater plume are considered to be qualitative because the method only considers advective flow and does not account for processes affecting contaminant transport in porous media. Therefore, results for the probable extent of the wastewater plume are sensitive to the number of particles used to represent flow from the lagoon and the resolution of a synthetic grid used for the analysis. Nonetheless, it is expected that the qualitative results may be of use for identifying potential downgradient areas of concern that can then be evaluated using the quantitative “area contributing recharge to wells” method or traditional contaminant-transport simulations.

A novel evaluation method for building construction project based on integrated information entropy with reliability theory.

PubMed

Bai, Xiao-ping; Zhang, Xi-wei

2013-01-01

Selecting construction schemes of the building engineering project is a complex multiobjective optimization decision process, in which many indexes need to be selected to find the optimum scheme. Aiming at this problem, this paper selects cost, progress, quality, and safety as the four first-order evaluation indexes, uses the quantitative method for the cost index, uses integrated qualitative and quantitative methodologies for progress, quality, and safety indexes, and integrates engineering economics, reliability theories, and information entropy theory to present a new evaluation method for building construction project. Combined with a practical case, this paper also presents detailed computing processes and steps, including selecting all order indexes, establishing the index matrix, computing score values of all order indexes, computing the synthesis score, sorting all selected schemes, and making analysis and decision. Presented method can offer valuable references for risk computing of building construction projects.

Challenges, coping strategies, and recommendations related to the HIV services field in the HAART era: a systematic literature review of qualitative studies from the United States and Canada.

PubMed

Kerr, Zachary Y; Miller, Katye R; Galos, Dylan; Love, Randi; Poole, Charles

2013-02-01

Qualitative research methods have been utilized to study the nature of work in the HIV services field. Yet current literature lacks a Highly Active Anti-Retroviral Treatment (HAART) era compendium of qualitative research studying challenges and coping strategies in the field. This study systematically reviewed challenges and coping strategies that qualitative researchers observed in the HIV services field during the HAART era, and their recommendations to organizations. Four online databases were searched for peer-reviewed research that utilized qualitative methods, were published from January 1998 to February 2012, utilized samples of individuals in the HIV services field; occurred in the U.S. or Canada, and contained information related to challenges and/or coping strategies. Abstracts were identified (n=846) and independently read and coded for inclusion by at least two of the four first authors. Identified articles (n=26) were independently read by at least two of the four first authors who recorded the study methodology, participant demographics, challenges and coping strategies, and recommendations. A number of challenges affecting those in the HIV services field were noted, particularly interpersonal and organizational issues. Coping strategies were problem- and emotion-focused. Summarized research recommendations called for increased support, capacity-building, and structural changes. Future research on challenges and coping strategies must provide up-to-date information to the HIV services field while creating, implementing, and evaluating interventions to manage current challenges and reduce the risk of burnout.

How important is aspirin adherence when evaluating effectiveness of low-dose aspirin?

PubMed

Navaratnam, Kate; Alfirevic, Zarko; Pirmohamed, Munir; Alfirevic, Ana

2017-12-01

Low-dose aspirin (LDA) is advocated for women at high-risk of pre-eclampsia, providing a modest, 10%, reduction in risk. Cardiology meta-analyses demonstrate 18% reduction in serious vascular events with LDA. Non-responsiveness to aspirin (sometimes termed aspirin resistance) and variable clinical effectiveness are often attributed to suboptimal adherence. The aim of this review was to identify the scope of adherence assessments in RCTs evaluating aspirin effectiveness in cardiology and obstetrics and discuss the quality of information provided by current methods. We searched MEDLINE, EMBASE and the Cochrane Library, limited to humans and English language, for RCTs evaluating aspirin in cardiology; 14/03/13-13/03/16 and pregnancy 1957-13/03/16. Search terms; 'aspirin', 'acetylsalicylic acid' appearing adjacent to 'myocardial infarction' or 'pregnancy', 'pregnant', 'obstetric' were used. 38% (25/68) of obstetric and 32% (20/62) of cardiology RCTs assessed aspirin adherence and 24% (6/25) and 29% (6/21) of obstetric and cardiology RCTs, respectively, defined acceptable adherence. Semi-quantitative methods (pill counts, medication weighing) prevailed in obstetric RCTs (93%), qualitative methods (interviews, questionnaires) were more frequent in obstetrics (67%). Two obstetric RCTs quantified serum thromboxane B 2 and salicylic acid, but no quantitative methods were used in cardiology Aspirin has proven efficacy, but suboptimal adherence is widespread and difficult to accurately quantify. Little is currently known about aspirin adherence in pregnancy. RCTs evaluating aspirin effectiveness show over-reliance on qualitative adherence assessments vulnerable to inherent inaccuracies. Reliable adherence data is important to assess and optimise the clinical effectiveness of LDA. We propose that adherence should be formally assessed in future trials and that development of quantitative assessments may prove valuable for trial protocols. Copyright © 2017 Elsevier B.V. All rights reserved.

The Role of Qualitative Approaches to Research in CALL Contexts: Closing in on the Learner's Experience

ERIC Educational Resources Information Center

Levy, Mike

2015-01-01

The article considers the role of qualitative research methods in CALL through describing a series of examples. These examples are used to highlight the importance and value of qualitative data in relation to a specific research objective in CALL. The use of qualitative methods in conjunction with other approaches as in mixed method research…

Impact of the Macmillan specialist Care at Home service: a mixed methods evaluation across six sites.

PubMed

Johnston, Bridget; Patterson, Anne; Bird, Lydia; Wilson, Eleanor; Almack, Kathryn; Mathews, Gillian; Seymour, Jane

2018-02-23

The Midhurst Macmillan Specialist Palliative Care at Home Service was founded in 2006 to improve community-based palliative care provision. Principal components include; early referral; home-based clinical interventions; close partnership working; and flexible teamwork. Following a successful introduction, the model was implemented in six further sites across England. This article reports a mixed methods evaluation of the implementation across these 'Innovation Centres'. The evaluation aimed to assess the process and impact on staff, patients and carers of providing Macmillan Specialist Care at Home services across the six sites. The study was set within a Realist Evaluation framework and used a longitudinal, mixed methods research design. Data collection over 15 months (2014-2016) included: Quantitative outcome measures - Palliative Performance Scale [PPS] and Palliative Prognostic Index [PPI] (n = 2711); Integrated Palliative Outcome Scales [IPOS] (n = 1157); Carers Support Needs Assessment Tool [CSNAT] (n = 241); Views of Informal Carers -Evaluation of Services [VOICES-SF] (n = 102); a custom-designed Service Data Tool [SDT] that gathered prospective data from each site (n = 88). Qualitative data methods included: focus groups with project team and staff (n = 32 groups with n = 190 participants), and, volunteers (n = 6 groups with n = 32 participants). Quantitative data were analysed using SPPS Vs. 21 and qualitative data was examined via thematic analysis. Comparison of findings across the six sites revealed the impact of their unique configurations on outcomes, compounded by variations in stage and mode of implementation. PPS, PPI and IPOS data revealed disparity in early referral criteria, complicated by contrasting interpretations of palliative care. The qualitative analysis, CSNAT and VOICES-SF data confirmed the value of the Macmillan model of care but uptake of specialist home-based clinical interventions was limited. The Macmillan brand engendered patient and carer confidence, bringing added value to existing services. Significant findings included better co-ordination of palliative care through project management and a single referral point and multi-disciplinary teamwork including leadership from consultants in palliative medicine, the role of health care assistants in rapid referral, and volunteer support. Macmillan Specialist Care at Home increases patient choice about place of death and enhances the quality of end of life experience. Clarification of key components is advocated to aid consistency of implementation across different sites and support future evaluative work.

“Having to Shift Everything We’ve Learned to the Side”: Expanding Research Methods Taught in Psychology to Incorporate Qualitative Methods

PubMed Central

Roberts, Lynne D.; Castell, Emily

2016-01-01

In Australia the tradition of conducting quantitative psychological research within a positivist framework has been challenged, with calls made for the inclusion of the full range of qualitative and quantitative methodologies within the undergraduate psychology curriculum. Despite this, the undergraduate psychology curriculum in most Australian universities retains a strong focus on teaching quantitative research methods. Limited research has examined attitudes toward qualitative research held by undergraduate psychology students taught within a positivist framework, and whether these attitudes are malleable and can be changed through teaching qualitative methodologies. Previous research has suggested that students from strong quantitative backgrounds experience some cognitive dissonance and greater difficulties in learning qualitative methods. In this article we examine 3rd year undergraduate psychology students’ attitudes to qualitative research prior to commencing and upon completion of a qualitative research unit. All students had previously completed two 13 weeks units of study in quantitative research methods. At Time 1, 63 students (84.1% female) completed online surveys comprising attitudinal measures. Key themes to emerge from student comments were that qualitative research was seen as an alternative approach, representing a paradigmatic shift that was construed by some students advantageous for meeting future professional and educative goals. Quantitative measures of attitudes to qualitative research were associated with general attitudes toward research, and psychology-specific epistemological beliefs. Changes in attitudes following completion of the qualitative research methods unit were in the hypothesized direction, but non-significant (small effect sizes). The findings increase our understanding of psychology students’ attitudes toward qualitative research and inform our recommendations for teaching research methods within the undergraduate psychology curriculum. PMID:27242602

"Having to Shift Everything We've Learned to the Side": Expanding Research Methods Taught in Psychology to Incorporate Qualitative Methods.

PubMed

Roberts, Lynne D; Castell, Emily

2016-01-01

In Australia the tradition of conducting quantitative psychological research within a positivist framework has been challenged, with calls made for the inclusion of the full range of qualitative and quantitative methodologies within the undergraduate psychology curriculum. Despite this, the undergraduate psychology curriculum in most Australian universities retains a strong focus on teaching quantitative research methods. Limited research has examined attitudes toward qualitative research held by undergraduate psychology students taught within a positivist framework, and whether these attitudes are malleable and can be changed through teaching qualitative methodologies. Previous research has suggested that students from strong quantitative backgrounds experience some cognitive dissonance and greater difficulties in learning qualitative methods. In this article we examine 3rd year undergraduate psychology students' attitudes to qualitative research prior to commencing and upon completion of a qualitative research unit. All students had previously completed two 13 weeks units of study in quantitative research methods. At Time 1, 63 students (84.1% female) completed online surveys comprising attitudinal measures. Key themes to emerge from student comments were that qualitative research was seen as an alternative approach, representing a paradigmatic shift that was construed by some students advantageous for meeting future professional and educative goals. Quantitative measures of attitudes to qualitative research were associated with general attitudes toward research, and psychology-specific epistemological beliefs. Changes in attitudes following completion of the qualitative research methods unit were in the hypothesized direction, but non-significant (small effect sizes). The findings increase our understanding of psychology students' attitudes toward qualitative research and inform our recommendations for teaching research methods within the undergraduate psychology curriculum.

FBI fingerprint identification automation study: AIDS 3 evaluation report. Volume 5: Current system evaluation

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The performance, costs, organization and other characteristics of both the manual system and AIDS 2 were used to establish a baseline case. The results of the evaluation are to be used to determine the feasibility of the AIDS 3 System, as well as provide a basis for ranking alternative systems during the second phase of the JPL study. The results of the study were tabulated by subject, scope and methods, providing a descriptive, quantitative and qualitative analysis of the current operating systems employed by the FBI Identification Division.

[Clinical research XXIII. From clinical judgment to meta-analyses].

PubMed

Rivas-Ruiz, Rodolfo; Castelán-Martínez, Osvaldo D; Pérez-Rodríguez, Marcela; Palacios-Cruz, Lino; Noyola-Castillo, Maura E; Talavera, Juan O

2014-01-01

Systematic reviews (SR) are studies made in order to ask clinical questions based on original articles. Meta-analysis (MTA) is the mathematical analysis of SR. These analyses are divided in two groups, those which evaluate the measured results of quantitative variables (for example, the body mass index -BMI-) and those which evaluate qualitative variables (for example, if a patient is alive or dead, or if he is healing or not). Quantitative variables generally use the mean difference analysis and qualitative variables can be performed using several calculations: odds ratio (OR), relative risk (RR), absolute risk reduction (ARR) and hazard ratio (HR). These analyses are represented through forest plots which allow the evaluation of each individual study, as well as the heterogeneity between studies and the overall effect of the intervention. These analyses are mainly based on Student's t test and chi-squared. To take appropriate decisions based on the MTA, it is important to understand the characteristics of statistical methods in order to avoid misinterpretations.

How has problem based learning fared in Pakistan?

PubMed

Mahmud, Waqas; Hyder, Omar

2012-10-01

To conduct a systematic review of primary research in undergraduate medical education in Pakistan in order to evaluate PBL programs, examine outcomes and competencies influenced by PBL, and compare them with conventional learning (lecture based learning, LBL). Qualitative content analysis. Rawalpindi Medical College, Rawalpindi, from June 2010 - February 2011. Literature was searched using online resources. Studies evaluating outcomes influenced by PBL, or comparing PBL with lecture based learning (LBL) were selected. Due to heterogeneity, a qualitative content analysis was performed in which studies were classified according to the methods of assessment; results were then summarized by outcome and frequencies were calculated. Eleven studies were included. Apart from knowledge acquisition, students gave high ratings to PBL in selected outcomes, alone, and in comparison with LBL. There was a disagreement among results of studies that evaluated knowledge acquisition alone. Based on student perceptions, PBL has many advantages. However, the results of this review are limited due to heterogeneity and methodological weakness of studies, specially the studies that compared exam scores to assess knowledge acquisition.

Educational Accountability: A Qualitatively Driven Mixed-Methods Approach

ERIC Educational Resources Information Center

Hall, Jori N.; Ryan, Katherine E.

2011-01-01

This article discusses the importance of mixed-methods research, in particular the value of qualitatively driven mixed-methods research for quantitatively driven domains like educational accountability. The article demonstrates the merits of qualitative thinking by describing a mixed-methods study that focuses on a middle school's system of…

Qualitative methods in environmental health research.

PubMed Central

Brown, Phil

2003-01-01

Public health researchers increasingly turn to qualitative methods either on their own or in combination with quantitative methods. Qualitative methods are especially important to community environmental health research, as they provide a way to produce community narratives that give voice to individuals and characterize the community in a full and complex fashion. This article first traces the legacy of qualitative research in environmental health, then uses a case study of the author's experiences studying the Woburn, Massachusetts, childhood leukemia cluster to provide personal and scholarly insights on qualitative approaches. That material then informs a discussion of important components of qualitative methods in environmental health research, including flexible study design, access, trust, empathy, and personal shifts in the researcher's worldview, bias, and the nature of the researcher's roles. A concluding discussion addresses issues in funding policy and research practices. PMID:14594634

Extending Beyond Qualitative Interviewing to Illuminate the Tacit Nature of Everyday Occupation: Occupational Mapping and Participatory Occupation Methods.

PubMed

Huot, Suzanne; Rudman, Debbie Laliberte

2015-07-01

The study of human occupation requires a variety of methods to fully elucidate its complex, multifaceted nature. Although qualitative approaches have commonly been used within occupational therapy and occupational science, we contend that such qualitative research must extend beyond the sole use of interviews. Drawing on qualitative methodological literature, we discuss the limits of interview methods and outline other methods, particularly visual methods, as productive means to enhance qualitative research. We then provide an overview of our critical ethnographic study that used narrative, visual, and observational methods to explore the occupational transitions experienced by immigrants to Canada. We describe our use of occupational mapping and participatory occupation methods and the contributions of these combined methods. We conclude that adopting a variety of methods can enable a deeper understanding of the tacit nature of everyday occupation, and is key to advancing knowledge regarding occupation and to informing occupational therapy practice.

The Risk Assessment Study for Electric Power Marketing Competitiveness Based on Cloud Model and TOPSIS

NASA Astrophysics Data System (ADS)

Li, Cunbin; Wang, Yi; Lin, Shuaishuai

2017-09-01

With the rapid development of the energy internet and the deepening of the electric power reform, the traditional marketing mode of electric power does not apply to most of electric power enterprises, so must seek a breakthrough, however, in the face of increasingly complex marketing information, how to make a quick, reasonable transformation, makes the electric power marketing competitiveness assessment more accurate and objective becomes a big problem. In this paper, cloud model and TOPSIS method is proposed. Firstly, build the electric power marketing competitiveness evaluation index system. Then utilize the cloud model to transform the qualitative evaluation of the marketing data into quantitative values and use the entropy weight method to weaken the subjective factors of evaluation index weight. Finally, by TOPSIS method the closeness degrees of alternatives are obtained. This method provides a novel solution for the electric power marketing competitiveness evaluation. Through the case analysis the effectiveness and feasibility of this model are verified.

Including mixed methods research in systematic reviews: Examples from qualitative syntheses in TB and malaria control

PubMed Central

2012-01-01

Background Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. Methods We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Results Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Conclusions Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research. PMID:22545681

Central nervous system antiretroviral efficacy in HIV infection: a qualitative and quantitative review and implications for future research.

PubMed

Cysique, Lucette A; Waters, Edward K; Brew, Bruce J

2011-11-22

There is conflicting information as to whether antiretroviral drugs with better central nervous system (CNS) penetration (neuroHAART) assist in improving neurocognitive function and suppressing cerebrospinal fluid (CSF) HIV RNA. The current review aims to better synthesise existing literature by using an innovative two-phase review approach (qualitative and quantitative) to overcome methodological differences between studies. Sixteen studies, all observational, were identified using a standard citation search. They fulfilled the following inclusion criteria: conducted in the HAART era; sample size > 10; treatment effect involved more than one antiretroviral and none had a retrospective design. The qualitative phase of review of these studies consisted of (i) a blind assessment rating studies on features such as sample size, statistical methods and definitions of neuroHAART, and (ii) a non-blind assessment of the sensitivity of the neuropsychological methods to HIV-associated neurocognitive disorder (HAND). During quantitative evaluation we assessed the statistical power of studies, which achieved a high rating in the qualitative analysis. The objective of the power analysis was to determine the studies ability to assess their proposed research aims. After studies with at least three limitations were excluded in the qualitative phase, six studies remained. All six found a positive effect of neuroHAART on neurocognitive function or CSF HIV suppression. Of these six studies, only two had statistical power of at least 80%. Studies assessed as using more rigorous methods found that neuroHAART was effective in improving neurocognitive function and decreasing CSF viral load, but only two of those studies were adequately statistically powered. Because all of these studies were observational, they represent a less compelling evidence base than randomised control trials for assessing treatment effect. Therefore, large randomised trials are needed to determine the robustness of any neuroHAART effect. However, such trials must be longitudinal, include the full spectrum of HAND, ideally carefully control for co-morbidities, and be based on optimal neuropsychology methods.

Towards a Critical Health Equity Research Stance: Why Epistemology and Methodology Matter More than Qualitative Methods

ERIC Educational Resources Information Center

Bowleg, Lisa

2017-01-01

Qualitative methods are not intrinsically progressive. Methods are simply tools to conduct research. Epistemology, the justification of knowledge, shapes methodology and methods, and thus is a vital starting point for a critical health equity research stance, regardless of whether the methods are qualitative, quantitative, or mixed. In line with…

Steps in the Right Direction, against the Odds, an Evaluation of a Community-Based Programme Aiming to Reduce Inactivity and Improve Health and Morale in Overweight and Obese School-Age Children

ERIC Educational Resources Information Center

Fraser, Claire; Lewis, Kiara; Manby, Martin

2012-01-01

The study describes an evaluation of a 48-week physical activity and nutritional education programme for overweight/obese school-age children using quantitative and qualitative methods. The majority of participants were obese or severely obese when enrolled, and while some improvements in body mass index, self-esteem and engagement in a range of…

An evaluation of medical student-led podcasts: what are the lessons learnt?

PubMed

Kapoor, Smriti; Catton, Rory; Khalil, Hisham

2018-01-01

Student-led podcasts were developed by 5th year Peninsula Medical School students as part of an educational grant. The students completed 35 video podcasts using PREZI software, and based on clinical indicative presentations of the Peninsula Medical School curriculum. Third, 4th and 5th year medical students were invited to complete the evaluation of the indicative presentation video podcasts they watched. Both quantitative and qualitative data were collected through anonymized questionnaires. A thematic analysis of qualitative data was carried out. Seven hundred and fifty students were invited to evaluate the podcasts of which 142 responded to the email. One hundred and forty-two students were assigned podcasts, of whom 122 completed the podcast questionnaire (85.9%), with 20 students dropping out for unknown reasons. The majority of the students found the podcasts to be clear, of an appropriate length, targeted at the right academic level and providing a good method of learning. However, there were mixed views in relation to the preference of podcasts over conventional learning methods. The thematic analysis identified positive comments and areas of improvement for the podcasts. Podcasts conducted in an interview style with an engaging voice and images are thought to help maintain student engagement from their perspective. Further evaluation/research is required to help establish the correct depth and breadth of information to be included in podcasts.

Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study

PubMed Central

2014-01-01

Background Qualitative research is undertaken with randomized controlled trials of health interventions. Our aim was to explore the perceptions of researchers with experience of this endeavour to understand the added value of qualitative research to the trial in practice. Methods A telephone semi-structured interview study with 18 researchers with experience of undertaking the trial and/or the qualitative research. Results Interviewees described the added value of qualitative research for the trial, explaining how it solved problems at the pretrial stage, explained findings, and helped to increase the utility of the evidence generated by the trial. From the interviews, we identified three models of relationship of the qualitative research to the trial. In ‘the peripheral’ model, the trial was an opportunity to undertake qualitative research, with no intention that it would add value to the trial. In ‘the add-on’ model, the qualitative researcher understood the potential value of the qualitative research but it was viewed as a separate and complementary endeavour by the trial lead investigator and wider team. Interviewees described how this could limit the value of the qualitative research to the trial. Finally ‘the integral’ model played out in two ways. In ‘integral-in-theory’ studies, the lead investigator viewed the qualitative research as essential to the trial. However, in practice the qualitative research was under-resourced relative to the trial, potentially limiting its ability to add value to the trial. In ‘integral-in-practice’ studies, interviewees described how the qualitative research was planned from the beginning of the study, senior qualitative expertise was on the team from beginning to end, and staff and time were dedicated to the qualitative research. In these studies interviewees described the qualitative research adding value to the trial although this value was not necessarily visible beyond the original research team due to the challenges of publishing this research. Conclusions Health researchers combining qualitative research and trials viewed this practice as strengthening evaluative research. Teams viewing the qualitative research as essential to the trial, and resourcing it in practice, may have a better chance of delivering its added value to the trial. PMID:24913438

Current status of quality evaluation of nursing care through director review and reflection from the Nursing Quality Control Centers

PubMed Central

Duan, Xia; Shi, Yan

2014-01-01

Background: The quality evaluation of nursing care is a key link in medical quality management. It is important and worth studying for the nursing supervisors to know the disadvantages during the process of quality evaluation of nursing care and then to improve the whole nursing quality. This study was to provide director insight on the current status of quality evaluation of nursing care from Nursing Quality Control Centers (NQCCs). Material and Methods: This qualitative study used a sample of 12 directors from NQCCs who were recruited from 12 provinces in China to evaluate the current status of quality evaluation of nursing care. Data were collected by in-depth interviews. Content analysis method was used to analyze the data. Results: Four themes emerged from the data: 1) lag of evaluation index; 2) limitations of evaluation content; 3) simplicity of evaluation method; 4) excessive emphasis on terminal quality. Conclusion: It is of great realistic significance to ameliorate nursing quality evaluation criteria, modify the evaluation content based on patient needs-oriented idea, adopt scientific evaluation method to evaluate nursing quality, and scientifically and reasonably draw horizontal comparisons of nursing quality between hospitals, as well as longitudinal comparisons of a hospital’s nursing quality. These methods mentioned above can all enhance a hospital’s core competitiveness and benefit more patients. PMID:25419427

Qualitative research and the profound grasp of the obvious.

PubMed Central

Hurley, R E

1999-01-01

OBJECTIVE: To discuss the value of promoting coexistent and complementary relationships between qualitative and quantitative research methods as illustrated by presentations made by four respected health services researchers who described their experiences in multi-method projects. DATA SOURCES: Presentations and publications related to the four research projects, which described key substantive and methodological areas that had been addressed with qualitative techniques. PRINCIPAL FINDINGS: Sponsor interest in timely, insightful, and reality-anchored evidence has provided a strong base of support for the incorporation of qualitative methods into major contemporary policy research studies. In addition, many issues may be suitable for study only with qualitative methods because of their complexity, their emergent nature, or because of the need to revisit and reexamine previously untested assumptions. CONCLUSION: Experiences from the four projects, as well as from other recent health services studies with major qualitative components, support the assertion that the interests of sponsors in the policy realm and pressure from them suppress some of the traditional tensions and antagonisms between qualitative and quantitative methods. PMID:10591276

Research on assessment methods for urban public transport development in China.

PubMed

Zou, Linghong; Dai, Hongna; Yao, Enjian; Jiang, Tian; Guo, Hongwei

2014-01-01

In recent years, with the rapid increase in urban population, the urban travel demands in Chinese cities have been increasing dramatically. As a result, developing comprehensive urban transport systems becomes an inevitable choice to meet the growing urban travel demands. In urban transport systems, public transport plays the leading role to promote sustainable urban development. This paper aims to establish an assessment index system for the development level of urban public transport consisting of a target layer, a criterion layer, and an index layer. Review on existing literature shows that methods used in evaluating urban public transport structure are dominantly qualitative. To overcome this shortcoming, fuzzy mathematics method is used for describing qualitative issues quantitatively, and AHP (analytic hierarchy process) is used to quantify expert's subjective judgment. The assessment model is established based on the fuzzy AHP. The weight of each index is determined through the AHP and the degree of membership of each index through the fuzzy assessment method to obtain the fuzzy synthetic assessment matrix. Finally, a case study is conducted to verify the rationality and practicability of the assessment system and the proposed assessment method.

Process service quality evaluation based on Dempster-Shafer theory and support vector machine.

PubMed

Pei, Feng-Que; Li, Dong-Bo; Tong, Yi-Fei; He, Fei

2017-01-01

Human involvement influences traditional service quality evaluations, which triggers an evaluation's low accuracy, poor reliability and less impressive predictability. This paper proposes a method by employing a support vector machine (SVM) and Dempster-Shafer evidence theory to evaluate the service quality of a production process by handling a high number of input features with a low sampling data set, which is called SVMs-DS. Features that can affect production quality are extracted by a large number of sensors. Preprocessing steps such as feature simplification and normalization are reduced. Based on three individual SVM models, the basic probability assignments (BPAs) are constructed, which can help the evaluation in a qualitative and quantitative way. The process service quality evaluation results are validated by the Dempster rules; the decision threshold to resolve conflicting results is generated from three SVM models. A case study is presented to demonstrate the effectiveness of the SVMs-DS method.

Evaluation of standardized sample collection, packaging, and ...

EPA Pesticide Factsheets

Journal Sample collection procedures and primary receptacle (sample container and bag) decontamination methods should prevent contaminant transfer between contaminated and non-contaminated surfaces and areas during bio-incident operations. Cross-contamination of personnel, equipment, or sample containers may result in the exfiltration of biological agent from the exclusion (hot) zone and have unintended negative consequences on response resources, activities and outcomes. The current study was designed to: (1) evaluate currently recommended sample collection and packaging procedures to identify procedural steps that may increase the likelihood of spore exfiltration or contaminant transfer; (2) evaluate the efficacy of currently recommended primary receptacle decontamination procedures; and (3) evaluate the efficacy of outer packaging decontamination methods. Wet- and dry-deposited fluorescent tracer powder was used in contaminant transfer tests to qualitatively evaluate the currently-recommended sample collection procedures. Bacillus atrophaeus spores, a surrogate for Bacillus anthracis, were used to evaluate the efficacy of spray- and wipe-based decontamination procedures.

Probability of Detection (POD) as a statistical model for the validation of qualitative methods.

PubMed

Wehling, Paul; LaBudde, Robert A; Brunelle, Sharon L; Nelson, Maria T

2011-01-01

A statistical model is presented for use in validation of qualitative methods. This model, termed Probability of Detection (POD), harmonizes the statistical concepts and parameters between quantitative and qualitative method validation. POD characterizes method response with respect to concentration as a continuous variable. The POD model provides a tool for graphical representation of response curves for qualitative methods. In addition, the model allows comparisons between candidate and reference methods, and provides calculations of repeatability, reproducibility, and laboratory effects from collaborative study data. Single laboratory study and collaborative study examples are given.

Qualitative tools and experimental philosophy

PubMed Central

Andow, James

2016-01-01

Abstract Experimental philosophy brings empirical methods to philosophy. These methods are used to probe how people think about philosophically interesting things such as knowledge, morality, and freedom. This paper explores the contribution that qualitative methods have to make in this enterprise. I argue that qualitative methods have the potential to make a much greater contribution than they have so far. Along the way, I acknowledge a few types of resistance that proponents of qualitative methods in experimental philosophy might encounter, and provide reasons to think they are ill-founded. PMID:28392629

Qualitative psychotherapy research: the journey so far and future directions.

PubMed

Levitt, Heidi M

2015-03-01

This article documents the evolution of qualitative psychotherapy research over the past 3 decades. Clients' and therapists' accounts of their experiences in psychotherapy provide a window into the psychotherapy relationship and its mechanisms of change. A sizable body of literature has been generated that uses qualitative methods to collect and analyze these accounts and to shed light on the psychotherapy process. It notes changes in the field such as growing numbers of dissertations and publications using qualitative methods as well as a strengthening emphasis on qualitative research within graduate education and research funding bodies. Future recommendations include developing principles for practice from qualitative methods and conducting qualitative meta-analyses. Other recommendations include forming journal review policies that support the publication of qualitative research and that focus on coherence in adapting methods to meet research goals, in light of a study's characteristics and epistemological framework, rather than focusing on sets of procedures. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Qualitative evaluation of an AIDS health education poster. A rapid assessment method for health education materials.

PubMed

Evian, C R; Ijsselmuiden, C B; Padayachee, G N; Hurwitz, H S

1990-11-03

In January 1989, the Johannesburg City Health Department developed an AIDS education poster. The poster was adapted from a cartoon in the Sowetan newspaper and was formally evaluated before its final production. As a result of this evaluation further editing and restructuring of the poster proved necessary. The methodology used in the evaluation is outlined, and some of the findings that emerged during the evaluation are discussed, since few formal evaluations of health education material seem to have been documented in South Africa. This study highlights the importance of formative evaluation of printed health educational media by a sample of the target audience before production and distribution.

Qualitative Analysis of Student Perceptions Comparing Team-based Learning and Traditional Lecture in a Pharmacotherapeutics Course.

PubMed

Remington, Tami L; Bleske, Barry E; Bartholomew, Tracy; Dorsch, Michael P; Guthrie, Sally K; Klein, Kristin C; Tingen, Jeffrey M; Wells, Trisha D

2017-04-01

Objective. To qualitatively compare students' attitudes and perceptions regarding team-based learning (TBL) and lecture. Design. Students were exposed to TBL and lecture in an elective pharmacotherapeutics course in a randomized, prospective, cross-over design. After completing the course, students provided their attitudes and perceptions through a written self-reflection and narrative questions on the end-of-course evaluation. Student responses were reviewed using a grounded theory coding method. Assessment. Students' responses yielded five major themes: impact of TBL on learning, perceptions about TBL learning methods, changes in approaches to learning, building skills for professional practice, and enduring challenges. Overall, students report TBL enhances their learning of course content (knowledge and application), teamwork skills, and lifelong learning skills. Conclusion. Students' attitudes and perceptions support TBL as a viable pedagogy for teaching pharmacotherapeutics.

Qualitative Analysis of Student Perceptions Comparing Team-based Learning and Traditional Lecture in a Pharmacotherapeutics Course

PubMed Central

Bleske, Barry E.; Bartholomew, Tracy; Dorsch, Michael P.; Guthrie, Sally K.; Klein, Kristin C.; Tingen, Jeffrey M.; Wells, Trisha D.

2017-01-01

Objective. To qualitatively compare students’ attitudes and perceptions regarding team-based learning (TBL) and lecture. Design. Students were exposed to TBL and lecture in an elective pharmacotherapeutics course in a randomized, prospective, cross-over design. After completing the course, students provided their attitudes and perceptions through a written self-reflection and narrative questions on the end-of-course evaluation. Student responses were reviewed using a grounded theory coding method. Assessment. Students’ responses yielded five major themes: impact of TBL on learning, perceptions about TBL learning methods, changes in approaches to learning, building skills for professional practice, and enduring challenges. Overall, students report TBL enhances their learning of course content (knowledge and application), teamwork skills, and lifelong learning skills. Conclusion. Students’ attitudes and perceptions support TBL as a viable pedagogy for teaching pharmacotherapeutics. PMID:28496275

Integration of the primary health care approach into a community nursing science curriculum.

PubMed

Vilakazi, S S; Chabeli, M M; Roos, S D

2000-12-01

The purpose of this article is to explore and describe guidelines for integration of the primary health care approach into a Community Nursing Science Curriculum in a Nursing College in Gauteng. A qualitative, exploratory, descriptive and contextual research design was utilized. The focus group interviews were conducted with community nurses and nurse educators as respondents. Data were analysed by a qualitative descriptive method of analysis as described in Creswell (1994: 155). Respondents in both groups held similar perceptions regarding integration of primary health care approach into a Community Nursing Science Curriculum. Five categories, which are in line with the curriculum cycle, were identified as follows: situation analysis, selection and organisation of objectives/goals, content, teaching methods and evaluation. Guidelines and recommendations for the integration of the primary health care approach into a Community Nursing Science Curriculum were described.

Standards for reporting qualitative research: a synthesis of recommendations.

PubMed

O'Brien, Bridget C; Harris, Ilene B; Beckman, Thomas J; Reed, Darcy A; Cook, David A

2014-09-01

Standards for reporting exist for many types of quantitative research, but currently none exist for the broad spectrum of qualitative research. The purpose of the present study was to formulate and define standards for reporting qualitative research while preserving the requisite flexibility to accommodate various paradigms, approaches, and methods. The authors identified guidelines, reporting standards, and critical appraisal criteria for qualitative research by searching PubMed, Web of Science, and Google through July 2013; reviewing the reference lists of retrieved sources; and contacting experts. Specifically, two authors reviewed a sample of sources to generate an initial set of items that were potentially important in reporting qualitative research. Through an iterative process of reviewing sources, modifying the set of items, and coding all sources for items, the authors prepared a near-final list of items and descriptions and sent this list to five external reviewers for feedback. The final items and descriptions included in the reporting standards reflect this feedback. The Standards for Reporting Qualitative Research (SRQR) consists of 21 items. The authors define and explain key elements of each item and provide examples from recently published articles to illustrate ways in which the standards can be met. The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear standards for reporting qualitative research. These standards will assist authors during manuscript preparation, editors and reviewers in evaluating a manuscript for potential publication, and readers when critically appraising, applying, and synthesizing study findings.

How Qualitative Methods Can be Used to Inform Model Development.

PubMed

Husbands, Samantha; Jowett, Susan; Barton, Pelham; Coast, Joanna

2017-06-01

Decision-analytic models play a key role in informing healthcare resource allocation decisions. However, there are ongoing concerns with the credibility of models. Modelling methods guidance can encourage good practice within model development, but its value is dependent on its ability to address the areas that modellers find most challenging. Further, it is important that modelling methods and related guidance are continually updated in light of any new approaches that could potentially enhance model credibility. The objective of this article was to highlight the ways in which qualitative methods have been used and recommended to inform decision-analytic model development and enhance modelling practices. With reference to the literature, the article discusses two key ways in which qualitative methods can be, and have been, applied. The first approach involves using qualitative methods to understand and inform general and future processes of model development, and the second, using qualitative techniques to directly inform the development of individual models. The literature suggests that qualitative methods can improve the validity and credibility of modelling processes by providing a means to understand existing modelling approaches that identifies where problems are occurring and further guidance is needed. It can also be applied within model development to facilitate the input of experts to structural development. We recommend that current and future model development would benefit from the greater integration of qualitative methods, specifically by studying 'real' modelling processes, and by developing recommendations around how qualitative methods can be adopted within everyday modelling practice.

Using internet-based approaches to collect qualitative data from vulnerable groups: reflections from the field.

PubMed

Neville, Stephen; Adams, Jeffery; Cook, Catherine

2016-12-01

Undertaking qualitative research with vulnerable populations is a complex and challenging process for researchers. Traditional and common modes of collecting qualitative data with these groups have been via face-to-face recorded interviews. This article reports on three internet-based data collection methods; email and synchronous online interviews, as well as online qualitative survey. The key characteristics of using email, sychronous online interviews and an online qualitative survey including the strengths and limitations of each are presented. Reflections and insights on the use of these internet-based data collection methods are provided to encourage researchers to embrace technology and move away from using traditional face-to-face interviews when researching with vulnerable populations. Using the internet to collect qualitative data offers additional ways to gather qualitative data over traditional data collection methods. The use of alternative interview methods may encourage participation of vulnerable participants.

Qualitative Evaluation.

ERIC Educational Resources Information Center

Stone, James C., Ed.; James, Raymond A., Ed.

1981-01-01

"Qualitative evaluation" is the theme of this issue of the California Journal of Teacher Education. Ralph Tyler states that evaluation is essentially descriptive, and using numbers does not solve basic problems. Martha Elin Vernazza examines the issue of objectivity in history and its implications for evaluation. She posits that the…

Barriers and facilitators to physical activity in people with hip or knee osteoarthritis: protocol for a systematic review of qualitative evidence.

PubMed

Kanavaki, Archontissa M; Rushton, Alison; Klocke, Rainer; Abhishek, Abhishek; Duda, Joan L

2016-11-03

This protocol aims to describe the objective and methods to be followed in a systematic review of qualitative studies on barriers and facilitators to physical activity (PA) in people with hip or knee osteoarthritis (OA). MEDLINE, EMBASE, PhychINFO, Web of Science, CINAHL, SPORTDiscus, Scopus and grey literature sources will be electronically searched. Hand search of qualitative research-centred journals, reference screening of relevant reviews and inquiries to researchers active in the field will complement the search. Studies will be selected if they apply qualitative or mixed-methods designs to directly explore factors that correspond to engagement in PA/exercise or, the perceptions regarding PA/exercise in people with hip or knee OA. The Critical Appraisal Skills Programme Qualitative Checklist and the evaluative criteria of credibility, transferability, dependability and confirmability will be applied for the study appraisal. 2 independent reviewers will perform the search, study selection and study appraisal. Thematic synthesis will be used for synthesising the findings of the primary studies and the process and product of the synthesis will be checked by a second researcher. ConQual approach will be used for assessing the confidence in the qualitative findings. This systematic review will inform our understanding of the PA determinants and how to optimise behaviour change in people living with hip or knee OA. The review findings will be reported in a peer-reviewed journal and presented at national or international conferences. The study raises no ethical issues. CRD42016030024. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

An exploratory qualitative analysis of student midwives views of teaching methods that could build their confidence to deliver perinatal bereavement care.

PubMed

Martin, Caroline J Hollins; Robb, Yvonne; Forrest, Eleanor

2016-04-01

Equipping student midwives with confidence to deliver bereavement care to childbearing women is a challenge for midwifery lecturers. To explore qualitative data provided by student midwives who evaluated the workbook Bereavement care for childbearing women and their families (Hollins Martin & Forrest, 2013) to explore their views of potential teaching strategies that could build their confidence to deliver real bereavement care. An exploratory qualitative thematic analysis was used to provide, analyse and report themes identified within data collected in a prior study. Participants were student midwives (n=179) in their second/third year of a midwifery degree program at 1 of 3 universities in the UK were included in the study. Data to evaluate effectiveness of the bereavement workbook as a teaching method was collected using a survey instrument. It was the comments written under questions by participants that were analysed in the present study. Three themes emerged: (1) increasing classroom interaction, (2) the importance of reflecting on emotions, and (3) need for experience. Although this study has addressed delivery of education that relates to midwives, the findings are cross transferable to other healthcare educators, practitioners, and students. Several solutions are proposed that could potentially build student confidence to deliver bereavement care: lecturers should (1) encourage group discussion in the classroom to help build student confidence to emotionally cope during real bereavement events; (2) ensure students gain exposure by encouraging qualified midwives to include them in real bereavement events early on in their training, and (3) develop packages of perinatal bereavement scenarios for simulation and rehearsal in the clinical skills laboratory. Post-implementation, it is recommended that these teaching strategies be evaluated. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist.

PubMed

Banna, Jinan C; Vera Becerra, Luz E; Kaiser, Lucia L; Townsend, Marilyn S

2010-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture's food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Using Qualitative Methods to Improve Questionnaires for Spanish Speakers: Assessing Face Validity of a Food Behavior Checklist

PubMed Central

BANNA, JINAN C.; VERA BECERRA, LUZ E.; KAISER, LUCIA L.; TOWNSEND, MARILYN S.

2015-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture’s food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. PMID:20102831

Deciphering the use and predictive value of "emergency medical services provider judgment" in out-of-hospital trauma triage: a multisite, mixed methods assessment.

PubMed

Newgard, Craig D; Kampp, Michael; Nelson, Maria; Holmes, James F; Zive, Dana; Rea, Thomas; Bulger, Eileen M; Liao, Michael; Sherck, John; Hsia, Renee Y; Wang, N Ewen; Fleischman, Ross J; Barton, Erik D; Daya, Mohamud; Heineman, John; Kuppermann, Nathan

2012-05-01

"Emergency medical services (EMS) provider judgment" was recently added as a field triage criterion to the national guidelines, yet its predictive value and real world application remain unclear. We examine the use and independent predictive value of EMS provider judgment in identifying seriously injured persons. We analyzed a population-based retrospective cohort, supplemented by qualitative analysis, of injured children and adults evaluated and transported by 47 EMS agencies to 94 hospitals in five regions across the Western United States from 2006 to 2008. We used logistic regression models to evaluate the independent predictive value of EMS provider judgment for Injury Severity Score ≥ 16. EMS narratives were analyzed using qualitative methods to assess and compare common themes for each step in the triage algorithm, plus EMS provider judgment. 213,869 injured patients were evaluated and transported by EMS over the 3-year period, of whom 41,191 (19.3%) met at least one of the field triage criteria. EMS provider judgment was the most commonly used triage criterion (40.0% of all triage-positive patients; sole criterion in 21.4%). After accounting for other triage criteria and confounders, the adjusted odds ratio of Injury Severity Score ≥ 16 for EMS provider judgment was 1.23 (95% confidence interval, 1.03-1.47), although there was variability in predictive value across sites. Patients meeting EMS provider judgment had concerning clinical presentations qualitatively similar to those meeting mechanistic and other special considerations criteria. Among this multisite cohort of trauma patients, EMS provider judgment was the most commonly used field trauma triage criterion, independently associated with serious injury, and useful in identifying high-risk patients missed by other criteria. However, there was variability in predictive value between sites.

Are Female Applicants Disadvantaged in National Institutes of Health Peer Review? Combining Algorithmic Text Mining and Qualitative Methods to Detect Evaluative Differences in R01 Reviewers' Critiques

PubMed Central

Magua, Wairimu; Zhu, Xiaojin; Bhattacharya, Anupama; Filut, Amarette; Potvien, Aaron; Leatherberry, Renee; Lee, You-Geon; Jens, Madeline; Malikireddy, Dastagiri; Carnes, Molly

2017-01-01

Abstract Background: Women are less successful than men in renewing R01 grants from the National Institutes of Health. Continuing to probe text mining as a tool to identify gender bias in peer review, we used algorithmic text mining and qualitative analysis to examine a sample of critiques from men's and women's R01 renewal applications previously analyzed by counting and comparing word categories. Methods: We analyzed 241 critiques from 79 Summary Statements for 51 R01 renewals awarded to 45 investigators (64% male, 89% white, 80% PhD) at the University of Wisconsin-Madison between 2010 and 2014. We used latent Dirichlet allocation to discover evaluative “topics” (i.e., words that co-occur with high probability). We then qualitatively examined the context in which evaluative words occurred for male and female investigators. We also examined sex differences in assigned scores controlling for investigator productivity. Results: Text analysis results showed that male investigators were described as “leaders” and “pioneers” in their “fields,” with “highly innovative” and “highly significant research.” By comparison, female investigators were characterized as having “expertise” and working in “excellent” environments. Applications from men received significantly better priority, approach, and significance scores, which could not be accounted for by differences in productivity. Conclusions: Results confirm our previous analyses suggesting that gender stereotypes operate in R01 grant peer review. Reviewers may more easily view male than female investigators as scientific leaders with significant and innovative research, and score their applications more competitively. Such implicit bias may contribute to sex differences in award rates for R01 renewals. PMID:28281870

The impact of early psychosocial intervention on self-efficacy of care recipient/carer dyads living with early stage dementia - A mixed methods study.

PubMed

Stockwell-Smith, G; Moyle, W; Kellett, U

2018-05-13

To evaluate the effect of a targeted community-based psychosocial intervention on self-efficacy outcomes for care recipient/carer dyads living with early-stage dementia. There is increasing interest in the role of self-efficacy and self-management structures in determining positive outcomes for people with dementia. The assumption is that care recipient/carer dyads who receive early support to identify and adjust to dementia related changes will cope better in the long-term. An explanatory sequential mixed-method design was employed. Primarily quantitative with qualitative data providing a supportive secondary role to expand on and illuminate the quantitative findings. 88 dyads were recruited and allocated on a regional basis to an intervention or control group. Intervention group dyads received the Early Diagnosis Dyadic Intervention. Control group dyads received two information manuals. Quantitative data were collected at three time-points. Qualitative data were collected via evaluation questionnaires and semi-structured interviews. Intervention structure, content and delivery were acceptable to the dyads but few quantitative self-efficacy findings reached statistical significance. Improvements in self-efficacy were evident in the post-intervention evaluation qualitative responses where dyads expressed greater confidence in identifying and accessing community support. There is an urgent need for effective psychosocial interventions to help reduce the impact of dementia symptoms on patients, carers and society. This study makes an important contribution to our understanding of the capacity of psychosocial interventions to improve self-efficacy outcomes for care recipient/carer dyads with early-stage dementia while also illustrating the challenges associated with measuring self-efficacy in the early stages of the condition. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Qualitative Evaluation of the Five-Year 'Red Collar' Campaign to End Inhumane Culling of Dogs as a Method of Rabies Control.

PubMed

Hiby, Elly; Tasker, Lou

2018-02-06

Dog-mediated human rabies can be eliminated through mass dog vaccination. Despite leading authorities in human and animal health uniting to advance effective and humane rabies control, some governments resort to lethal methods, which are unethical, often inhumane and ineffective. To end the inhumane culling of dogs in response to rabies, World Animal Protection launched 'Red Collar'; a five-year campaign (2011-2016) that worked with governments to promote the implementation of mass dog vaccination for rabies control. We present the findings from a qualitative evaluation of 'Red Collar', conducted both regionally and with national focus on Bangladesh, China, Indonesia, the Philippines and Zanzibar, Tanzania. Through semi-structured interviews and written contributions from stakeholders ( n = 54), we compared perceptions of changes with stated campaign goals to capture recommendations for future work. The campaign successfully generated momentum for implementation of mass dog vaccination by targeted governments. Lessons learned were established: Value of a consistent animal welfare 'voice'; the need to explore the motivations behind culling; the need to capacity build; time required for the 'ripple effect' to inspire humane control in other countries; importance of monitoring and evaluation of indicators; time and effort required for exit strategies and prior preparation for a robust response to culling.

Development and psychometric evaluation of a women shift workers' reproductive health questionnaire: study protocol for a sequential exploratory mixed-method study.

PubMed

Nikpour, Maryam; Tirgar, Aram; Ebadi, Abbas; Ghaffari, Fatemeh; Firouzbakht, Mojgan; Hajiahmadi, Mahmod

2018-02-06

Although shift works is a certain treat for female reproductive health, but currently, there is no standardized instrument for measuring reproductive health among female shift workers. This study aims to develop and evaluate the psychometric properties of a Women Shift Workers' Reproductive Health Questionnaire (WSW-RHQ). This is a sequential exploratory mixed-method study with a qualitative and a quantitative phase. In the qualitative phase, semi-structured interviews will be held with female shift workers who live in Mazandaran Province, Iran, additionally, the literature review will be performed by searching electronic databases. Sampling will be done in different workplaces and with maximum variation respecting female shift workers' age and job and educational and different economic situation. Interview data will be analyzed using conventional content analysis and then, the primary item pool for the questionnaire will be developed. In the quantitative phase, we will evaluate the psychometric properties of the questionnaire, i.e. its face, content, construct as well as reliability via the internal consistency, stability. Finally, a scoring system will be developed for the questionnaire. The development of WSW-RHQ will facilitate the promotion and implementation of reproductive health interventions and assessment of their effectiveness. Other scholars can cross-culturally adapt and use the questionnaire according to their immediate contexts.