Building Responsive Health Systems to Help Communities Affected by Migration: An International Delphi Consensus

PubMed Central

Pottie, Kevin; Hui, Charles; Rahman, Prinon; Ingleby, David; Akl, Elie A.; Russell, Grant; Ling, Li; Wickramage, Kolitha; Mosca, Davide; Brindis, Claire D.

2017-01-01

Persons affected by migration require health systems that are responsive and adaptable to the needs of both disadvantaged migrants and non-migrant populations. The objective of this study is to support health systems for populations affected by migration. Materials and Methods: An international Delphi consensus process was used to identify policy approaches to improve health systems for populations affected by migration. Participants were leading migrant health experts from Americas, Europe, Middle East, Asia, and Australasia. We calculated average ranking scores and qualitatively analyzed open-ended questions. Results: Participants identified the following key areas as priorities for policy development: health inequities, system discrimination, migrant related health data, disadvantaged migrant sub-groups, and considerations for disadvantaged non-migrant populations. Highly ranked items to improve health systems were: Health Equity Impact Assessment, evidence based guidelines, and the International Organization for Migration annual reports. Discussion: Policy makers need tools, data and resources to address health systems challenges. Policies need to avoid preventable deaths of migrants and barriers to basic health services. PMID:28165380

A delphi study on health in future India.

PubMed

Rohatgi, K; Rohatgi, P K

1980-07-01

A delphi study was conducted to identify or envision health scenarios in India by the year 2000. Questionnaires consisting of 48 questions on 5 areas (diagnosis and therapy; family planning; pharmaceuticals and drugs; biochemical and biomedical research; health services) were mailed to 250 experts in India. 36 responded. Results were compiled and mailed back to the respondents for changes and comments. 17 people responded. Results of the delphi study shows that policy decisions with respect to compulsory family planning as well as health education at secondary school level will precede further breakthroughs in birth control technology. Non operation reversible sterilization procedures, immunological birth control, Ayurvedic medicines for contraception and abortion, and selection of baby's sex are all possible by 2000 thereafter. Complete eradication of infectious diseases, malnutrition and associated diseases is considered unlikely before 2000, as are advances in biomedical research. Changes in health services (e.g., significant increases in hospital beds and doctors, cheap bulk drugs), particularly in rural areas, are imminent, leading to prolonging of life expectancy to 70 years. Genetic engineering may provide significant breakthroughs in the prevention of malignancies and cardiac disorders. The India delphi study is patterned after a similar delphi study conducted in the U.S. by Smith, Kline and French (SKF) Laboratories in 1968. The SKF study was able to predict some breakthroughs with basic research which have been realized.

Co-Creating Nano-Imaginaries: Report of a Delphi-Exercise

ERIC Educational Resources Information Center

Deblonde, Marian; Van Oudheusden, Michiel; Evers, Johan; Goorden, Lieve

2008-01-01

In the first phase of the research project Nanotechnologies for Tomorrow's Society (www.nanosoc.be), the research consortium explored a variety of futuristic visions or technoscientific imaginaries. This exploration took the form of a Policy Delphi, adapted to the particular objective of jointly constructing nano-imaginaries, taking participants'…

Solutions Unlimited: Delphi Study on Policy Issues in the Introduction and Management of Computers in the Classroom. Research Report 90.

ERIC Educational Resources Information Center

White, Deborah; Rampy, Leah

The Agency for Instructional Television (AIT) has established a consortium of 42 state, provincial, and local educational agencies to develop computer/video materials in problem-solving, prepare inservice materials, and define and conduct policy studies. The purpose of this study, which focuses on the last task, was two-fold: (1) to identify…

Strategies to promote better research on oral health in Africa: A Delphi consensus study

PubMed Central

Kanoute, Aïda; Faye, Daouda; Bourgeois, Denis

2014-01-01

Background: Research on oral health contributes to improved health outcomes; it is an indispensable tool in health policy. But how to fill the gaps in research oral health and to strengthen its capacity is the question. The main objective of the present study is to identify the current status of oral health research and potential strategies, thereby strengthening the research infrastructure and capacity. Delphi consultation, in the perspective of assisting decision-makers to identify strategies to promote better research on oral health in Africa, was initiated. Design and Methods: The panels of 30 experts were asked to complete the questionnaire with 42 items into four groups by web survey. Each indicator statement was considered to be in consensus if the expert's opinion rating was of “A or B” for more than 75% in a scale of seven categories. Quantitative analysis was made from the answers of Delphi round. Results: There was a strong consensus about three items concerning the role of oral health research, the development of research policy for oral health going through an effective governance of research institutes, migration of researchers and fund raising. Conclusion: This study shows strong many dispersal opinions by experts, but highlights the need for to improve the effectiveness of oral health research capacity strengthening activities. Africa's researchers, policy makers and partners will have to give special attention to ensuring that knowledge generated from oral health research is acted on to improve health for all. PMID:24808689

Economic instruments for obesity prevention: results of a scoping review and modified Delphi survey.

PubMed

Faulkner, Guy E J; Grootendorst, Paul; Nguyen, Van Hai; Andreyeva, Tatiana; Arbour-Nicitopoulos, Kelly; Auld, M Christopher; Cash, Sean B; Cawley, John; Donnelly, Peter; Drewnowski, Adam; Dubé, Laurette; Ferrence, Roberta; Janssen, Ian; Lafrance, Jeffrey; Lakdawalla, Darius; Mendelsen, Rena; Powell, Lisa M; Traill, W Bruce; Windmeijer, Frank

2011-10-06

Comprehensive, multi-level approaches are required to address obesity. One important target for intervention is the economic domain. The purpose of this study was to synthesize existing evidence regarding the impact of economic policies targeting obesity and its causal behaviours (diet, physical activity), and to make specific recommendations for the Canadian context. Arksey and O'Malley's (2005) methodological framework for conducting scoping reviews was adopted for this study and this consisted of two phases: 1) a structured literature search and review, and 2) consultation with experts in the research field through a Delphi survey and an in-person expert panel meeting in April 2010. Two key findings from the scoping review included 1) consistent evidence that weight outcomes are responsive to food and beverage prices. The debate on the use of food taxes and subsidies to address obesity should now shift to how best to address practical issues in designing such policies; and 2) very few studies have examined the impact of economic instruments to promote physical activity and clear policy recommendations cannot be made at this time. Delphi survey findings emphasised the relatively modest impact any specific economic instrument would have on obesity independently. Based on empirical evidence and expert opinion, three recommendations were supported. First, to create and implement an effective health filter to review new and current agricultural polices to reduce the possibility that such policies have a deleterious impact on population rates of obesity. Second, to implement a caloric sweetened beverage tax. Third, to examine how to implement fruit and vegetable subsidies targeted at children and low income households. In terms of economic interventions, shifting from empirical evidence to policy recommendation remains challenging. Overall, the evidence is not sufficiently strong to provide clear policy direction. Additionally, the nature of the experiments needed to provide definitive evidence supporting certain policy directions is likely to be complex and potentially unfeasible. However, these are not reasons to take no action. It is likely that policies need to be implemented in the face of an incomplete evidence base.

Economic instruments for obesity prevention: results of a scoping review and modified delphi survey

PubMed Central

2011-01-01

Background Comprehensive, multi-level approaches are required to address obesity. One important target for intervention is the economic domain. The purpose of this study was to synthesize existing evidence regarding the impact of economic policies targeting obesity and its causal behaviours (diet, physical activity), and to make specific recommendations for the Canadian context. Methods Arksey and O'Malley's (2005) methodological framework for conducting scoping reviews was adopted for this study and this consisted of two phases: 1) a structured literature search and review, and 2) consultation with experts in the research field through a Delphi survey and an in-person expert panel meeting in April 2010. Results Two key findings from the scoping review included 1) consistent evidence that weight outcomes are responsive to food and beverage prices. The debate on the use of food taxes and subsidies to address obesity should now shift to how best to address practical issues in designing such policies; and 2) very few studies have examined the impact of economic instruments to promote physical activity and clear policy recommendations cannot be made at this time. Delphi survey findings emphasised the relatively modest impact any specific economic instrument would have on obesity independently. Based on empirical evidence and expert opinion, three recommendations were supported. First, to create and implement an effective health filter to review new and current agricultural polices to reduce the possibility that such policies have a deleterious impact on population rates of obesity. Second, to implement a caloric sweetened beverage tax. Third, to examine how to implement fruit and vegetable subsidies targeted at children and low income households. Conclusions In terms of economic interventions, shifting from empirical evidence to policy recommendation remains challenging. Overall, the evidence is not sufficiently strong to provide clear policy direction. Additionally, the nature of the experiments needed to provide definitive evidence supporting certain policy directions is likely to be complex and potentially unfeasible. However, these are not reasons to take no action. It is likely that policies need to be implemented in the face of an incomplete evidence base. PMID:21978599

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process.

PubMed

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-09-10

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention.

Identification of Response Options to Artisanal and Small-Scale Gold Mining (ASGM) in Ghana via the Delphi Process

PubMed Central

Basu, Avik; Phipps, Sean; Long, Rachel; Essegbey, George; Basu, Niladri

2015-01-01

The Delphi technique is a means of facilitating discussion among experts in order to develop consensus, and can be used for policy formulation. This article describes a modified Delphi approach in which 27 multi-disciplinary academics and 22 stakeholders from Ghana and North America were polled about ways to address negative effects of small-scale gold mining (ASGM) in Ghana. In early 2014, the academics, working in disciplinary groups, synthesized 17 response options based on data aggregated during an Integrated Assessment of ASGM in Ghana. The researchers participated in two rounds of Delphi polling in March and April 2014, during which 17 options were condensed into 12. Response options were rated via a 4-point Likert scale in terms of benefit (economic, environmental, and benefit to people) and feasibility (economic, social/cultural, political, and implementation). The six highest-scoring options populated a third Delphi poll, which 22 stakeholders from diverse sectors completed in April 2015. The academics and stakeholders also prioritized the response options using ranking exercises. The technique successfully gauged expert opinion on ASGM, and helped identify potential responses, policies and solutions for the sector. This is timely given that improvement to the ASGM sector is an important component within the UN Minamata Convention. PMID:26378557

Establishment of a dental license regulation authority is required in Korea: results of the Delphi technique.

PubMed

Choi, Jin-Woo; Kim, Kack-Kyun; Lee, Jihyun; Choi, Dong-Ju; Kim, Kyung-Nyun

2017-01-01

In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea. Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed. After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group. The quality of dental treatment should be managed to protect patients and dental professionals. For this purpose, the establishment of an independent license regulation authority along with legislative changes is required.

Application of Delphi-AHP methods to select the priorities of WEEE for recycling in a waste management decision-making tool.

PubMed

Kim, Mincheol; Jang, Yong-Chul; Lee, Seunguk

2013-10-15

The management of waste electrical and electronic equipment (WEEE) or electronic waste (e-waste) has become a major issue of concern for solid waste communities due to the large volumes of waste being generated from the consumption of modern electrical and electronic products. In 2003, Korea introduced the extended producer responsibility (EPR) system to reduce the amount of electronic products to be disposed and to promote resource recovery from WEEE. The EPR currently regulates a total of 10 electrical and electronic products. This paper presents the results of the application of the Delphi method and analytical hierarchy process (AHP) modeling to the WEEE management tool in the policy-making process. Specifically, this paper focuses on the application of the Delphi-AHP technique to determine the WEEE priority to be included in the EPR system. Appropriate evaluation criteria were derived using the Delphi method to assess the potential selection and priority among electrical and electronic products that will be regulated by the EPR system. Quantitative weightings from the AHP model were calculated to identify the priorities of electrical and electronic products to be potentially regulated. After applying all the criteria using the AHP model, the results indicate that the top 10 target recycling products for the expansion of the WEEE list were found to be vacuum cleaners, electric fans, rice cookers, large freezers, microwave ovens, water purifiers, air purifiers, humidifiers, dryers, and telephones in order from the first to last. The proposed Delphi-AHP method can offer a more efficient means of selecting WEEE than subjective assessment methods that are often based on professional judgment or limited available data. By providing WEEE items to be regulated, the proposed Delphi-AHP method can eliminate uncertainty and subjective assessment and enable WEEE management policy-makers to identify the priority of potential WEEE. More generally, the work performed in this study is an example of how Delphi-AHP modeling can be used as a decision-making process tool in WEEE management. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review.

PubMed

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D'Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2017-09-01

There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018.

What works for wellbeing in culture and sport? Report of a DELPHI process to support coproduction and establish principles and parameters of an evidence review

PubMed Central

Daykin, Norma; Mansfield, Louise; Payne, Annette; Kay, Tess; Meads, Catherine; D’Innocenzo, Giorgia; Burnett, Adele; Dolan, Paul; Julier, Guy; Longworth, Louise; Tomlinson, Alan; Testoni, Stefano; Victor, Christina

2016-01-01

Aims: There is a growing recognition of the ways in which culture and sport can contribute to wellbeing. A strong evidence base is needed to support innovative service development and a 3-year research programme is being undertaken to capture best evidence of wellbeing impacts and outcomes of cultural and sporting activities in order to inform UK policy and practice. This article provides an overview of methods and findings from an initial coproduction process with key stakeholders that sought to explore and agree principles and parameters of the evidence review for culture, sport and wellbeing (CSW). Methods: A two-stage DELPHI process was conducted with a purposeful sample of 57 stakeholders between August and December 2015. Participants were drawn from a range of culture and sport organisations and included commissioners and managers, policy makers, representatives of service delivery organisations (SDOs) and scholars. The DELPHI 1 questionnaire was developed from extensive consultation in July and August 2015. It explored definitions of wellbeing, the role of evidence, quality assessment, and the culture and sport populations, settings and interventions that are most likely to deliver wellbeing outcomes. Following further consultation, the results, presented as a series of ranked statements, were sent back to participants (DELPHI 2), which allowed them to reflect on and, if they wished, express agreement or disagreement with the emerging consensus. Results: A total of 40 stakeholders (70.02%) responded to the DELPHI questionnaires. DELPHI 1 mapped areas of agreement and disagreement, confirmed in DELPHI 2. The exercise drew together the key priorities for the CSW evidence review. Conclusion: The DELPHI process, in combination with face-to-face deliberation, enabled stakeholders to engage in complex discussion and express nuanced priorities while also allowing the group to come to an overall consensus and agree outcomes. The results will inform the CSW evidence review programme until its completion in March 2018. PMID:27789779

Wireless technologies and accessibility for people with disabilities: findings from a policy research instrument.

PubMed

Baker, Paul M A; Moon, Nathan W

2008-01-01

The near universal deployment in the United States of a wide variety of information and communications technologies, both wired and wireless, creates potential barriers to use for several key populations, including the poor, people with disabilities, and the aging. Equal access to wireless technologies and services can be achieved through a variety of mechanisms, including legislation and regulations, market-based solutions, and awareness and outreach-based approaches. This article discusses the results of policy research conducted by the Rehabilitation Engineering Research Center on Wireless Technologies (Wireless RERC) using policy Delphi polling methodology to probe stakeholders' opinions on key access barrier issues and to explore potential policy responses. Participants included disability advocates, disability/wireless technology policy makers, and product developers/manufacturers. Respondent input informed subsequent development of potential policy initiatives to increase access to these technologies. The findings from the Delphi suggest that awareness issues remain most important, especially manufacturer awareness of user needs and availability of consumer information for selecting the most appropriate wireless devices and services. Other key issues included the ability of people with disabilities to afford technologies and inadequacies in legislation and policy making for ensuring their general accessibility, as well as usefulness in emergencies. Technical issues, including interoperability, speech-to-text conversion, and hearing aid compatibility, were also identified by participating stakeholders as important. To address all these issues, Delphi respondents favored goals and options congruent with voluntary market-driven solutions where possible but also supported federal involvement, where necessary, to aid this process.

Multi-criteria decision analysis of breast cancer control in low- and middle- income countries: development of a rating tool for policy makers.

PubMed

Venhorst, Kristie; Zelle, Sten G; Tromp, Noor; Lauer, Jeremy A

2014-01-01

The objective of this study was to develop a rating tool for policy makers to prioritize breast cancer interventions in low- and middle- income countries (LMICs), based on a simple multi-criteria decision analysis (MCDA) approach. The definition and identification of criteria play a key role in MCDA, and our rating tool could be used as part of a broader priority setting exercise in a local setting. This tool may contribute to a more transparent priority-setting process and fairer decision-making in future breast cancer policy development. First, an expert panel (n = 5) discussed key considerations for tool development. A literature review followed to inventory all relevant criteria and construct an initial set of criteria. A Delphi study was then performed and questionnaires used to discuss a final list of criteria with clear definitions and potential scoring scales. For this Delphi study, multiple breast cancer policy and priority-setting experts from different LMICs were selected and invited by the World Health Organization. Fifteen international experts participated in all three Delphi rounds to assess and evaluate each criterion. This study resulted in a preliminary rating tool for assessing breast cancer interventions in LMICs. The tool consists of 10 carefully crafted criteria (effectiveness, quality of the evidence, magnitude of individual health impact, acceptability, cost-effectiveness, technical complexity, affordability, safety, geographical coverage, and accessibility), with clear definitions and potential scoring scales. This study describes the development of a rating tool to assess breast cancer interventions in LMICs. Our tool can offer supporting knowledge for the use or development of rating tools as part of a broader (MCDA based) priority setting exercise in local settings. Further steps for improving the tool are proposed and should lead to its useful adoption in LMICs.

Improving the care of older persons in Australian prisons using the Policy Delphi method.

PubMed

Patterson, Karen; Newman, Claire; Doona, Katherine

2016-09-01

There are currently no internationally recognised and approved processes relating to the care of older persons with dementia in prison. This research aimed to develop tools and procedures related to managing the care of, including the identification and assessment of, older persons with dementia who are imprisoned in New South Wales, Australia. A modified approach to the Policy Delphi method, using both surveys and facilitated discussion groups, enabled experts to come together to discuss improving the quality of care provision for older persons with dementia in prison and achieve research aims. © The Author(s) 2014.

Using Stakeholder Input to Inform an Innovative Research and Policy Initiative to Improve Depression in Safety Net Communities.

PubMed

Khodyakov, Dmitry; Williams, Pluscedia; Bromley, Elizabeth; Chung, Bowen; Wells, Kenneth

Depression quality improvement programs based on chronic disease management models have been shown to improve depression outcomes. Nonetheless, access to and the use of such programs is limited in minority, under-resourced communities. We report on the outcomes of a Delphi-based consensus exercise conducted by our partnership at a community-wide conference in Los Angeles. Participants identified and prioritized the needs of depressed individuals that should be addressed in a county-wide Health Neighborhood Initiative designed to increase existing mental health, substance use, healthcare, and social services for individuals with low socioeconomic position. Participants agreed that housing is the number one priority. Delphi results also illustrate the importance of addressing social, spiritual, and healthcare access needs of depressed individuals. Our study shows how to systematically engage community-based organizations, patients, families, and community members in the process of improving the design of community-wide health policy initiatives.

Foresight Model of Turkey's Defense Industries' Space Studies until 2040

NASA Astrophysics Data System (ADS)

Yuksel, Nurdan; Cifci, Hasan; Cakir, Serhat

2016-07-01

Being advanced in science and technology is inevitable reality in order to be able to have a voice in the globalized world. Therefore, for the countries, making policies in consistent with their societies' intellectual, economic and political infrastructure and attributing them to the vision having been embraced by all parties of the society is quite crucial for the success. The generated policies are supposed to ensure the usage of countries' resources in the most effective and fastest way, determine the priorities and needs of society and set their goals and related roadmaps. In this sense, technology foresight studies based on justified forecasting in science and technology have critical roles in the process of developing policies. In this article, Foresight Model of Turkey's Defense Industries' Space Studies, which is turned out to be the important part of community life and fundamental background of most technologies, up to 2040 is presented. Turkey got late in space technology studies. Hence, for being fast and efficient to use its national resources in a cost effective way and within national and international collaboration, it should be directed to its pre-set goals. By taking all these factors into consideration, the technology foresight model of Turkey's Defense Industry's Space Studies was presented in the study. In the model, the present condition of space studies in the World and Turkey was analyzed; literature survey and PEST analysis were made. PEST analysis will be the inputs of SWOT analysis and Delphi questionnaire will be used in the study. A two-round Delphi survey will be applied to the participants from universities, public and private organizations operating in space studies at Defense Industry. Critical space technologies will be distinguished according to critical technology measures determined by expert survey; space technology fields and goals will be established according to their importance and feasibility indexes. Finally, for the decision makers, opportunist and possible prospective exploratory scenarios will be set forth according to determined vision. Keywords Turkey's Defense Industries, Space Studies, Foresight, PEST, SWOT, Delphi

The comparative evaluation of expanded national immunization policies in Korea using an analytic hierarchy process.

PubMed

Shin, Taeksoo; Kim, Chun-Bae; Ahn, Yang-Heui; Kim, Hyo-Youl; Cha, Byung Ho; Uh, Young; Lee, Joo-Heon; Hyun, Sook-Jung; Lee, Dong-Han; Go, Un-Yeong

2009-01-29

The purpose of this paper is to propose new evaluation criteria and an analytic hierarchy process (AHP) model to assess the expanded national immunization programs (ENIPs) and to evaluate two alternative health care policies. One of the alternative policies is that private clinics and hospitals would offer free vaccination services to children and the other of them is that public health centers would offer these free vaccination services. Our model to evaluate the ENIPs was developed using brainstorming, Delphi techniques, and the AHP model. We first used the brainstorming and Delphi techniques, as well as literature reviews, to determine 25 criteria with which to evaluate the national immunization policy; we then proposed a hierarchical structure of the AHP model to assess ENIPs. By applying the proposed AHP model to the assessment of ENIPs for Korean immunization policies, we show that free vaccination services should be provided by private clinics and hospitals rather than public health centers.

Defining Advance Care Planning for Adults: A Consensus Definition from a Multidisciplinary Delphi Panel

PubMed Central

Sudore, Rebecca L.; Lum, Hillary D.; You, John J.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Matlock, Daniel D.; Rietjens, Judith A. C.; Korfage, Ida J.; Ritchie, Christine S.; Kutner, Jean S.; Teno, Joan M.; Thomas, Judy; McMahan, Ryan D.; Heyland, Daren K.

2017-01-01

Background Despite increasing interest in advance care planning (ACP) and prior ACP descriptions, a consensus definition does not yet exist to guide clinical, research, and policy initiatives. Objective To develop a consensus definition of ACP for adults. Design Delphi Panel Setting/Participants Participants included a multidisciplinary panel of international ACP experts consisting of 52 clinicians, researchers, and policy leaders from 4 countries, and a patient/surrogate advisory committee. Measurements We conducted 10 rounds of a modified Delphi method and qualitatively analyzed panelists’ input. Panelists identified several themes lacking consensus, and iteratively discussed and developed a final consensus definition. Results Panelists identified several tensions concerning ACP concepts such as whether the definition should focus on conversations vs. written advance directives; patients’ values vs. treatment preferences; current shared decision making vs. future medical decisions; and who should be included in the process. The panel achieved a final consensus one-sentence definition and accompanying goals statement: “Advance care planning is a process that supports adults at any age or stage of health in understanding and sharing their personal values, life goals, and preferences regarding future medical care. The goal of advance care planning is to help ensure that people receive medical care that is consistent with their values, goals and preferences during serious and chronic illness.” The panel also described strategies to best support adults in ACP. Conclusions A multidisciplinary Delphi panel developed a consensus definition for ACP for adults that can be used to inform implementation and measurement of ACP clinical, research, and policy initiatives. PMID:28062339

The Role of Key Qualifications in the Transition from Vocational Education to Work

ERIC Educational Resources Information Center

van Zolingen, S. J.

2002-01-01

This study presents a new definition of key qualifications related to occupations based on an extensive literature search. The empirical aspect of this study describes a Delphi study focused on policy where a number of key qualifications were operationalized for three selected jobs: commercial employee at a bank, claims assessor or acceptor at an…

Climate Change Impacts and Vulnerability Assessment in Industrial Complexes

NASA Astrophysics Data System (ADS)

Lee, H. J.; Lee, D. K.

2016-12-01

Climate change has recently caused frequent natural disasters, such as floods, droughts, and heat waves. Such disasters have also increased industrial damages. We must establish climate change adaptation policies to reduce the industrial damages. It is important to make accurate vulnerability assessment to establish climate change adaptation policies. Thus, this study aims at establishing a new index to assess vulnerability level in industrial complexes. Most vulnerability indices have been developed with subjective approaches, such as the Delphi survey and the Analytic Hierarchy Process(AHP). The subjective approaches rely on the knowledge of a few experts, which provokes the lack of the reliability of the indices. To alleviate the problem, we have designed a vulnerability index incorporating objective approaches. We have investigated 42 industrial complex sites in Republic of Korea (ROK). To calculate weights of variables, we used entropy method as an objective method integrating the Delphi survey as a subjective method. Finally, we found our method integrating both subjective method and objective method could generate result. The integration of the entropy method enables us to assess the vulnerability objectively. Our method will be useful to establish climate change adaptation policies by reducing the uncertainties of the methods based on the subjective approaches.

Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure

PubMed Central

2013-01-01

Background The quantity and quality of studies in child and adolescent physical activity and sedentary behaviour have rapidly increased, but research directions are often pursued in a reactive and uncoordinated manner. Aim To arrive at an international consensus on research priorities in the area of child and adolescent physical activity and sedentary behaviour. Methods Two independent panels, each consisting of 12 experts, undertook three rounds of a Delphi methodology. The Delphi methodology required experts to anonymously answer questions put forward by the researchers with feedback provided between each round. Results The primary outcome of the study was a ranked set of 29 research priorities that aimed to be applicable for the next 10 years. The top three ranked priorities were: developing effective and sustainable interventions to increase children’s physical activity long-term; policy and/or environmental change and their influence on children’s physical activity and sedentary behaviour; and prospective, longitudinal studies of the independent effects of physical activity and sedentary behaviour on health. Conclusions These research priorities can help to guide decisions on future research directions. PMID:24228891

A modified Delphi study towards developing a guideline to inform policy on fetal alcohol spectrum disorders in South Africa: a study protocol

PubMed Central

Mukumbang, Ferdinand C; Okop, Kufre J; Beytell, Anna-Marie

2018-01-01

Introduction Maternal alcohol consumption during pregnancy can result in mental and physical birth defects in individuals. These birth defects are usually described as fetal alcohol spectrum disorders (FASDs). With an estimated 183–259 per 1000 children born with FASDs, South Africa is identified to have the highest prevalence of FASDs in the world. Nevertheless, there is a lack of appropriate policies, guidelines and interventions addressing the issues around FASDs. This protocol outlines a proposed process for developing a guideline to inform policies on FASDs. Methods and analysis This process will have three phases. Phase I will be carried out in three steps; we plan to conduct a document review of available policies on the prevention and management of FASDs and update the existing systematic review on FASDs interventions. The aim of the two reviews is to explore the availability and content of existing policies and global interventions on FASDs. In addition, we will conduct two exploratory qualitative studies to obtain the perspectives of various stakeholders on the existing or possible guidelines and policies for the management of FASDs and available interventions and services. In phase II, we will aggregate the findings of the previous phase to develop a prototype guideline. In phase III, using the developed prototype, we will apply the Delphi approach with experts on FASDs, soliciting their opinions on the nature and content of the proposed guidelines for policies. The information gathered will be used to modify the prototype to formulate a policy guideline on FASDs. The data will be analysed using thematic analysis and narrative synthesis. Ethics and dissemination Ethical clearance has been obtained from the ethics committee of the university and governmental departments. The findings will be disseminated through publications and the guideline will be submitted to relevant departments. PMID:29703853

[Prioritization and Consentation of Criteria for the Appraisal, Funding and Evaluation of Projects from the German Innovationsfonds: A multi-perspective Delphi study].

PubMed

Schmitt, J; Petzold, T; Nellessen-Martens, G; Pfaff, H

2015-09-01

The German Innovationsfonds provides the chance for evidence-based developments of the German healthcare system. Prioritization of recommendations for an effective, efficient, fair, transparent, and sustainable granting of funds through a transparent, evidence-driven consensus-process involving all relevant stakeholder groups. Representatives from health and research policy, payers, patient representatives, healthcare providers, and scientists were invited to nominate participants for an electronic 3 round iterative Delphi-study to prioritize the thematic focus, requirements concerning study methods, the team of applicants, evaluation, utilization of study results, and for the selection of reviewers. Criteria considered as relevant by at least 60% of the panel (consensus definition) in the first 2 Delphi rounds were rated as facultative, preferable, or obligatory criteria for project funding. Data were analyzed descriptively. ( Datenbank Versorgungsforschung Deutschland VfD_15_003561). All invited stakeholder groups except payers participated. 34 (85%) of 40 nominated representatives participated in the Delphi-study. A total of 64 criteria were consented as relevant for project review and funding concerning the thematic focus (n=28), methodological requirements (n=13), requirements for applicants (n=4), for the evaluation (n=4), utilization (n=6), and selection of peer reviewers (n=9). It is the collective responsibility of all stakeholders to spend the designated funds as efficient and sustainable as possible. The consented recommendations shall serve decision makers as a resource for the granting of funds and the evaluation of the Innovationsfonds. © Georg Thieme Verlag KG Stuttgart · New York.

Development of measurable indicators to enhance public health evidence-informed policy-making.

PubMed

Tudisca, Valentina; Valente, Adriana; Castellani, Tommaso; Stahl, Timo; Sandu, Petru; Dulf, Diana; Spitters, Hilde; Van de Goor, Ien; Radl-Karimi, Christina; Syed, Mohamed Ahmed; Loncarevic, Natasa; Lau, Cathrine Juel; Roelofs, Susan; Bertram, Maja; Edwards, Nancy; Aro, Arja R

2018-05-31

Ensuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations. The indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project 'REsearch into POlicy to enhance Physical Activity' (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators. The first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists' suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation. The study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.

Policy and Systems Issues Limiting the Participation of Historically Black Colleges and Universities in the Federal Disability Research Agenda

ERIC Educational Resources Information Center

Moore, Corey L.; Johnson, Jean E.; Manyibe, Edward O.; Washington, Andre L.; Uchegbu, Nkechi E.; Cross, Kenyotta Eugene; Hollis-Staten, Bridget; Turner-Whittaker, Tyra; Edwards, Yolanda

2012-01-01

This study reports on an investigation of barriers that prevent Historically Black Colleges and Universities (HBCUs) from fully participating in the federal disability and rehabilitation research and development (R&D) agenda. The Delphi technique was used to examine panelists' perceptions on the importance of contextual R&D barriers…

The Decentralization of Perkins: History, Impact, and Recommendations for Future CTE Legislation

ERIC Educational Resources Information Center

Manley, R. Adam

2011-01-01

The purpose of this study was to identify the impact the 1990 amendments to Carl D. Perkins Career and Applied Technology Act within-state allocation of federal funds had on the operational infrastructure of secondary career and technical education (OISCTE) in Virginia. Using the policy Delphi research technique, the researcher identified 161…

Promoting good policy for leadership and governance of health related rehabilitation: a realist synthesis.

PubMed

McVeigh, Joanne; MacLachlan, Malcolm; Gilmore, Brynne; McClean, Chiedza; Eide, Arne H; Mannan, Hasheem; Geiser, Priscille; Duttine, Antony; Mji, Gubela; McAuliffe, Eilish; Sprunt, Beth; Amin, Mutamad; Normand, Charles

2016-08-24

Good governance may result in strengthened performance of a health system. Coherent policies are essential for good health system governance. The overall aim of this research is to provide the best available scientific evidence on principles of good policy related leadership and governance of health related rehabilitation services in less resourced settings. This research was also conducted to support development of the World Health Organization's (WHO) Guidelines on health related rehabilitation. An innovative study design was used, comprising two methods: a systematic search and realist synthesis of literature, and a Delphi survey of expert stakeholders to refine and triangulate findings from the realist synthesis. In accordance with Pawson and Tilley's approach to realist synthesis, we identified context mechanism outcome pattern configurations (CMOCs) from the literature. Subsequently, these CMOCs were developed into statements for the Delphi survey, whereby 18 expert stakeholders refined these statements to achieve consensus on recommendations for policy related governance of health related rehabilitation. Several broad principles emerged throughout formulation of recommendations: participation of persons with disabilities in policy processes to improve programme responsiveness, efficiency, effectiveness, and sustainability, and to strengthen service-user self-determination and satisfaction; collection of disaggregated disability statistics to support political momentum, decision-making of policymakers, evaluation, accountability, and equitable allocation of resources; explicit promotion in policies of access to services for all subgroups of persons with disabilities and service-users to support equitable and accessible services; robust inter-sectoral coordination to cultivate coherent mandates across governmental departments regarding service provision; and 'institutionalizing' programmes by aligning them with preexisting Ministerial models of healthcare to support programme sustainability. Alongside national policymakers, our policy recommendations are relevant for several stakeholders, including service providers and service-users. This research aims to provide broad policy recommendations, rather than a strict formula, in acknowledgement of contextual diversity and complexity. Accordingly, our study proposes general principles regarding optimal policy related governance of health related rehabilitation in less resourced settings, which may be valuable across diverse health systems and contexts.

Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age.

ERIC Educational Resources Information Center

Eggers, Renee M.; Jones, Charles M.

1998-01-01

In addition to giving an overview of Delphi methodology and describing the methodology used by the researchers in two Delphi studies, the authors provide information about electronic communication in Delphi studies. Also provided are suggestions that can be used in a Delphi study involving any form of communication. (SLD)

Determinants of Social Accountability in Iranian Nursing and Midwifery Schools: A Delphi Study.

PubMed

Salehmoghaddam, Amir Reza; Mazloom, Seyed Reza; Sharafkhani, Mohammad; Gholami, Hassan; Emami Zeydi, Amir; Khorashadizadeh, Fatemeh; Emadzadeh, Ali

2017-04-01

Revising the medical education programs to meet the needs of society has become both a necessity and an important priority due to the considerable increase of population, changing patterns of diseases, and new health priorities. While this necessity has been highlighted in Iran's Fifth Development Plan as well as its National 2025 Vision Plan, the determinants of social accountability have not been explained yet. This study aimed to develop determinants of social accountability in the Iranian Nursing and Midwifery Schools. This classic Delphi study included thirty experts in Nursing and Midwifery Education, Research and Services selected based on purposive sampling and three rounds of Delphi technique and conducted in Nursing and Midwifery School of Mashhad University of Medical Sciences. The primary data were collected using an initial structured questionnaire prepared through extensive review of literature. SPSS 11.5 software was used to analyze the data. The interquartile deviation and percentage of agreement were also used to study the consensus of opinion by experts. Finding obtained from the rounds of Delphi resulted in selecting 69 determinants out of the initial pool of 128 primary determinants of social accountability. The items were selected based on experts' consensus and categorized under three main activities of Nursing and Midwifery School, namely education, research, and service. Social accountability determinants were explained by 69 items for Schools of Nursing and Midwifery in Iran. The proposed determinants can be used by managers and authorities of Nursing and Midwifery School, policy makers, and evaluating institutions associated with them to ensure realizing social accountability goals.

Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey.

PubMed

Colagiuri, Ruth; Boylan, Sinead; Morrice, Emily

2015-10-16

Climate change and non-communicable diseases (NCDs) are arguably the greatest global challenges of the 21st Century. However, the confluence between them remains under-examined and there is little evidence of a comprehensive, systematic approach to identifying research priorities to mitigate their joint impact. Consequently, we: (i) convened a workshop of academics (n = 25) from the Worldwide Universities Network to identify priority areas at the interface between NCDs and climate change; (ii) conducted a Delphi survey of international opinion leaders in public health and relevant other disciplines; and (iii) convened an expert panel to review and advise on final priorities. Three research areas (water security; transport; conceptualising NCD harms to support policy formation) were listed among the top 10 priorities by >90% of Delphi respondents, and ranked among the top 12 priorities by >60% of respondents who ranked the order of priority. A fourth area (reducing the carbon footprint of cities) was ranked highest by the same >60% of respondents. Our results are consistent with existing frameworks on health and climate change, and extends them by focusing specifically on NCDs. Researching these priorities could progress understanding of climate change and NCDs, and inform global and national policy decisions for mitigating associated harms.

Use of modified Delphi to plan knowledge translation for decision makers: an application in the field of advanced practice nursing.

PubMed

Carter, Nancy; Lavis, John N; MacDonald-Rencz, Sandra

2014-01-01

Disseminating research to decision makers is difficult. Interaction between researchers and decision makers can identify key messages and processes for dissemination. To gain agreement on the key findings from a synthesis on the integration of advanced practice nurses, we used a modified Delphi process. Nursing decision makers contributed ideas via e-mail, discussed and clarified ideas face to face, and then prioritized statements. Sixteen (89%) participated and 14 (77%) completed the final phase. Priority key messages were around access to care and outcomes. The majority identified "NPs increase access to care" and "NPs and CNSs improve patient and system outcomes" as priority messaging statements. Participants agreed policy makers and the public were target audiences for messages. Consulting with policy makers provided the necessary context to develop tailored policy messages and is a helpful approach for research dissemination. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Developing Policy for Integrating Biomedicine and Traditional Chinese Medical Practice Using Focus Groups and the Delphi Technique

PubMed Central

Chung, Vincent C. H.; Ma, Polly H. X.; Lau, Chun Hong; Griffiths, Sian M.

2012-01-01

In Hong Kong, statutory regulation for traditional Chinese medicine (TCM) practitioners has been implemented in the past decade. Increasing use of TCM on top of biomedicine (BM) services by the population has been followed; but corresponding policy development to integrate their practices has not yet been discussed. Using focus group methodology, we explore policy ideas for integration by collating views from frontline BM (n = 50) and TCM clinicians (n = 50). Qualitative data were analyzed under the guidance of structuration model of collaboration, a theoretical model for understanding interprofessional collaboration. From focus group findings we generated 28 possible approaches, and subsequently their acceptability was assessed by a two round Delphi survey amongst BM and TCM policy stakeholders (n = 12). Consensus was reached only on 13 statements. Stakeholders agreed that clinicians from both paradigms should share common goals of providing patient-centered care, promoting the development of protocols for shared care and information exchange, as well as strengthening interprofessional connectivity and leadership for integration. On the other hand, attitudes amongst policy stakeholders were split on the possibility of fostering trust and mutual learning, as well as on enhancing innovation and governmental support. Future policy initiatives should focus on these controversial areas. PMID:22649469

Stakeholders' resistance to telemedicine with focus on physicians: utilizing the Delphi technique.

PubMed

Choi, Woo Seok; Park, Joowoong; Choi, Jin Young Brian; Yang, Jae-Suk

2018-01-01

Introduction Sufficient infrastructure for information and communications technology (ICT) and a well-established policy are necessary factors for smooth implementation of telemedicine. However, despite these necessary conditions being met, there are situations where telemedicine still fails to be accepted as a system due to the low receptivity of stakeholders. In this study, we analyse stakeholders' resistance to an organization's implementation of telemedicine. Focusing on the physicians' interests, we propose a strategy to minimize conflicts and improve acceptance. Methods The Delphi study involved 190 telemedicine professionals who were recommended by 485 telemedicine-related personnel in South Korea. Results Out of 190 professionals, 60% of enrolled participants completed the final questionnaires. The stakeholders were categorized into four groups: policy-making officials, physicians, patients, and industrialists. Among these, the physicians were most opposed to the adoption of telemedicine. The main causes of such opposition were found to be the lack of a medical services delivery system and the threat of disruption for primary care clinics. Very little consensus was observed among the stakeholders, except on the following points: the need for expansion of the national health insurance budget by the government, and the need for enhancement of physicians' professional autonomy to facilitate smooth agreements. Discussion Our analysis on the causes of the resistance to telemedicine, carried out with the groups mentioned above, has important implications for policy-makers deriving strategies to achieve an appropriate consensus.

Report of Activities and Accomplishments: March 1, 1968 to February 28, 1969. Final Report.

ERIC Educational Resources Information Center

Green, Thomas F.; And Others

From 1968 to 1969 the EPRC focused on: staff development, definition of a specific research program, and development of methods to deal with educational policy issues in the context of longrange futures. The research program of the center is organized around educational futures and policy planning. Specific methods include Delphi techniques, goal…

Considerations when conducting e-Delphi research: a case study.

PubMed

Toronto, Coleen

2017-06-22

Background E-Delphi is a way to access a geographically dispersed group of experts. It is similar to other Delphi methods but conducted online. E-research methodologies, such as the e-Delphi method, have yet to undergo significant critical discussion. Aim To highlight some of the challenges nurse researchers may wish to consider when using e-Delphi in their research. Discussion This paper provides details about the author's approach to conducting an e-Delphi study in which a group of health literacy nurse experts (n=41) used an online survey platform to identify and prioritise essential health literacy competencies for registered nurses. Conclusion This paper advances methodological discourse about e-Delphi by critically assessing an e-Delphi case study. The online survey platform used in this study was advantageous for the researcher and the experts: the experts could participate at any time and place where the internet was available; the researcher could efficiently access a national group of experts, track responses and analyse data in each round. Implications for practice E-Delphi studies create opportunities for nurse researchers to conduct research nationally and internationally. Before conducting an e-Delphi study, researchers should carefully consider the design and methods for collecting data, to avoid challenges that could potentially compromise the quality of the findings. Researchers are encouraged to publish details about their approaches to e-Delphi studies, to advance the state of the science.

Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers.

PubMed

Li, Ying; Ehiri, John; Hu, Daiyu; Oren, Eyal; Cao, Jia

2015-12-15

Although TB health promotion directed at policy makers and healthcare workers (HCWs) is considered important to tuberculosis (TB) control, no indicators currently assess the impact of such promotional activities. This article is the second in a series of papers that seek to establish a framework of behavioral indicators for outcome evaluation of TB health promotion, using the Delphi method. In the first article, we sought to establish a framework of behavioral indicators for outcome evaluation of TB health promotion among TB suspects and patients. The objective of this second article is to present an indicator framework that can be used to assess behavioral outcomes of TB health promotion directed at policy makers and HCWs. A two-round, modified Delphi method was used to establish the indicators. Sixteen experts who were knowledgeable and experienced in the field of TB control were consulted in Delphi surveys. A questionnaire was developed following 4 steps, and involved ranking indicators on a five-point Likert scale. The consensus level was 70 %. Median, mode, and Coefficient of variation (CV) were used to describe expert responses. An authority coefficient (Cr) was used to assess the degree of each expert's authority. Consensus was achieved following the two survey rounds and several iterations among the experts. For TB health-promotion activities directed at policymakers, the experts reached consensus on 2 domains ("Resource inputs" and "Policymaking and monitoring behaviors"), 4 subdomains ("Human resources" among others), and 13 indicators ("Human resources per 100,000 person" among others). For TB health-promotion activities directed at HCWs, the experts reached consensus on 5 domains ("Self-protective behaviors" among others), 6 sub-domains ("Preventing infection" among others), and 15 indicators ("Average hours of daily workplace disinfection by ultraviolet radiation" among others). This study identified a conceptual framework of core behavioral indicators to evaluate TB health-promotion activities directed at policymakers and HCWs involved in TB control. Validation in other parts of the world could lead to global consensus on behavioral indicators to evaluate TB health promotion targeted at policymakers and HCWs.

Global priorities for research and the relative importance of different research outcomes: an international Delphi survey of malaria research experts.

PubMed

Mulligan, Jo-Ann; Conteh, Lesong

2016-12-06

As global research investment increases, attention inevitably turns to assessing and measuring the outcomes and impact from research programmes. Research can have many different outcomes such as producing advances in scientific knowledge, building research capacity and, ultimately, health and broader societal benefits. The aim of this study was to test the use of a Delphi methodology as a way of gathering views from malaria research experts on research priorities and eliciting relative valuations of the different types of health research impact. An international Delphi survey of 60 malaria research experts was used to understand views on research outcomes and priorities within malaria and across global health more widely. The study demonstrated the application of the Delphi technique to eliciting views on malaria specific research priorities, wider global health research priorities and the values assigned to different types of research impact. In terms of the most important past research successes, the development of new anti-malarial drugs and insecticide-treated bed nets were rated as the most important. When asked about research priorities for future funding, respondents ranked tackling emerging drug and insecticide resistance the highest. With respect to research impact, the panel valued research that focuses on health and health sector benefits and informing policy and product development. Contributions to scientific knowledge, although highly valued, came lower down the ranking, suggesting that efforts to move research discoveries to health products and services are valued more highly than pure advances in scientific knowledge. Although the Delphi technique has been used to elicit views on research questions in global health this was the first time it has been used to assess how a group of research experts value or rank different types of research impact. The results suggest it is feasible to inject the views of a key stakeholder group into the research prioritization process and the Delphi approach is a useful tool for eliciting views on the value or importance of research impact. Future work will explore other methods for assessing and valuing research impact and test the feasibility of developing a composite tool for measuring research outcomes weighted by the values of different stakeholders.

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology

PubMed Central

Magalhães-Sant'Ana, M.; More, S. J.; Morton, D. B.; Hanlon, A.

2016-01-01

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. PMID:27613779

Ethical challenges facing veterinary professionals in Ireland: results from Policy Delphi with vignette methodology.

PubMed

Magalhães-Sant'Ana, M; More, S J; Morton, D B; Hanlon, A

2016-10-29

Ethics is key to the integrity of the veterinary profession. Despite its importance, there is a lack of applied research on the range of ethical challenges faced by veterinarians. A three round Policy Delphi with vignette methodology was used to record the diversity of views on ethical challenges faced by veterinary professionals in Ireland. Forty experts, comprising veterinary practitioners, inspectors and nurses, accepted to participate. In round 1, twenty vignettes describing a variety of ethically challenging veterinary scenarios were ranked in terms of ethical acceptability, reputational risk and perceived standards of practice. Round 2 aimed at characterising challenges where future policy development or professional guidance was deemed to be needed. In round 3, possible solutions to key challenges were explored. Results suggest that current rules and regulations are insufficient to ensure best veterinary practices and that a collective approach is needed to harness workable solutions for the identified ethical challenges. Challenges pertaining mostly to the food chain seem to require enforcement measures whereas softer measures that promote professional discretion were preferred to address challenges dealing with veterinary clinical services. These findings can support veterinary representative bodies, advisory committees and regulatory authorities in their decision making, policy and regulation. British Veterinary Association.

Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey

PubMed Central

Colagiuri, Ruth; Boylan, Sinead; Morrice, Emily

2015-01-01

Climate change and non-communicable diseases (NCDs) are arguably the greatest global challenges of the 21st Century. However, the confluence between them remains under-examined and there is little evidence of a comprehensive, systematic approach to identifying research priorities to mitigate their joint impact. Consequently, we: (i) convened a workshop of academics (n = 25) from the Worldwide Universities Network to identify priority areas at the interface between NCDs and climate change; (ii) conducted a Delphi survey of international opinion leaders in public health and relevant other disciplines; and (iii) convened an expert panel to review and advise on final priorities. Three research areas (water security; transport; conceptualising NCD harms to support policy formation) were listed among the top 10 priorities by >90% of Delphi respondents, and ranked among the top 12 priorities by >60% of respondents who ranked the order of priority. A fourth area (reducing the carbon footprint of cities) was ranked highest by the same >60% of respondents. Our results are consistent with existing frameworks on health and climate change, and extends them by focusing specifically on NCDs. Researching these priorities could progress understanding of climate change and NCDs, and inform global and national policy decisions for mitigating associated harms. PMID:26501301

Setting a health policy research agenda for controlling cancer burden in Korea.

PubMed

Jang, Sung-In; Cho, Kyoung-Hee; Kim, Sun Jung; Lee, Kwang-Sig; Park, Eun-Cheol

2015-04-01

The aim of study was to provide suggestions for prioritizing research in effort to reduce cancer burden in Korea based on a comprehensive analysis of cancer burden and Delphi consensus among cancer experts. Twenty research plans covering 10 topics were selected based on an assessment of the literature, and e-mail surveys were analyzed using a two-round modified Delphi method. Thirty-four out of 79 experts were selected from four organizations to participate in round one, and 21 experts among them had completed round two. Each item had two questions; one regarding the agreement of the topic as a priority item to reduce cancer burden, and the other about the importance of the item on a nine-point scale. A consensus was defined to be an average lower coefficient of variation with less than 30% in importance. Seven plans that satisfied the three criteria were selected as priority research plans for reducing cancer burden. These plans are "research into advanced clinical guidelines for thyroid cancer given the current issue with over-diagnosis," "research into smoking management plans through price and non-price cigarette policy initiatives," "research into ways to measure the quality of cancer care," "research on policy development to expand hospice care," "research into the spread and management of Helicobacter pylori," "research on palliative care in a clinical setting," and "research into alternative mammography methods to increase the accuracy of breast cancer screenings." The seven plans identified in this study should be prioritized to reduce the burden of cancer in Korea. We suggest that policy makers and administrators study and invest significant effort in these plans.

An international survey and modified Delphi approach revealed numerous rapid review methods.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Antony, Jesmin; Hutton, Brian; Moher, David; Sherifali, Diana; Straus, Sharon E

2016-02-01

To solicit experiences with and perceptions of rapid reviews from stakeholders, including researchers, policy makers, industry, journal editors, and health care providers. An international survey of rapid review producers and modified Delphi. Forty rapid review producers responded on our survey (63% response rate). Eighty-eight rapid reviews with 31 different names were reported. Rapid review commissioning organizations were predominantly government (78%) and health care (58%) organizations. Several rapid review approaches were identified, including updating the literature search of previous reviews (92%); limiting the search strategy by date of publication (88%); and having only one reviewer screen (85%), abstract data (84%), and assess the quality of studies (86%). The modified Delphi included input from 113 stakeholders on the rapid review approaches from the survey. Approach 1 (search limited by date and language; study selection by one reviewer only, and data abstraction and quality appraisal conducted by one reviewer and one verifier) was ranked the most feasible (72%, 81/113 responses), with the lowest perceived risk of bias (12%, 12/103); it also ranked second in timeliness (37%, 38/102) and fifth in comprehensiveness (5%, 5/100). Rapid reviews have many names and approaches, and some methods might be more desirable than others. Copyright © 2016 Elsevier Inc. All rights reserved.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Specialty Training's Organizational Readiness for curriculum Change (STORC): development of a questionnaire in a Delphi study.

PubMed

Bank, Lindsay; Jippes, Mariëlle; van Luijk, Scheltus; den Rooyen, Corry; Scherpbier, Albert; Scheele, Fedde

2015-08-05

In postgraduate medical education (PGME), programs have been restructured according to competency-based frameworks. The scale and implications of these adjustments justify a comprehensive implementation plan. Organizational Readiness for Change (ORC) is seen as a critical precursor for a successful implementation of change initiatives. Though, ORC in health care settings is mostly assessed in small scale settings and in relation to new policies and practices rather than educational change. Therefore our aim with this work was to develop an instrument to asses Specialty Training's Organizational Readiness for curriculum Change (STORC). A Delphi procedure was conducted to examine the applicability of a preliminary questionnaire in PGME, which was based on existing instruments designed for business and health care organizations. The 41 panellists (19 trainees and 22 supervisors from 6 specialties) from four different countries who were confronted with an apparent curriculum change, or would be in the near future, were asked to rate the relevance of a 89-item web-based questionnaire with regard to changes in specialty training on a 5-point Likert scale. Furthermore, they were invited to make qualitative comments on the items. In two rounds the 89-item preliminary questionnaire was reduced to 44 items. Items were either removed, kept, adapted or added based on individual item scores and qualitative comments. In the absence of a gold standard, this Delphi procedure was considered complete when the overall questionnaire rating exceeded 4.0 (scale 0-5). The overall item score reached 4.1 in the second round, meeting our criteria for completion of this Delphi procedure. This Delphi study describes the initial validating step in the development of an instrument to asses Specialty Training's Organisational Readiness for curriculum Change (STORC). Since ORC is measured on various subscales and presented as such, its strength lies in analysing these subscales. The latter makes it possible for educational leaders to identify and anticipate on hurdles in the implementation process and subsequently optimize efforts for successful curriculum change.

Measuring elimination of podoconiosis, endemicity classifications, case definition and targets: an international Delphi exercise.

PubMed

Deribe, Kebede; Wanji, Samuel; Shafi, Oumer; Muheki Tukahebwa, Edridah; Umulisa, Irenee; Davey, Gail

2015-09-01

Podoconiosis is one of the major causes of lymphoedema in the tropics. Nonetheless, currently there are no endemicity classifications or elimination targets to monitor the effects of interventions. This study aimed at establishing case definitions and indicators that can be used to assess endemicity, elimination and clinical outcomes of podoconiosis. This paper describes the result of a Delphi technique used among 28 experts. A questionnaire outlining possible case definitions, endemicity classifications, elimination targets and clinical outcomes was developed. The questionnaire was distributed to experts working on podoconiosis and other neglected tropical diseases in two rounds. The experts rated the importance of case definitions, endemic classifications, elimination targets and the clinical outcome measures. Median and mode were used to describe the central tendency of expert responses. The coefficient of variation was used to describe the dispersals of expert responses. Consensus on definitions and indicators for assessing endemicity, elimination and clinical outcomes of podoconiosis directed at policy makers and health workers was achieved following the two rounds of Delphi approach among the experts. Based on the two Delphi rounds we discuss potential indicators and endemicity classification of this disabling disease, and the ongoing challenges to its elimination in countries with the highest prevalence. Consensus will help to increase effectiveness of podoconiosis elimination efforts and ensure comparability of outcome data. © The Author 2015. Published by Oxford University Press on behalf of Royal Society of Tropical Medicine and Hygiene.

Internet-Based Delphi Research: Case Based Discussion

PubMed Central

Donohoe, Holly M.; Stellefson, Michael L.

2013-01-01

The interactive capacity of the Internet offers benefits that are intimately linked with contemporary research innovation in the natural resource and environmental studies domains. However, e-research methodologies, such as the e-Delphi technique, have yet to undergo critical review. This study advances methodological discourse on the e-Delphi technique by critically assessing an e-Delphi case study. The analysis suggests that the benefits of using e-Delphi are noteworthy but the authors acknowledge that researchers are likely to face challenges that could potentially compromise research validity and reliability. To ensure that these issues are sufficiently considered when planning and designing an e-Delphi, important facets of the technique are discussed and recommendations are offered to help the environmental researcher avoid potential pitfalls associated with coordinating e-Delphi research. PMID:23288149

Defining the role of a forensic hospital registered nurse using the Delphi method.

PubMed

Newman, Claire; Patterson, Karen; Eason, Michelle; Short, Ben

2016-11-01

A Delphi survey was undertaken to refine the position description of a registered nurse working in a forensic hospital, in New South Wales, Australia. Prior to commencing operation in 2008, position descriptions were developed from a review of legislation, as well as policies and procedures used by existing forensic mental health services in Australia. With an established workforce and an evolving model of care, a review of the initial registered nurse position description was required. An online Delphi survey was undertaken. Eight executive (88.9%) and 12 (58.3%) senior nursing staff participated in the first survey round. A total of four survey rounds were completed. At the final round, there was consensus (70%) that the revised position description was either very or somewhat suitable. There were a total of nine statements, from 31 originally produced in round 1, that did not reach consensus. The Delphi survey enabled a process for refining the Forensic Hospital registered nurse position description. Methods that facilitate executive and senior nursing staff consensus in the development and review of position descriptions should be considered in nursing management. © 2016 John Wiley & Sons Ltd.

Developing a framework for assessment of the environmental determinants of walking and cycling.

PubMed

Pikora, Terri; Giles-Corti, Billie; Bull, Fiona; Jamrozik, Konrad; Donovan, Rob

2003-04-01

The focus for interventions and research on physical activity has moved away from vigorous activity to moderate-intensity activities, such as walking. In addition, a social ecological approach to physical activity research and practice is recommended. This approach considers the influence of the environment and policies on physical activity. Although there is limited empirical published evidence related to the features of the physical environment that influence physical activity, urban planning and transport agencies have developed policies and strategies that have the potential to influence whether people walk or cycle in their neighbourhood. This paper presents the development of a framework of the potential environmental influences on walking and cycling based on published evidence and policy literature, interviews with experts and a Delphi study. The framework includes four features: functional, safety, aesthetic and destination; as well as the hypothesised factors that contribute to each of these features of the environment. In addition, the Delphi experts determined the perceived relative importance of these factors. Based on these factors, a data collection tool will be developed and the frameworks will be tested through the collection of environmental information on neighbourhoods, where data on the walking and cycling patterns have been collected previously. Identifying the environmental factors that influence walking and cycling will allow the inclusion of a public health perspective as well as those of urban planning and transport in the design of built environments.

Characteristics of national registries for occupational diseases: international development and validation of an audit tool (ODIT).

PubMed

Spreeuwers, Dick; de Boer, Angela G E M; Verbeek, Jos H A M; van Dijk, Frank J H

2009-10-23

The aim of the study was to develop quality indicators that can be used for quality assessment of registries of occupational diseases in relation to preventive policy on a national level. The research questions were: 1. Which indicators determine the quality of national registries of occupational diseases with respect to their ability to provide appropriate information for preventive policy? 2. What are the criteria that can distinguish low quality from high quality? First, we performed a literature search to assess which output of registries can be considered appropriate for preventive policy and to develop a set of preliminary indicators and criteria. Second, final indicators and criteria were assessed and their content validity was tested in a Delphi study, for which experts from the 25 EU Member States were invited. The literature search revealed two different types of information output to be appropriate for preventive policy: monitor and alert information. For the evaluation of the quality of the monitor and alert function we developed ten indicators and criteria. Sixteen of the twenty-five experts responded in the first round of the Delphi study, and eleven in the second round. Based on their comments, we assessed the final nine indicators: the completeness of the notification form, coverage of registration, guidelines or criteria for notification, education and training of reporting physicians, completeness of registration, statistical methods used, investigation of special cases, presentation of monitor information, and presentation of alert information. Except for the indicator "coverage of registration" for the alert function, all the indicators met the preset requirements of content validity. We have developed quality indicators and criteria to evaluate registries for occupational diseases on the ability to provide appropriate information for preventive policy on a national level. Together, these indicators form a tool which can be used for quality improvement of registries of occupational diseases.

Lifelong learning in nursing: a Delphi study.

PubMed

Davis, Lisa; Taylor, Heidi; Reyes, Helen

2014-03-01

In order to foster a culture of lifelong learning in nursing, it is important to identify what the concept means in the nursing profession as well as the characteristics of a lifelong learner. The purpose of this Delphi study was to conceptualize lifelong learning from the perspective of nursing, and to identify characteristics and essential elements of lifelong learning. A Delphi Study technique in three phases was completed using an online survey tool. Data were analyzed for conceptual description, ratings of characteristics and attributes, and expert consensus in these three phases. An online survey tool was used in this study. Recognized experts in nursing education, administration and public policy participated in this study. Lifelong learning in nursing is defined as a dynamic process, which encompasses both personal and professional life. This learning process is also both formal and informal. Lifelong learning involves seeking and appreciating new worlds or ideas in order to gain a new perspective as well as questioning one's environment, knowledge, skills and interactions. The most essential characteristics of a lifelong learner are reflection, questioning, enjoying learning, understanding the dynamic nature of knowledge, and engaging in learning by actively seeking learning opportunities. Keeping the mind active is essential to both lifelong learning and being able to translate knowledge into the capacity to deliver high quality nursing care. It is hoped that a clearer understanding of lifelong learning in nursing will foster more discussion and research about intentional, active inclusion of lifelong learning behaviors in nursing curricula. Copyright © 2013 Elsevier Ltd. All rights reserved.

Alcohol marketing in the Americas and Spain during the 2014 FIFA World Cup Tournament.

PubMed

Noel, Jonathan K; Babor, Thomas F; Robaina, Katherine; Feulner, Melissa; Vendrame, Alan; Monteiro, Maristela

2017-01-01

To identify the nature of visual alcohol references in alcohol advertisements during televised broadcasts of the 2014 FIFA World Cup Tournament matches and to evaluate cross-national differences according to alcohol marketing policy restrictiveness. Content analysis using the Delphi method and identification of in-game sponsorships. Television broadcasts of the 2014 FIFA World Cup in Argentina, Brazil, Canada, Finland, France, Mexico, Spain and the United States. Eighty-seven alcohol advertisements; 20 matches. Quantitative rating scales, combined with the Delphi rating technique, were used to determine compliance of the alcohol advertisements with the International Alliance for Responsible Drinking's (IARD) Guiding Principles. Recordings of five matches from four countries were also used to identify the number of in- and out-of-game alcohol brand appearances. A total of 86.2% of all unique alcohol advertisements contained at least one violation of IARD's Guiding Principles, with violation rates ranging from 72.7% (Mexico) to 100% (Brazil). Countries with the least restrictive marketing policies had a higher prevalence of violations in guidelines designed to protect minors. There were 2.76 in-game alcohol brand appearances and 0.83 out-of-game alcohol brand appearances per minute. Brand appearances did not differ across countries or according to a country's marketing policy restrictiveness. Self-regulation and statutory policies were ineffective at limiting alcohol advertising during the 2014 FIFA World Cup Tournament television broadcasts. Most advertisements contained content that violated the self-regulation codes, and there were high levels of within-broadcast brand appearances. © 2016 Society for the Study of Addiction.

Web-based dynamic Delphi: a new survey instrument

NASA Astrophysics Data System (ADS)

Yao, JingTao; Liu, Wei-Ning

2006-04-01

We present a mathematical model for a dynamic Delphi survey method which takes advantages of Web technology. A comparative study on the performance of the conventional Delphi method and the dynamic Delphi instrument is conducted. It is suggested that a dynamic Delphi survey may form a consensus quickly. However, the result may not be robust due to the judgement leaking issues.

Building expert agreement on the importance and feasibility of workplace health promotion interventions for nurses and midwives: A modified Delphi consultation.

PubMed

Perry, Lin; Nicholls, Rachel; Duffield, Christine; Gallagher, Robyn

2017-11-01

To use a Delphi panel to determine the relative importance and feasibility of workplace health promotion interventions to promote and support the health of the Australian nursing and midwifery workforce. The nursing workforce experiences rates of ill health above that of other workforces, yet there is little investment in workplace health promotion. The study used a modified Delphi design conducted between September and November 2015. Eleven of 19 purposively selected expert panellists discussed, rated and provided feedback through two rounds of an electronic questionnaire about the relative importance and feasibility of 46 workplace health promotion interventions and processes for nurses and midwives. Scores for importance and feasibility were calculated and ranked and a composite score of importance multiplied by feasibility. Mental health strategies were prioritized as the most important and feasible of the intervention topics, followed closely by healthy eating and physical activity interventions; smoking cessation ranked lowest. The most highly ranked interventions targeted healthy eating, stress management and resilience training. Highest ranked processes to support development of a healthy work environment included intersectoral collaboration and employee wellness groups. Study findings prompt consideration of health promotion opportunities to support nurses' health and well-being. Findings identified key workplace health promotion priorities and provide direction for policy makers and managers to promote nursing and midwifery workforce health. © 2017 John Wiley & Sons Ltd.

Exploring Nurse Leaders' Policy Participation Within the Context of a Nursing Conceptual Framework.

PubMed

Waddell, Ashley; Adams, Jeffrey M; Fawcett, Jacqueline

2017-11-01

This study was designed to describe and quantify the experiences of nurse leaders working to influence policy and to build consensus for priority skills and knowledge useful in policy efforts within the context of a nursing conceptual framework. The conceptual model for nursing and health policy and the Adams influence model were combined into a conceptual framework used to guide this two-round modified Delphi study. Twenty-two nurse leaders who were members of a state action coalition participated in the Round 1 focus group; 15 of these leaders completed the Round 2 electronic survey. Round 1 themes indicated the value of a passion for policy, the importance of clear communication, and an understanding the who and when of policy work. Round 2 data reinforced the importance of clear communication regarding policy engagement; knowing the who and when of policy closely followed, and having a passion for policy work was identified as least important. These themes inform learning objectives for nursing education and preparation for interactions with public officials because influencing policy requires knowledge, skills, and persistence. Study findings begin to describe how nurse leaders influence policy within the context of a nursing conceptual framework and generate implications for research, education, and professional practice.

Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

PubMed

Diamond, Ivan R; Grant, Robert C; Feldman, Brian M; Pencharz, Paul B; Ling, Simon C; Moore, Aideen M; Wales, Paul W

2014-04-01

To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies. Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009. About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds. Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required. Copyright © 2014 Elsevier Inc. All rights reserved.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique.

PubMed

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method.

Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique

PubMed Central

Guzys, Diana; Dickson-Swift, Virginia; Kenny, Amanda; Threlkeld, Guinever

2015-01-01

In this article we aim to demonstrate how Gadamerian philosophical hermeneutics may provide a sound methodological framework for researchers using the Delphi Technique (Delphi) in studies exploring health and well-being. Reporting of the use of Delphi in health and well-being research is increasing, but less attention has been given to covering its methodological underpinnings. In Delphi, a structured anonymous conversation between participants is facilitated, via an iterative survey process. Participants are specifically selected for their knowledge and experience with the topic of interest. The purpose of structuring conversation in this manner is to cultivate collective opinion and highlight areas of disagreement, using a process that minimizes the influence of group dynamics. The underlying premise is that the opinion of a collective is more useful than that of an individual. In designing our study into health literacy, Delphi aligned well with our research focus and would enable us to capture collective views. However, we were interested in the methodology that would inform our study. As researchers, we believe that methodology provides the framework and principles for a study and is integral to research integrity. In assessing the suitability of Delphi for our research purpose, we found little information about underpinning methodology. The absence of a universally recognized or consistent methodology associated with Delphi was highlighted through a scoping review we undertook to assist us in our methodological thinking. This led us to consider alternative methodologies, which might be congruent with the key principles of Delphi. We identified Gadamerian philosophical hermeneutics as a methodology that could provide a supportive framework and principles. We suggest that this methodology may be useful in health and well-being studies utilizing the Delphi method. PMID:25948132

Environmental and occupational health research and training needs in Colombia: A Delphi study

PubMed Central

Rodríguez-Villamizar, Laura A.; González, Beatriz Elena; Vera, Lina María; Patz, Jonathan; Bautista, Leonelo E.

2015-01-01

Introduction Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. Objective To identify needs for research and training in environmental and occupational health in Colombia. Materials and methods We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert’s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Results Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. Conclusions These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia. PMID:26535742

Environmental and occupational health research and training needs in Colombia: A Delphi study.

PubMed

Rodríguez-Villamizar, Laura A; González, Beatriz Elena; Vera, Lina María; Patz, Jonathan; Bautista, Leonelo E

2015-08-01

Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. To identify needs for research and training in environmental and occupational health in Colombia. We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert´s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia.

Navigating future uncertainty in marine protected area governance: Lessons from the Scottish MPA network

NASA Astrophysics Data System (ADS)

Hopkins, Charlotte Rachael; Bailey, David Mark; Potts, Tavis

2018-07-01

As international pressure for marine protection has increased, Scotland has increased spatial protection through the development of a Marine Protected Area (MPA) network. Few MPA networks to date have included specific considerations of climate change in the design, monitoring or management of the network. The Scottish MPA network followed a feature-led approach to identify a series of MPAs across the Scottish marine area and incorporated the diverse views of many different stakeholders. This feature led approach has led to wide ranging opinions and understandings regarding the success of the MPA network. Translating ideas of success into a policy approach whilst also considering how climate change may affect these ideas of success is a complex challenge. This paper presents the results of a Delphi process that aimed to facilitate clear communication between academics, policy makers and stakeholders in order to identify specific climate change considerations applicable to the Scottish MPA network. This study engaged a group of academic and non-academic stakeholders to discuss potential options that could be translated into an operational process for management of the MPA network. The results of Delphi process discussion are presented with the output of a management matrix tool, which could aid in future decisions for MPA management under scenarios of climate change.

The main indicators for Iranian hospital ethical accreditation

PubMed Central

ENJOO, SEYED ALI; AMINI, MITRA; TABEI, SEYED ZIAADIN; MAHBUDI, ALI; KAVOSI, ZAHRA; SABER, MAHBOOBEH

2015-01-01

Introduction The application of organizational ethics in hospitals is one of the novel ways to improve medical ethics. Nowadays achieving efficient and sufficient ethical hospital indicators seems to be inevitable. In this connection, the present study aims to determine the best indicators in hospital accreditation. Methods 69 indicators in 11 fields to evaluate hospital ethics were achieved through a five-step qualitative and quantitative study including literature review, expert focus group, Likert scale survey, 3 rounded Delphi, and content validity measurement. Expert focus group meeting was conducted, employing Nominal Group Technique (NGT). After running NGT, a three rounded Delphi and parallel to Delphi and a Likert scale survey were performed to obtain objective indicators for each domain. The experts were all healthcare professionals who were also medical ethics researchers, teachers, or PhD students. Content validity measurements were computed, using the viewpoints of two different expert groups, some ethicists, and some health care professionals (n=46). Results After conducting NGT, Delphi, Likert survey, 11 main domains were listed including:  Informed consent, Medical confidentiality, Physician-patient economic relations, Ethics consultation policy in the hospital, Ethical charter of hospital, Breaking bad medical news protocol, Respect for the patients’ rights, Clinical ethics committee, Spiritual and palliative care unit programs in the hospitals, Healthcare professionals’ communication skills, and Equitable access to the healthcare. Also 71 objective indicators for these 11 domains were listed in 11 tables with 5 to 8 indicators per table. Content Validity Ratio (CVR) measurements were done and 69 indicators were highlighted. Conclusion The domains listed in this study seem to be the most important ones for evaluating hospital ethics programs and services. Healthcare organizations’ accreditation and ranking are crucial for the improvement of healthcare services. Ethics programs would also motivate hospitals to improve their services and move towards patients’ satisfaction. In this regard, more involvement of bioethicists can help healthcare organizations to develop ethics programs and ensure ethics-based practice in hospitals. PMID:26269789

Expert consensus on facilitators and barriers to return-to-work following surgery for non-traumatic upper extremity conditions: a Delphi study.

PubMed

Peters, S E; Johnston, V; Ross, M; Coppieters, M W

2017-02-01

This Delphi study aimed to reach consensus on important facilitators and barriers for return-to-work following surgery for non-traumatic upper extremity conditions. In Round 1, experts ( n = 42) listed 134 factors, which were appraised in Rounds 2 and 3. Consensus (⩾85% agreement) was achieved for 13 facilitators (high motivation to return-to-work; high self-efficacy for return-to-work and recovery; availability of modified/alternative duties; flexible return-to-work arrangements; positive coping skills; limited heavy work exertion; supportive return-to-work policies; supportive supervisor/management; no catastrophic thinking; no fear avoidance to return-to-work; no fear avoidance to pain/activity; return to meaningful work duties; high job satisfaction) and six barriers (mood disorder diagnosis; pain/symptoms at more than one musculoskeletal site; heavy upper extremity exertions at work; lack of flexible return-to-work arrangements; lack of support from supervisor/management; high level of pain catastrophizing). Future prognostic studies are required to validate these biopsychosocial factors to further improve return-to-work outcomes. V.

Measuring and Assessing Technical Training Performance in the Army’s Schools and Units: A Survey of Current Methods

DTIC Science & Technology

1988-10-01

Madey and Stenner , 1981) and the Delphi Technique (Dalkey, 1969). These techniques are used by management analysts, industrial-organizational...Personnel Research Laboratory, Aerospace Medical Division, Lackland AFB, TX, May 1963. Madey, D, & Stenner , J. (1980). Policy implications analysis: A

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Policy Options for Radio Frequency Identification (RFID) Application in Healthcare; a Prospective View

PubMed Central

van Oranje-Nassau, Constantijn; Schindler, Helen Rebecca; Vilamovska, Anna-Marie; Botterman, Maarten

2012-01-01

Abstract This article reviews the state of play of European markets and applications of Radio Frequency Identification (RFID) technology in healthcare in Europe. Based on the current situation the study presents three scenarios for 2020, to describe futures in which the technology and health care sectors develop in different ways. The scenarios were discussed in expert workshops to derive issues that need to be addressed by future policies of the European Union and other stakeholders. The market assessment is based on a review of literature and an analysis of proprietary market data. The information on the state of RFID applications in Health in Europe summarises the results of a literature review, an online Delphi survey, expert interviews and seven cases studies in Europe and the US. The policy analysis is based on the outcomes of a scenario gaming workshop with experts from academia, industry, healthcare providers, policymakers and representatives of patient organisations. PMID:28083212

Outcomes that Define Successful Advance Care Planning: A Delphi Panel Consensus

PubMed Central

Sudore, Rebecca L.; Heyland, Daren K.; Lum, Hillary D.; Rietjens, Judith A.C.; Korfage, Ida J.; Ritchie, Christine S.; Hanson, Laura C.; Meier, Diane E.; Pantilat, Steven Z.; Lorenz, Karl; Howard, Michelle; Green, Michael J.; Simon, Jessica E.; Feuz, Mariko A.; You, John J.

2017-01-01

Context Standardized outcomes that define successful advance care planning (ACP) are lacking. Objective To create an Organizing Framework of ACP outcome constructs and rate the importance of these outcomes. Methods This study convened a Delphi panel consisting of 52 multidisciplinary, international ACP experts including clinicians, researchers, and policy leaders from four countries. We conducted literature reviews and solicited attendee input from 5 international ACP conferences to identify initial ACP outcome constructs. In 5 Delphi rounds, we asked panelists to rate patient-centered outcomes on a 7-point “not-at-all” to “extremely important” scale. We calculated means and analyzed panelists’ input to finalize an Organizing Framework and outcome rankings. Results Organizing Framework outcome domains included process (e.g., attitudes), actions (e.g., discussions), quality of care (e.g., satisfaction), and healthcare (e.g., utilization). The top 5 outcomes included (1) care consistent with goals, mean 6.71 (±SD 0.04); (2) surrogate designation, 6.55 (0.45); (3) surrogate documentation, 6.50 (0.11); (4) discussions with surrogates, 6.40 (0.19); and (5) documents and recorded wishes are accessible when needed 6.27 (0.11). Advance directive documentation was ranked 10th, 6.01 (0.21). Panelists raised caution about whether “care consistent with goals” 6.01 (0.21). Panelists raised can be reliably measured. Conclusion A large, multidisciplinary Delphi panel developed an Organizing Framework and rated the importance of ACP outcome constructs. Top rated outcomes should be used to evaluate the success of ACP initiatives. More research is needed to create reliable and valid measurement tools for the highest rated outcomes, particularly “care consistent with goals.” PMID:28865870

Rating scale for the assessment of competence in ultrasound-guided peripheral vascular access - a Delphi Consensus Study.

PubMed

Primdahl, Stine C; Todsen, Tobias; Clemmesen, Louise; Knudsen, Lars; Weile, Jesper

2016-09-21

Peripheral vascular access is vital for treatment and diagnostics of hospitalized patients. Ultrasound-guided vascular access (UGVA) is superior to the landmark technique. To ensure competence-based education, an assessment tool of UGVA competence is needed. We aimed to develop a global rating scale (RS) for assessment of UGVA competence based on opinions on the content from ultrasound experts in a modified Delphi consensus study. We included experts from anesthesiology, emergency medicine and radiology across university hospitals in Denmark. Nine elements were drafted based on existing literature and recommendations from international societies. In a multi-round survey, the experts rated the elements on a five-point Likert scale according to importance, and suggested missing elements. The final Delphi round occurred when >80% of the experts rated all elements ≥4 on the Likert scale. Sixteen experts consented to participate in the study, one withdrew consent prior to the first Delphi round, and 14 completed all three Delphi rounds. In the first Delphi round the experts excluded one element from the scale and changed the content of two elements. In the second Delphi round, the experts excluded one element from the scale. In the third Delphi round, consensus was obtained on the eight elements: preparation of utensils, ergonomics, preparation of the ultrasound device, identification of blood vessels, anatomy, hygiene, coordination of the needle, and completion of the procedure. We developed an RS for assessment of UGVA competence based on opinions of ultrasound experts through a modified Delphi consensus study.

Using the Delphi technique in economic evaluation: time to revisit the oracle?

PubMed

Simoens, S

2006-12-01

Although the Delphi technique has been commonly used as a data source in medical and health services research, its application in economic evaluation of medicines has been more limited. The aim of this study was to describe the methodology of the Delphi technique, to present a case for using the technique in economic evaluation, and to provide recommendations to improve such use. The literature was accessed through MEDLINE focusing on studies discussing the methodology of the Delphi technique and economic evaluations of medicines using the Delphi technique. The Delphi technique can be used to provide estimates of health care resources required and to modify such estimates when making inter-country comparisons. The Delphi technique can also contribute to mapping the treatment process under investigation, to identifying the appropriate comparator to be used, and to ensuring that the economic evaluation estimates cost-effectiveness rather than cost-efficacy. Ideally, economic evaluations of medicines should be based on real-patient data. In the absence of such data, evaluations need to incorporate the best evidence available by employing approaches such as the Delphi technique. Evaluations based on this approach should state the limitations, and explore the impact of the associated uncertainty in the results.

Reducing Energy Cost and Greenhouse Gas Emission in the Corporate Sector, a Delphi Study

ERIC Educational Resources Information Center

Kramer, Maxim L.

2013-01-01

The study is titled "Reducing energy cost and GreenHouse Gas emission in the corporate sector, A Delphi Study". The study applied the Delphi methodology and focused on the Green IT solutions that can help the modern corporate organizations with less than 1000 employees to decrease their energy costs and GHG emissions. The study presents…

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.

PubMed

Birko, Stanislav; Dove, Edward S; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts' variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions. PMID:26270647

Implementing and maintaining a researchable database from electronic medical records: a perspective from an academic family medicine department.

PubMed

Stewart, Moira; Thind, Amardeep; Terry, Amanda L; Chevendra, Vijaya; Marshall, J Neil

2009-11-01

Electronic medical records (EMRs) are posited as a tool for improving practice, policy and research in primary healthcare. This paper describes the Deliver Primary Healthcare Information (DELPHI) Project at the Department of Family Medicine at the University of Western Ontario, focusing on its development, current status and research potential in order to share experiences with researchers in similar contexts. The project progressed through four stages: (a) participant recruitment, (b) EMR software modification and implementation, (c) database creation and (d) data quality assessment. Currently, the DELPHI database holds more than two years of high-quality, de-identified data from 10 practices, with 30,000 patients and nearly a quarter of a million encounters.

Study plan to identify long term national telecommunications need and priorities applying Delphi techniques (handbook). [technological forecasting - United States of America

NASA Technical Reports Server (NTRS)

1974-01-01

A handbook that explains the basic Delphi methodology and discusses modified Delphi techniques is presented. The selection of communications experts to participate in a study, the construction of questionnaires on potential communications developments, and requisite technology is treated. No two modified Delphi studies were the same, which reflects the flexibility and adaptability of the technique. Each study must be specifically tailored to a particular case, and consists of seeking a consensus of opinion among experts about a particular subject and attendant conditions that may prevail in the future.

Reference Materials in LIS Instruction: A Delphi Study

ERIC Educational Resources Information Center

Rabina, Debbie

2013-01-01

This paper presents the results of a Delphi study conducted over a two-month period in 2011. The purpose of the study was to identify reference sources that should be covered in basic reference courses taught in LIS programs in the United States. The Delphi method was selected for its appropriateness in soliciting expert opinions and assessing the…

Application of the Delphi technique in healthcare maintenance.

PubMed

Njuangang, Stanley; Liyanage, Champika; Akintoye, Akintola

2017-10-09

Purpose The purpose of this paper is to examine the research design, issues and considerations in the application of the Delphi technique to identify, refine and rate the critical success factors and performance measures in maintenance-associated infections. Design/methodology/approach In-depth literature review through the application of open and axial coding were applied to formulate the interview and research questions. These were used to conduct an exploratory case study of two healthcare maintenance managers, randomly selected from two National Health Service Foundation Trusts in England. The results of exploratory case study provided the rationale for the application of the Delphi technique in this research. The different processes in the application of the Delphi technique in healthcare research are examined thoroughly. Findings This research demonstrates the need to apply and integrate different research methods to enhance the validity of the Delphi technique. The rationale for the application of the Delphi technique in this research is because some healthcare maintenance managers lack knowledge about basic infection control (IC) principles to make hospitals safe for patient care. The result of first round of the Delphi exercise is a useful contribution in its own rights. It identified a number of salient issues and differences in the opinions of the Delphi participants, noticeably between healthcare maintenance managers and members of the infection control team. It also resulted in useful suggestions and comments to improve the quality and presentation of the second- and third-round Delphi instruments. Practical implications This research provides a research methodology that can be adopted by researchers investigating new and emerging issues in the healthcare sector. As this research demonstrates, the Delphi technique is relevant in soliciting expert knowledge and opinion to identify performance measures to control maintenance-associated infections in hospitals. The methodology provided here could be applied by other researchers elsewhere to probe, investigate and generate rich information about new and emerging healthcare research topics. Originality/value The authors demonstrate how different research methods can be integrated to enhance the validity of the Delphi technique. For example, the results of an exploratory case study provided the rationale for the application of the Delphi technique investigating the key performance measures in maintenance-associated infections. The different processes involved in the application of the Delphi technique are also carefully explored and discussed in depth.

The Delphi Predictions of Pathology Chairmen: A Six-Year Retrospective View.

ERIC Educational Resources Information Center

Hill, Rolla B.; Goodale, Fairfield

1981-01-01

A retrospective review is reported of progress in academic pathology since 1974, when the Association of Pathology Chairmen undertook a Delphi study of pathology chairmen's expectations and desires for the future. The Delphi study was useful in alerting academic pathologists to opportunities and in coalescing activities toward achievement of…

Exploration to Identify Professional Dispositions of School Librarians: A Delphi Study

ERIC Educational Resources Information Center

Bush, Gail; Jones, Jami L.

2010-01-01

This article reports the findings of an exploratory study to identify professional dispositions of school librarians. The authors employed the Delphi method, a qualitative research method that emphasizes expert knowledge and consensus within a particular field. The Delphi panel consisted of members of the editorial boards of nationally recognized…

Setting Priorities for Gerontological Social Work Research: A National Delphi Study

ERIC Educational Resources Information Center

Burnette, Denise; Morrow-Howell, Nancy; Chen, Li-Mei

2003-01-01

Purpose: An increasingly important task for all disciplines involved in aging research is to identify and prioritize areas for investigation. This article reports the results of a national Delphi study on setting research priorities for gerontological social work. Design and Methods: Delphi methodology, a structured process for eliciting and…

Concepts and Contexts in Engineering and Technology Education: An International and Interdisciplinary Delphi Study

ERIC Educational Resources Information Center

Rossouw, Ammeret; Hacker, Michael; de Vries, Marc J.

2011-01-01

Inspired by a similar study by Osborne et al. we have conducted a Delphi study among experts to identify key concepts to be taught in engineering and technology education and relevant and meaningful contexts through which these concepts can be taught and learnt. By submitting the outcomes of the Delphi study to a panel of experts in a two-day…

Examining the Roles of Blended Learning Approaches in Computer-Supported Collaborative Learning (CSCL) Environments: A Delphi Study

ERIC Educational Resources Information Center

So, Hyo-Jeong; Bonk, Curtis J.

2010-01-01

In this study, a Delphi method was used to identify and predict the roles of blended learning approaches in computer-supported collaborative learning (CSCL) environments. The Delphi panel consisted of experts in online learning from different geographic regions of the world. This study discusses findings related to (a) pros and cons of blended…

Development of guidelines to assist organisations to support employees returning to work after an episode of anxiety, depression or a related disorder: a Delphi consensus study with Australian professionals and consumers

PubMed Central

2012-01-01

Background Mental disorders are a significant cause of disability and loss of workplace productivity. The scientific evidence for how organisations should best support those returning to work after common mental disorders is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods A systematic review of websites, books and journal articles was conducted to develop a 387 item survey containing strategies that organisations might use to support those returning to work after common mental disorders. Three panels of Australian experts (66 health professionals, 30 employers and 80 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results The participation rate across all three rounds was 60.2% (57.6% health professionals, 76.7% employers, 56.3% consumers). 308 strategies were endorsed as essential or important by at least 80% of all three panels. The endorsed strategies provided information on policy and procedures, the roles of supervisors, employees and colleagues in managing absence and return to work, and provision of mental health information and training. Conclusions The guidelines outline strategies for organisations supporting those returning to work after common mental disorders. It is hoped that they may be used to inform policy and practice in a variety of workplaces. PMID:22943604

1988 Delphi survey of nursing research priorities for New York State.

PubMed

Shortridge, L; Doswell, W; Evans, M E; Levin, R F; Millor, G K; Carter, E

1989-09-01

In order to inform decisions about nursing research and health care policy, the Council on Nursing Research of the New York State Nurses Association (NYSNA) conducted a Delphi survey to identify the priorities for nursing research in New York state. The Delphi technique is a method of eliciting judgements from experts for the purpose of short-term forecasting and planning. The survey was conducted by mail in three rounds during 1988. Round I required participants to identify three primary research priorities for the nursing profession. In Round II participants ranked the 37 most frequently identified categories from Round I. The highest 16 categories from Round II were ranked by participants in Round III to provide the final 10 nursing research priority categories for New York state. All members of the New York State Nurses Association holding a minimum of a master's degree in nursing were invited to participate. The response rates were: Round I, 34% (N = 872); Round II, 38% (N = 985); Round III 37% (N = 974). Of the 10 nursing research priority categories identified in the final round, 5 relate to nurses, 2 relate to nursing, and 3 relate to clients. None of the high-risk conditions or populations with whom nurses work appear in the top 10, and only 2 of these are ranked in the top 15 priority categories. These priority categories will be used by the NYSNA Council on Nursing Research to influence its future agenda and activities. They can be used by the nursing profession and others for planning, policy making, and establishing nursing research funding priorities.(ABSTRACT TRUNCATED AT 250 WORDS)

A Delphi Study: Exploring Faculty Perceptions of the Best Practices Influencing Student Persistence in Blended Courses

ERIC Educational Resources Information Center

Manning, Kim Elise

2010-01-01

This Delphi study explored the instructional practices of community college faculty who were teaching blended or Web-assisted courses and how these practices influenced student persistence. The Delphi method provided qualitative data in the form of expert advice through consensus building on the instructional practices most likely to influence…

What Is Next for Functional Requirements for Bibliographic Records? A Delphi Study

ERIC Educational Resources Information Center

Zhang, Yin; Salaba, Athena

2009-01-01

This article reports on a Delphi study conducted to determine key issues and challenges facing Functional Requirements for Bibliographic Records (FRBR) research and practice. The Delphi panel consisted of thirty-three experts in the field who participated in a three-round issue-raising and consensus-building process via a Web-based survey…

Career and Technical Education at a Crossroads: A Delphi Study

ERIC Educational Resources Information Center

Cutright, Michael W.

2011-01-01

Career and technical education in the United States has reached a critical juncture. A three round Delphi method was used to determine a consensus on the future events of career and technical education to better inform educational decision makers. Forty-one individual experts in the field were invited to serve as panelists for the Delphi study and…

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.

PubMed

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

The Delphi Method: Gathering Expert Opinion in Religious Education

ERIC Educational Resources Information Center

Baumfield, Vivienne M.; Conroy, James C.; Davis, Robert A.; Lundie, David C.

2012-01-01

The "Does Religious Education work?" project is part of the Religion and Society programme funded by two major research councils in the UK. It sets out to track the trajectory of Religious Education (RE) in secondary schools in the UK from the aims and intentions represented in policy through its enactment in classroom practice to the…

Can the impact of public involvement on research be evaluated? A mixed methods study.

PubMed

Barber, Rosemary; Boote, Jonathan D; Parry, Glenys D; Cooper, Cindy L; Yeeles, Philippa; Cook, Sarah

2012-09-01

  Public involvement is central to health and social research policies, yet few systematic evaluations of its impact have been carried out, raising questions about the feasibility of evaluating the impact of public involvement.   To investigate whether it is feasible to evaluate the impact of public involvement on health and social research.   Mixed methods including a two-round Delphi study with pre-specified 80% consensus criterion, with follow-up interviews. UK and international panellists came from different settings, including universities, health and social care institutions and charitable organizations. They comprised researchers, members of the public, research managers, commissioners and policy makers, self-selected as having knowledge and/or experience of public involvement in health and/or social research; 124 completed both rounds of the Delphi process. A purposive sample of 14 panellists was interviewed.   Consensus was reached that it is feasible to evaluate the impact of public involvement on 5 of 16 impact issues: identifying and prioritizing research topics, disseminating research findings and on key stakeholders. Qualitative analysis revealed the complexities of evaluating a process that is subjective and socially constructed. While many panellists believed that it is morally right to involve the public in research, they also considered that it is appropriate to evaluate the impact of public involvement.   This study found consensus among panellists that it is feasible to evaluate the impact of public involvement on some research processes, outcomes and on key stakeholders. The value of public involvement and the importance of evaluating its impact were endorsed. © 2011 Blackwell Publishing Ltd.

Can the impact of public involvement on research be evaluated? A mixed methods study

PubMed Central

Barber, Rosemary; Boote, Jonathan D; Parry, Glenys D; Cooper, Cindy L; Yeeles, Philippa; Cook, Sarah

2011-01-01

Abstract Background  Public involvement is central to health and social research policies, yet few systematic evaluations of its impact have been carried out, raising questions about the feasibility of evaluating the impact of public involvement. Objective  To investigate whether it is feasible to evaluate the impact of public involvement on health and social research. Methods  Mixed methods including a two‐round Delphi study with pre‐specified 80% consensus criterion, with follow‐up interviews. UK and international panellists came from different settings, including universities, health and social care institutions and charitable organizations. They comprised researchers, members of the public, research managers, commissioners and policy makers, self‐selected as having knowledge and/or experience of public involvement in health and/or social research; 124 completed both rounds of the Delphi process. A purposive sample of 14 panellists was interviewed. Results  Consensus was reached that it is feasible to evaluate the impact of public involvement on 5 of 16 impact issues: identifying and prioritizing research topics, disseminating research findings and on key stakeholders. Qualitative analysis revealed the complexities of evaluating a process that is subjective and socially constructed. While many panellists believed that it is morally right to involve the public in research, they also considered that it is appropriate to evaluate the impact of public involvement. Conclusions  This study found consensus among panellists that it is feasible to evaluate the impact of public involvement on some research processes, outcomes and on key stakeholders. The value of public involvement and the importance of evaluating its impact were endorsed. PMID:21324054

Projecting Agricultural Education Programs for the 21st Century Using a Modified Delphi Technique.

ERIC Educational Resources Information Center

Iverson, Maynard J.

A modified three-step Delphi procedure was used to conduct a series of national studies of futurists regarded by their peers as top experts in agricultural education. The primary objective was to project enrollments in agricultural education programs for the 21st century. Other study objectives were to ascertain whether the Delphi technique could…

Expert opinion on "best practices" in the delivery of health care services to immigrants in Denmark.

PubMed

Jensen, Natasja Koitzsch; Nielsen, Signe Smith; Krasnik, Allan

2010-08-01

Delivery of health care to immigrants is an emerging field of interest. Immigrants are frequently characterised by health outcomes that are inferior to those of other groups with regard to morbidity and mortality. In addition, health professionals report difficulties associated with the encounter with immigrant patients. A Delphi process with eight Danish experts from the field of immigrant health was performed as part of an EU project. The objective of the Delphi process was to investigate expert opinion on "best practice in the delivery of healthcare to immigrants". Initially, 60 factors were suggested by the experts. Next, these factors were summarised into 32 factors that the experts were invited to rate and, if possible, agree on. The top 11 factors identified in the Delphi process were access to interpreters, quality of interpretation, ensuring medication compliance, having sufficient consultation time, coherence of offers, interdisciplinary collaboration, allocation of resources, the role of the practitioner, acknowledgement of the individual patient, education of health professionals and students and access to telephone interpretation to supplement other services. The Delphi process can be a valuable tool in the investigation of expert opinion and may thereby help to guide future policy directives. In the light of the importance experts placed on access to interpreters and on the quality of the interpretation services offered, it seems as an untenable strategy to introduce as from June 2011 self-payment for interpretation services provided to immigrants who have stayed in the country for more than seven years.

A Research Study Using the Delphi Method to Define Essential Competencies for a High School Game Art and Design Course Framework at the National Level

ERIC Educational Resources Information Center

Mack, Nayo Corenus-Geneva

2011-01-01

This research study reports the findings of a Delphi study conducted to determine the essential competencies and objectives for a high school Game Art and Design course framework at the national level. The Delphi panel consisted of gaming, industry and educational experts from all over the world who were members of the International Game…

Determining the political influence of nurses who work in the field of hepatitis C: a Delphi survey.

PubMed

McKeown, Clare; Gibson, Faith

2007-07-01

The principle aim of this study was to determine the political influence and the professional profile of nurses who work in the field of hepatitis C. Hepatitis C has emerged as a major public health problem. Its growing impact on health services has led to the development and expansion of a range of specialist nursing roles in hepatitis C. The professional group has never been profiled in the current political and social context, although many nurses traverse patient, organizational and strategic levels of practice and service development. A multi-centre survey design using the Delphi technique was undertaken to gain consensus. A total of 160 nurses who work in the field of hepatitis C, were invited to participate. The target population was located from 90 sites across the United Kingdom. Data collection comprised two questionnaire rounds. Final sample included 40 participants in round 1 and 34 in round 2. The results showed strong consensus on the necessity of structural and policy changes at national and regional levels and nurses' inclusion within that process. Of note was the need for policy group representation and engagement in the commissioning agenda. Overall, the findings demonstrate that most nurses have advanced contextual understanding of the issues. There is evidence of political activities and nursing influence at local and regional levels. This is less evident at national level, where there is only a core of active members. These findings reveal nurses to be operating and thinking strategically without referencing their activities as political. Nurses should be more focused in translating strategic thinking into political activities. This should be coordinated and supported through the Hepatitis Nurse Specialist Forum to ensure nurses become increasingly visible in driving services forward at policy level. Successive governments have failed to address the serious structural problems in resource allocation, lack of public awareness and policy direction. This is where patient, organizational and strategy levels interface in hepatitis C because policy affects patients and organizations, patient level care affects policy direction and nurses can influence all three.

Two science communities and coastal wetlands policy

DOE Office of Scientific and Technical Information (OSTI.GOV)

LeVine, J.B.

1984-01-01

This study compares the attitudes of academic and government wetlands scientists about wetlands science and policy. Analysis of one thousand seven hundred responses to Delphi-type questions posed to twenty California scientists on a wide range of issues about California coastal wetlands found significant differences between academic and government scientists about wetlands definitions, threats to wetlands, wetlands policies, wetlands health, and wetlands mitigation strategies. These differences were consistent with descriptive models of political sociology developed by D. Price and C.P. Snow and with normative models of the philosophy of science developed in the renaissance by F. Bacon and R. Descartes. Characteristics,more » preferences, and personality attributes consistent with group functions and roles have been described in these models. These findings have serious implications for policy. When academic and government wetlands scientists act as advisors to the major parties in land use conflicts, basic differences in perspective have contributed to costly contention over the future use of wetlands.« less

Policy Options for Radio Frequency Identification (RFID) Application in Healthcare; a Prospective View: Final Report (D5).

PubMed

van Oranje-Nassau, Constantijn; Schindler, Helen Rebecca; Vilamovska, Anna-Marie; Botterman, Maarten

2012-01-01

This article reviews the state of play of European markets and applications of Radio Frequency Identification (RFID) technology in healthcare in Europe. Based on the current situation the study presents three scenarios for 2020, to describe futures in which the technology and health care sectors develop in different ways. The scenarios were discussed in expert workshops to derive issues that need to be addressed by future policies of the European Union and other stakeholders. The market assessment is based on a review of literature and an analysis of proprietary market data. The information on the state of RFID applications in Health in Europe summarises the results of a literature review, an online Delphi survey, expert interviews and seven cases studies in Europe and the US. The policy analysis is based on the outcomes of a scenario gaming workshop with experts from academia, industry, healthcare providers, policymakers and representatives of patient organisations.

After 10 Years: A Vision Forward for Progress in Community Health Partnerships.

PubMed

Grieb, Suzanne Dolwick; Pichon, Latrice; Kwon, Simona; Yeary, Karen Kim; Tandon, Darius

In 2007 the journal Progress in Community Health Partnerships was launched to advance the field of community-engaged research and the journal's editors engaged in a Delphi process to identify priorities for the journal and field. Ten years later, the increased adoption of community-engaged research continues to improve public health. The purpose of this manuscrip t is to i dentify community-engaged research priorities for the next 10 years. The study engaged leaders in community-engaged research using a two-round Delphi process, whereby leaders in the field were asked to identify and then rank order topics in community-engaged research that needed to be prioritized for the next decade. In stage 1, 41 respondents generated 441 priorities across 8 categories (e.g., theory, epidemiology, intervention science) that were collapsed into 90 priority topics, ranging from 8 to 15 per category. In stage 2, 73 respondents ranked five prioritized items for each category. The prioritized items are provided, with the following themes present across all categories: 1) improvements to equity among partners, 2) partnership sustainability, and 3) increased efforts to translate community-engaged research into policy change. We compare the findings from this Delphi process with the priorities identified in 2007 to reflect on how the field has progressed. It is our hope that community and academic stakeholders will be able to use these priorities as a guide to their community-engaged research in the coming years.

An international Delphi study examining health promotion and health education in nursing practice, education and policy.

PubMed

Whitehead, Dean

2008-04-01

To arrive at an expert consensus in relation to health promotion and health education constructs as they apply to nursing practice, education and policy. Nursing has often been maligned and criticized, both inside and outside of the profession, for its ability to understand and conduct effective health promotion and health education-related activities. In the absence of an expert-based consensus, nurses may find it difficult to progress beyond the current situation. In the absence of any previously published nursing-related consensus research, this study seeks to fill that knowledge-gap. A two-round Delphi technique via email correspondence. A first-round qualitative questionnaire used open-ended questions for defining health promotion and health education. This was both in general terms and as participants believed these concepts related to the clinical, theoretical (academic/educational) and the policy (political) setting in nursing. Line-by-line qualitative content and thematic analysis of the first-round data generated 13 specific categories. These categories contained 134 statement items. The second-round questionnaire comprised the identified 134 statements. Using a five-point Likert scale (ranging from 1 = strongly disagree to 5 = strongly agree) participants scored and rated their level of agreement/disagreement against the listed items. Data from the second-round was descriptively analysed according to distribution and central tendency measures. An expert consensus was reached on 65 of the original 134 statements. While some minor contradiction was demonstrated, strong consensus emerged around the issues of defining health promotion and health education and the emergence of a wider health promotion and health education role for nursing. No consensus was reached on only one of the 13 identified topic categories - that of 'nurses working with other disciplines and agencies in a health education and health promotion role.' This study provides a hitherto previously absent expert consensus on the current position of health promotion and health education, in nursing and predictions for their future course. Its findings represent an important step for nurses as they seek to become increasingly active and influential within wider health promotion and health education arenas. Relevance to clinical practice. Delphi studies do not necessarily offer indisputable fact. This study, however, with its strong consensus on the majority of original statements is a good indicator as to how nursing experts currently view health promotion and health education constructs. Expert consensus offers a useful form of measure against current and future clinical practice and helps to build a firm foundation for change. Nurses, then, are advised here to refer to the findings presented, that they remain contextually and conceptually clear, as they embark on current and future health promotion-related activities.

Building consensus on key priorities for rural health care in South Africa using the Delphi technique.

PubMed

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-24

South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential.

Building consensus on key priorities for rural health care in South Africa using the Delphi technique

PubMed Central

Versteeg, Marije; du Toit, Lilo; Couper, Ian

2013-01-01

Background South Africa is currently undergoing major health system restructuring in an attempt to improve health outcomes and reduce inequities in access. Such inequities exist between private and public health care and within the public health system itself. Experience shows that rural health care can be disadvantaged in policy formulation despite good intentions. The objective of this study was to identify the major challenges and priority interventions for rural health care provision in South Africa thereby contributing to pro-rural health policy dialogue. Methods The Delphi technique was used to develop consensus on a list of statements that was generated through interviews and literature review. A panel of rural health practitioners and other stakeholders was asked to indicate their level of agreement with these statements and to rank the top challenges in and interventions required for rural health care. Results Response rates ranged from 83% in the first round (n=44) to 64% in the final round (n=34). The top five priorities were aligned to three of the WHO health system building blocks: human resources for health (HRH), governance, and finance. Specifically, the panel identified a need to focus on recruitment and support of rural health professionals, the employment of managers with sufficient and appropriate skills, a rural-friendly national HRH plan, and equitable funding formulae. Conclusion Specific policies and strategies are required to address the greatest rural health care challenges and to ensure improved access to quality health care in rural South Africa. In addition, a change in organisational climate and a concerted effort to make a career in rural health appealing to health care workers and adequate funding for rural health care provision are essential. PMID:23364081

Using the Delphi expert consensus method in mental health research.

PubMed

Jorm, Anthony F

2015-10-01

The article gives an introductory overview of the use of the Delphi expert consensus method in mental health research. It explains the rationale for using the method, examines the range of uses to which it has been put in mental health research, and describes the stages of carrying out a Delphi study using examples from the literature. To ascertain the range of uses, a systematic search was carried out in PubMed. The article also examines the implications of 'wisdom of crowds' research for how to conduct Delphi studies. The Delphi method is a systematic way of determining expert consensus that is useful for answering questions that are not amenable to experimental and epidemiological methods. The validity of the approach is supported by 'wisdom of crowds' research showing that groups can make good judgements under certain conditions. In mental health research, the Delphi method has been used for making estimations where there is incomplete evidence (e.g. What is the global prevalence of dementia?), making predictions (e.g. What types of interactions with a person who is suicidal will reduce their chance of suicide?), determining collective values (e.g. What areas of research should be given greatest priority?) and defining foundational concepts (e.g. How should we define 'relapse'?). A range of experts have been used in Delphi research, including clinicians, researchers, consumers and caregivers. The Delphi method has a wide range of potential uses in mental health research. © The Royal Australian and New Zealand College of Psychiatrists 2015.

Consensus on the criteria needed for creating a rare-disease patient registry. A Delphi study.

PubMed

Cavero-Carbonell, Clara; Gras-Colomer, Elena; Guaita-Calatrava, Rosana; López-Briones, Carmen; Amorós, Rubén; Abaitua, Ignacio; Posada, Manuel; Zurriaga, Oscar

2016-06-01

Patient registries (PRs) are important tools for public-health surveillance and rare-disease research. The purpose of this study is to identify the most important criteria for the creation of a rare-disease PR that could be used by public-health authorities to develop health policies. A consensus-development Delphi study was used, with participants selected for their expertize in rare diseases and registries. Participants were asked to complete a questionnaire on the most important criteria for creating PRs. Three rounds were performed. Agreement was reached on half the questions in the first round and on 89% of questions in the final round, with a total expert participation rate of around 60% by the final stage. This study made it possible to reach a broader consensus starting from experts' initial assessment of the features that should be considered for the creation of a rare-disease PR. The consensus method used made it possible to define the characteristics of a PR based on expert opinion within a rare-disease framework. This study may serve as a guide for helping other researchers plan and build a rare-disease PR. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A Delphi study on environmental factors that impact work and social life participation of individuals with multiple sclerosis in Austria and Switzerland.

PubMed

Prodinger, Birgit; Weise, Andrea P; Shaw, Lynn; Stamm, Tanja A

2010-01-01

This study aimed to gain knowledge about environmental factors (EFs) that impact work and social life participation of people with multiple sclerosis (MS) in Austria and Switzerland to extend the knowledge of participation and to identify key areas for measuring participation. A three-round Delphi study was conducted defining patients as experts. In the 1st round, qualitative data was gathered through questionnaires, analyzed with content analysis, and factors were assigned to EFs as classified in the ICF. In the 2nd and 3rd round, experts judged EFs according to its relevance to obtain consensus (cut-off 75%). Categories were ranked on a scale from mostly important to important. One hundred and twelve Austrian and 109 Swiss experts were recruited. The content analysis revealed 768 EFs. The study resulted in a list of 176 consensus factors for Austria and 177 Switzerland. Five categories revealed to be highly important, 12 moderately important, 6 fairly important, and 10 important. This study indicates that participation in work or social life is influenced by physical, social, attitudinal, and policy factors. Consensus factors afford insights into areas for consideration in the development of participation outcome measurements and support a comprehensive and inclusive rehabilitation approach.

Identifying the science and technology dimensions of emerging public policy issues through horizon scanning.

PubMed

Parker, Miles; Acland, Andrew; Armstrong, Harry J; Bellingham, Jim R; Bland, Jessica; Bodmer, Helen C; Burall, Simon; Castell, Sarah; Chilvers, Jason; Cleevely, David D; Cope, David; Costanzo, Lucia; Dolan, James A; Doubleday, Robert; Feng, Wai Yi; Godfray, H Charles J; Good, David A; Grant, Jonathan; Green, Nick; Groen, Arnoud J; Guilliams, Tim T; Gupta, Sunjai; Hall, Amanda C; Heathfield, Adam; Hotopp, Ulrike; Kass, Gary; Leeder, Tim; Lickorish, Fiona A; Lueshi, Leila M; Magee, Chris; Mata, Tiago; McBride, Tony; McCarthy, Natasha; Mercer, Alan; Neilson, Ross; Ouchikh, Jackie; Oughton, Edward J; Oxenham, David; Pallett, Helen; Palmer, James; Patmore, Jeff; Petts, Judith; Pinkerton, Jan; Ploszek, Richard; Pratt, Alan; Rocks, Sophie A; Stansfield, Neil; Surkovic, Elizabeth; Tyler, Christopher P; Watkinson, Andrew R; Wentworth, Jonny; Willis, Rebecca; Wollner, Patrick K A; Worts, Kim; Sutherland, William J

2014-01-01

Public policy requires public support, which in turn implies a need to enable the public not just to understand policy but also to be engaged in its development. Where complex science and technology issues are involved in policy making, this takes time, so it is important to identify emerging issues of this type and prepare engagement plans. In our horizon scanning exercise, we used a modified Delphi technique. A wide group of people with interests in the science and policy interface (drawn from policy makers, policy adviser, practitioners, the private sector and academics) elicited a long list of emergent policy issues in which science and technology would feature strongly and which would also necessitate public engagement as policies are developed. This was then refined to a short list of top priorities for policy makers. Thirty issues were identified within broad areas of business and technology; energy and environment; government, politics and education; health, healthcare, population and aging; information, communication, infrastructure and transport; and public safety and national security.

Chapter 1. Introduction. Recommendations and standard operating procedures for intensive care unit and hospital preparations for an influenza epidemic or mass disaster.

PubMed

Sprung, Charles L; Cohen, Robert; Adini, Bruria

2010-04-01

In December 2007, the European Society of Intensive Care Medicine established a Task Force to develop standard operating procedures (SOPs) for operating intensive care units (ICU) during an influenza epidemic or mass disaster. To provide direction for health care professionals in the preparation and management of emergency ICU situations during an influenza epidemic or mass disaster, standardize activities, and promote coordination and communication among the medical teams. Based on a literature review and contributions of content experts, a list of essential categories for managing emergency situations in the ICU were identified. Based on three cycles of a modified Delphi process, consensus was achieved regarding the categories. A primary author along with an expert group drafted SOPs for each category. Based on the Delphi cycles, the following key topics were found to be important for emergency preparedness: triage, infrastructure, essential equipment, manpower, protection of staff and patients, medical procedures, hospital policy, coordination and collaboration with interface units, registration and reporting, administrative policies and education. The draft SOPs serve as benchmarks for emergency preparedness and response of ICUs to emergencies or outbreak of pandemics.

Delphi based consensus study into planning for chemical incidents.

PubMed

Crawford, I W F; Mackway-Jones, K; Russell, D R; Carley, S D

2004-01-01

To achieve consensus in all phases of chemical incident planning and response. A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required.

Delphi based consensus study into planning for chemical incidents

PubMed Central

Crawford, I; Mackway-Jones, K; Russell, D; Carley, S

2004-01-01

Objective: To achieve consensus in all phases of chemical incident planning and response. Design: A three round Delphi study was conducted using a panel of 39 experts from specialties involved in the management of chemical incidents. Areas that did not reach consensus in the Delphi study were presented as synopsis statements for discussion in four syndicate groups at a conference hosted by the Department of Health Emergency Planning Co-ordination Unit. Results: A total of 183 of 322 statements had reached consensus upon completion of the Delphi study. This represented 56.8% of the total number of statements. Of these, 148 reached consensus at >94% and 35 reached consensus at >89%. The results of the process are presented as a series of synopsis consensus statements that cover all phases of chemical incident planning and response. Conclusions: The use of a Delphi study and subsequent syndicate group discussions achieved consensus in aspects of all phases of chemical incident planning and response that can be translated into practical guidance for use at regional prehospital and hospital level. Additionally, areas of non-consensus have been identified where further work is required. PMID:14734369

Acceptability and Perceived Benefits and Risks of Public and Patient Involvement in Health Care Policy: A Delphi Survey in Belgian Stakeholders.

PubMed

Cleemput, Irina; Christiaens, Wendy; Kohn, Laurence; Léonard, Christian; Daue, François; Denis, Alain

2015-06-01

In systems with public health insurance, coverage decisions should reflect social values. Deliberation among stakeholders could achieve this goal, but rarely involves patients and citizens directly. This study aimed at evaluating the acceptability, and the perceived benefits and risks, of public and patient involvement (PPI) in coverage decision making to Belgian stakeholders. A two-round Delphi survey was conducted among all stakeholder groups. The survey was constructed on the basis of interviews with 10 key stakeholders and a review of the literature on participation models. Consensus was defined as 65% or more of the respondents agreeing with a statement and less than 15% disagreeing. Eighty stakeholders participated in both rounds. They were defined as the Delphi panel. Belgian stakeholders are open toward PPI in coverage decision processes. Benefits are expected to exceed risks. The preferred model for involvement is to consult citizens or patients, within the existing decision-making structures and at specific milestones in the process. Consulting citizens and patients is a higher level of involvement than merely informing them and a lower level than letting them participate actively. Consultation involves asking nonbinding advice on (parts of) the decision problem. According to the Delphi panel, the benefits of PPI could be increasing awareness among members of the general public and patients about the challenges and costs of health care, and enriched decision processes with expertise by experience from patients. Potential risks include subjectivity, insufficient resources to participate and weigh on the process, difficulties in finding effective ways to express a collective opinion, the risk of manipulation, and lobbying or power games of other stakeholders. PPI in coverage decision-making processes is acceptable to Belgian stakeholders, be it in different ways for different types of decisions. Benefits are expected to outweigh risks. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

[A Delphi Method Survey of the Core Competences of Post-Acute-Care Nurses in Caring for Acute Stroke Patients].

PubMed

Chi, Shu-Ching; Yeh, Lily; Lu, Meei-Shiow; Lin, Pei-Yu

2015-12-01

Post-acute care (PAC) service is becoming increasingly important in Taiwan as a core focus of government policies that are designed to ensure continuity of care. In order to improve PAC nursing education and quality of care, the present study applies a modified Delphi method to identify the core competences of nurses who provide PAC services to acute stroke patients. We surveyed 18 experts in post-acute care and long-term care anonymously using a 29-question questionnaire in order to identify the essential professional skills that are required to perform PAC effectively. The results of this survey indicate that the core competences of PAC may be divided into two categories: Case Management and Care Management. Case Management includes Direct Care, Communication, Health Care Education, Nursing Consulting, and Family Assessment & Health Care. Care Management includes Interdisciplinary Teamwork, Patient Care Management, and Resource Integration. The importance and practicality of each item was evaluated using a 7-point Likert scale. The experts required 2 rounds to reach a consensus about the importance and 3 rounds to determine the practicality of PAC core competences. This process highlighted the differing points of view that are held by professionals in the realms of nursing, medicine, and national health policy. The PAC in-job training program in its current form inadequately cul-tivates core competence in Care Management. The results of the present study may be used to inform the development of PAC nurse orientation training programs and continuing education courses.

A Delphi Study on Staff Bereavement Training in the Intellectual and Developmental Disabilities Field

ERIC Educational Resources Information Center

Gray, Jennifer A.; Truesdale, Jesslyn

2015-01-01

The Delphi technique was used to obtain expert panel consensus to prioritize content areas and delivery methods for developing staff grief and bereavement curriculum training in the intellectual and developmental disabilities (IDD) field. The Delphi technique was conducted with a panel of 18 experts from formal and informal disability caregiving,…

Estimating community health needs against a Triple Aim background: What can we learn from current predictive risk models?

PubMed

Elissen, Arianne M J; Struijs, Jeroen N; Baan, Caroline A; Ruwaard, Dirk

2015-05-01

To support providers and commissioners in accurately assessing their local populations' health needs, this study produces an overview of Dutch predictive risk models for health care, focusing specifically on the type, combination and relevance of included determinants for achieving the Triple Aim (improved health, better care experience, and lower costs). We conducted a mixed-methods study combining document analyses, interviews and a Delphi study. Predictive risk models were identified based on a web search and expert input. Participating in the study were Dutch experts in predictive risk modelling (interviews; n=11) and experts in healthcare delivery, insurance and/or funding methodology (Delphi panel; n=15). Ten predictive risk models were analysed, comprising 17 unique determinants. Twelve were considered relevant by experts for estimating community health needs. Although some compositional similarities were identified between models, the combination and operationalisation of determinants varied considerably. Existing predictive risk models provide a good starting point, but optimally balancing resources and targeting interventions on the community level will likely require a more holistic approach to health needs assessment. Development of additional determinants, such as measures of people's lifestyle and social network, may require policies pushing the integration of routine data from different (healthcare) sources. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

75 FR 16513 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-01

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8th, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture... location of Delphi Packard Electrical/Electronic Architecture, a subsidiary of Delphi Corporation. The...

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

Knowledge-Based Systems Approach to Wilderness Fire Management.

NASA Astrophysics Data System (ADS)

Saveland, James M.

The 1988 and 1989 forest fire seasons in the Intermountain West highlight the shortcomings of current fire policy. To fully implement an optimization policy that minimizes the costs and net value change of resources affected by fire, long-range fire severity information is essential, yet lacking. This information is necessary for total mobility of suppression forces, implementing contain and confine suppression strategies, effectively dealing with multiple fire situations, scheduling summer prescribed burning, and wilderness fire management. A knowledge-based system, Delphi, was developed to help provide long-range information. Delphi provides: (1) a narrative of advice on where a fire might spread, if allowed to burn, (2) a summary of recent weather and fire danger information, and (3) a Bayesian analysis of long-range fire danger potential. Uncertainty is inherent in long-range information. Decision theory and judgment research can be used to help understand the heuristics experts use to make decisions under uncertainty, heuristics responsible both for expert performance and bias. Judgment heuristics and resulting bias are examined from a fire management perspective. Signal detection theory and receiver operating curve (ROC) analysis can be used to develop a long-range forecast to improve decisions. ROC analysis mimics some of the heuristics and compensates for some of the bias. Most importantly, ROC analysis displays a continuum of bias from which an optimum operating point can be selected. ROC analysis is especially appropriate for long-range forecasting since (1) the occurrence of possible future events is stated in terms of probability, (2) skill prediction is displayed, (3) inherent trade-offs are displayed, and (4) fire danger is explicitly defined. Statements on the probability of the energy release component of the National Fire Danger Rating System exceeding a critical value later in the fire season can be made early July in the Intermountain West. Delphi was evaluated formally and informally. Continual evaluation and feedback to update knowledge-based systems results in a repository for current knowledge, and a means to devise policy that will augment existing knowledge. Thus, knowledge-based systems can help implement adaptive resource management.

Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study.

PubMed

Gijsbers, H J H; Lauret, G J; van Hofwegen, A; van Dockum, T A; Teijink, J A W; Hendriks, H J M

2016-06-01

The aim of the study was to develop quality indicators (QIs) for physiotherapy management of patients with intermittent claudication (IC) in the Netherlands. As part of an international six-step method to develop QIs, an online survey Delphi-procedure was completed. After two Delphi-rounds a validation round was performed. Twenty-six experts were recruited to participate in this study. Twenty-four experts completed two Delphi-rounds. A third round was conducted inviting 1200 qualified and registered physiotherapists of the Dutch integrated care network 'Claudicationet' to validate a draft set of quality indicators. Out of 83 potential QIs in the Dutch physiotherapy guideline on 'Intermittent claudication', consensus among the experts selected nine indicators. All nine quality indicators were validated by 300 physiotherapists. A final set of nine indicators was derived from (1) a Dutch evidence-based physiotherapy guideline, (2) an expert Delphi procedure and (3) a validation by 300 physiotherapists. This set of indicators should be validated in clinical practice. Copyright © 2015 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Scientific framework for research on disaster and mass casualty incident in Korea: building consensus using Delphi method.

PubMed

Kim, Chu Hyun; Park, Ju Ok; Park, Chang Bae; Kim, Seong Chun; Kim, Soo Jin; Hong, Ki Jeong

2014-01-01

We aimed to determine the scientific framework for research on disaster and mass casualty incident (MCI) in Korea, especially Korean terminology, feasible definition, and epidemiologic indices. The two staged policy Delphi method was performed by instructors of National Disaster Life Support (NDLS®) with the constructed questionnaire containing items based on the literature review. The first-stage survey was conducted by 11 experts through two rounds of survey for making issue and option. The second-stage survey was conducted by 35 experts for making a generalized group based consensus. Experts were selected among instructors of National Disaster Life Support Course. Through two staged Delphi survey experts made consensus: 1) the Korean terminology "jaenan" with "disaster" and "dajung-sonsang-sago" with "MCI"; 2) the feasible definition of "disaster" as the events that have an effect on one or more municipal local government area (city-county-district) or results in ≥ 10 of death or ≥ 50 injured victims; 3) the feasible definition of MCI as the events that result in ≥ 6 casualties including death; 4) essential 31 epidemiologic indices. Experts could determine the scientific framework in Korea for research on disaster medicine, considering the distinct characteristics of Korea and current research trends.

Integrating research evidence and physical activity policy making-REPOPA project.

PubMed

Aro, Arja R; Bertram, Maja; Hämäläinen, Riitta-Maija; Van De Goor, Ien; Skovgaard, Thomas; Valente, Adriana; Castellani, Tommaso; Chereches, Razvan; Edwards, Nancy

2016-06-01

Evidence shows that regular physical activity is enhanced by supporting environment. Studies are needed to integrate research evidence into health enhancing, cross-sector physical activity (HEPA) policy making. This article presents the rationale, study design, measurement procedures and the initial results of the first phase of six European countries in a five-year research project (2011-2016), REsearch into POlicy to enhance Physical Activity (REPOPA). REPOPA is programmatic research; it consists of linked studies; the first phase studied the use of evidence in 21 policies in implementation to learn more in depth from the policy making process and carried out 86 qualitative stakeholder interviews. The second, ongoing phase builds on the central findings of the first phase in each country; it consists of two sets of interventions: game simulations to study cross-sector collaboration and organizational change processes in the use of evidence and locally tailored interventions to increase knowledge integration. The results of the first two study phases will be tested and validated among policy makers and other stakeholders in the third phase using a Delphi process. Initial results from the first project phase showed the lack of explicit evidence use in HEPA policy making. Facilitators and barriers of the evidence use were the availability of institutional resources and support but also networking between researchers and policy makers. REPOPA will increase understanding use of research evidence in different contexts; develop guidance and tools and establish sustainable structures such as networks and platforms between academics and policy makers across relevant sectors. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Identifying the Science and Technology Dimensions of Emerging Public Policy Issues through Horizon Scanning

PubMed Central

Parker, Miles; Acland, Andrew; Armstrong, Harry J.; Bellingham, Jim R.; Bland, Jessica; Bodmer, Helen C.; Burall, Simon; Castell, Sarah; Chilvers, Jason; Cleevely, David D.; Cope, David; Costanzo, Lucia; Dolan, James A.; Doubleday, Robert; Feng, Wai Yi; Godfray, H. Charles J.; Good, David A.; Grant, Jonathan; Green, Nick; Groen, Arnoud J.; Guilliams, Tim T.; Gupta, Sunjai; Hall, Amanda C.; Heathfield, Adam; Hotopp, Ulrike; Kass, Gary; Leeder, Tim; Lickorish, Fiona A.; Lueshi, Leila M.; Magee, Chris; Mata, Tiago; McBride, Tony; McCarthy, Natasha; Mercer, Alan; Neilson, Ross; Ouchikh, Jackie; Oughton, Edward J.; Oxenham, David; Pallett, Helen; Palmer, James; Patmore, Jeff; Petts, Judith; Pinkerton, Jan; Ploszek, Richard; Pratt, Alan; Rocks, Sophie A.; Stansfield, Neil; Surkovic, Elizabeth; Tyler, Christopher P.; Watkinson, Andrew R.; Wentworth, Jonny; Willis, Rebecca; Wollner, Patrick K. A.; Worts, Kim; Sutherland, William J.

2014-01-01

Public policy requires public support, which in turn implies a need to enable the public not just to understand policy but also to be engaged in its development. Where complex science and technology issues are involved in policy making, this takes time, so it is important to identify emerging issues of this type and prepare engagement plans. In our horizon scanning exercise, we used a modified Delphi technique [1]. A wide group of people with interests in the science and policy interface (drawn from policy makers, policy adviser, practitioners, the private sector and academics) elicited a long list of emergent policy issues in which science and technology would feature strongly and which would also necessitate public engagement as policies are developed. This was then refined to a short list of top priorities for policy makers. Thirty issues were identified within broad areas of business and technology; energy and environment; government, politics and education; health, healthcare, population and aging; information, communication, infrastructure and transport; and public safety and national security. PMID:24879444

Application of Delphi expert panel in joint venture projects

NASA Astrophysics Data System (ADS)

Adnan, H.; Rosman, M. R.; Rashid, Z. Z. Ahmad; Mohamad Yusuwan, N.; Bakhary, N. A.

2018-02-01

This study was conducted with the aim to identify the application of the Delphi Technique in validating findings obtained from questionnaire surveys and interviews done in- depth on the subject of joint venture projects in Malaysia. The Delphi technique aims to achieve a consensus of opinion amongst expert panellist that were selected on the primary factors in JV projects. To achieve research objectives, a progressive series of questions was designed where a selected panel of expert to confirm and validate the final findings. The rationale, benefits, limitations and recommendations for the use of Delphi were given in this study. From the literature review done, twenty-one factors were identified as critical factors to the making any joint venture project successful. Detail information from contractors were obtained by using the questionnaire survey method and forty-three in-depth interviews were carried out. Trust between partners, mutual understanding, partner selection criteria, agreement of contract, objective compatibility, conflict, and commitment were confirmed by the Delphi panel to be the critical success factors besides another fourteen factors which were found to be the Failure Reduction Criteria. Delphi techniques has proven to successfully assist in recognising the main factors and would be beneficial in supplementing the success of joint venture arrangements application for construction projects in Malaysia.

An international survey and modified Delphi process revealed editors’ perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals

PubMed Central

Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768

An international survey and modified Delphi process revealed editors' perceptions, training needs, and ratings of competency-related statements for the development of core competencies for scientific editors of biomedical journals.

PubMed

Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David

2017-01-01

Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well).  The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.

[Establishment of policy indicators of adaptation to the impact of climate change on the transmission of schistosomiasis and malaria in China].

PubMed

Qian, Ying-Jun; Li, Shi-Zhu; Xu, Jun-Fang; Zhang, Li; Fu, Qing; Zhou, Xiao-Nong

2013-12-01

To set up a framework of indicators for schistosomiasis and malaria to guide the formulation and evaluation of vector-borne disease control policies focusing on adaptation to the negative impact of climate change. A 2-level indicator framework was set up on the basis of literature review, and Delphi method was applied to a total of 22 and 19 experts working on schistosomiasis and malaria, respectively. The result was analyzed to calculate the weight of various indicators. A total of 41 questionnaires was delivered, and 38 with valid response (92.7%). The system included 4 indicators at first level, i.e. surveillance, scientific research, disease control and intervention, and adaptation capacity building, with 25 indicators for schistosomiasis and 21 for malaria at the second level. Among indicators at the first level, disease surveillance ranked first with a weight of 0.32. Among the indicators at the second level, vector monitoring scored the highest in terms of both schistosomiasis and malaria. The indicators set up by Delphi method are practical,universal and effective ones using in the field, which is also useful to technically support the establishment of adaptation to climate change in the field of public health.

75 FR 28655 - Delphi Packard Electrical/Electronic Architecture, a Subsidiary of Delphi Corporation, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-21

.../Electronic Architecture, a Subsidiary of Delphi Corporation, Including On-Site Leased Workers From Bartech... Assistance on December 8, 2009, applicable to workers of Delphi Packard Electrical/Electronic Architecture, a.../Electronic Architecture, a subsidiary of Delphi Corporation, including on-site leased [[Page 28656

Building sustainability indicators in the health dimension for solid waste management 1

PubMed Central

Veiga, Tatiane Bonametti; Coutinho, Silvano da Silva; Andre, Silvia Carla Silva; Mendes, Adriana Aparecida; Takayanagui, Angela Maria Magosso

2016-01-01

ABSTRACT Objective: to prepare a list of sustainability indicators in the health dimension, for urban solid waste management. Methods: a descriptive and exploratory study performed jointly with 52 solid waste specialists, using a three-steps Delphi technique, and a scale measuring the degree of importance for agreement among the researchers in this area. Results: the subjects under study were 92,3% PhD's concentrated in the age group from 30 to 40 years old (32,7%) and 51% were men. At the end of the 3rd step of the Delphi process, the average and standard deviation of all the proposed indicators varied from 4,22 (±0,79) to 4,72 (±0,64), in a scale of scores for each indicator from 1 to 5 (from "dispensable" to "very important"). Results showed the level of correspondence among the participants ranging from 82% to 94% related to those indicators. Conclusion: the proposed indicators may be helpful not only for the identification of data that is updated in this area, but also to enlarge the field of debates of the environmental health policies, directed not only for urban solid waste but for the achievement of better health conditions for the Brazilian context. PMID:27508905

Designing a Standardized Laparoscopy Curriculum for Gynecology Residents: A Delphi Approach

PubMed Central

Shore, Eliane M.; Lefebvre, Guylaine G.; Husslein, Heinrich; Bjerrum, Flemming; Sorensen, Jette Led; Grantcharov, Teodor P.

2015-01-01

Background Evidence suggests that simulation leads to improved operative skill, shorter operating room time, and better patient outcomes. Currently, no standardized laparoscopy curriculum exists for gynecology residents. Objective To design a structured laparoscopy curriculum for gynecology residents using Delphi consensus methodology. Methods This study began with Delphi methodology to determine expert consensus on the components of a gynecology laparoscopic skills curriculum. We generated a list of cognitive content, technical skills, and nontechnical skills for training in laparoscopic surgery, and asked 39 experts in gynecologic education to rate the items on a Likert scale (1–5) for inclusion in the curriculum. Consensus was predefined as Cronbach α of ≥ 0.80. We then conducted another Delphi survey with 9 experienced users of laparoscopic virtual reality simulators to delineate relevant curricular tasks. Finally, a cross-sectional design defined benchmark scores for all identified tasks, with 10 experienced gynecologic surgeons performing the identified tasks at basic, intermediate, and advanced levels. Results Consensus (Cronbach α = 0.85) was achieved in the first round of the curriculum Delphi, and after 2 rounds (Cronbach α = 0.80) in the virtual reality curriculum Delphi. Consensus was reached for cognitive, technical, and nontechnical skills as well as for 6 virtual reality tasks. Median time and economy of movement scores defined benchmarks for all tasks. Conclusions This study used Delphi consensus to develop a comprehensive curriculum for teaching gynecologic laparoscopy. The curriculum conforms to current educational standards of proficiency-based training, and is suggested as a standard in residency programs. PMID:26221434

Assessment of critical thinking: a Delphi study.

PubMed

Paul, Sheila A

2014-11-01

Nurse educators are responsible for preparing nurses who critically analyze patient information and provide meaningful interventions in today's complex health care system. By using the Delphi research method, this study, utilized the specialized and experiential knowledge of Certified Nurse Educators. This original Delphi research study asked Certified Nurse Educators how to assess the critical-thinking ability of nursing students in the clinical setting. The results showed that nurse educators need time, during the clinical experience, to accurately assess each individual nursing student. This study demonstrated the need for extended student clinical time, and a variety of clinical learning assessment tools. Copyright © 2014 Elsevier Ltd. All rights reserved.

Updating the School Counseling Research Agenda: A Delphi Study

ERIC Educational Resources Information Center

Villares, Elizabeth; Dimmitt, Carey

2017-01-01

The authors updated an earlier Delphi study identifying the research priorities for school counseling (Dimmitt et al., 2005). A 29-member expert panel selected research questions from the prior study, generated new questions, and rank ordered the combined set. The results provide guidance for prioritizing dissertation topics, targeting future…

Reinforcement of Science Learning through Local Culture: A Delphi Study

ERIC Educational Resources Information Center

Nuangchalerm, Prasart

2008-01-01

This study aims to explore the ways to reinforce science learning through local culture by using Delphi technique. Twenty four participants in various fields of study were selected. The result of study provides a framework for reinforcement of science learning through local culture on the theme life and environment. (Contains 1 table.)

Experience of Delphi technique in the process of establishing consensus on core competencies.

PubMed

Raghav, Pankaja Ravi; Kumar, Dewesh; Bhardwaj, Pankaj

2016-01-01

The Department of Community Medicine and Family Medicine (CMFM) has been started as a new model for imparting the components of family medicine and delivering health-care services at primary and secondary levels in all six newly established All India Institute of Medical Sciences (AIIMS), but there is no competency-based curriculum for it. The paper aims to share the experience of Delphi method in the process of developing consensus on core competencies of the new model of CMFM in AIIMS for undergraduate medical students in India. The study adopted different approaches and methods, but Delphi was the most critical method used in this research. In Delphi, the experts were contacted by e-mail and their feedback on the same was analyzed. Two rounds of Delphi were conducted in which 150 participants were contacted in Delphi-I but only 46 responded. In Delphi-II, 26 participants responded whose responses were finally considered for analysis. Three of the core competencies namely clinician, primary-care physician, and professionalism were agreed by all the participants, and the least agreement was observed in the competencies of epidemiologist and medical teacher. The experts having more experience were less consistent as responses were changed from agree to disagree in more than 15% of participants and 6% changed from disagree to agree. Within the given constraints, the final list of competencies and skills for the discipline of CMFM compiled after the Delphi process will provide a useful insight into the development of competency-based curriculum of the subject.

The Creation and Application of Two Innovative Real-Time Delphi and Cross-Impact Simulation Approaches to Forecast the Future: Forecasting High-Speed Broadband Developments for the State of Hawai`i

ERIC Educational Resources Information Center

Bergo, Rolv Alexander

2013-01-01

Technology development is moving rapidly and our dependence on information services is growing. Building a broadband infrastructure that can support future demand and change is therefore critical to social, political, economic and technological developments. It is often up to local policy makers to find the best solutions to support this demand…

Health Professionals' Perceptions of Sexual Assault Management: A Delphi Study

ERIC Educational Resources Information Center

Jancey, Jonine; Meuleners, Lynn; Phillips, Maureen

2011-01-01

Objective: To explore health professionals' perceptions of sexual assault management practices and identify issues related to these practices across Western Australia (WA). Design: A two-round electronic Delphi study was undertaken with health professionals (medical doctors, registered nurses, social workers and managers). Setting: Healthcare…

Future Directions for Business Education: A Delphi Study

ERIC Educational Resources Information Center

Kesten, Cyril A.; Lambrecht, Judith J.

2010-01-01

Purpose: The purpose of this study was to synthesize perceptions from the field about current issues and to propose future directions for the field of business education. Method: A modified three-stage Delphi study was carried out with business educators who attended national conferences and/or belonged to national professional organizations.…

Rehabilitation Counselor Competencies When Working With Hispanic/Latino Immigrant Injured Workers: A Delphi Study

ERIC Educational Resources Information Center

Santos Román, Leslie M.; Estrada-Hernández, Noel

2017-01-01

Purpose: To explore and identify attitudes, knowledge, and skills rehabilitation practitioners in the private sector need when working with Hispanic/Latino immigrant injured workers. Methods: This study employed a 3-round Delphi study to obtain a consensus of 8 rehabilitation practitioners who had experience and expertise working with…

Factors Influencing Continuing Professional Development: A Delphi Study among Nursing Experts

ERIC Educational Resources Information Center

Brekelmans, Gerard; Poell, Rob F.; van Wijk, Kees

2013-01-01

Purpose: The aim of this paper is to present an inventory of expert opinions on the factors that influence the participation of registered nurses in continuing professional development (CPD) activities. Design/methodology/approach: A Delphi study was conducted among 38 Dutch experts (nursing employers, managers, education institutions, and…

A Delphi Study of Agriculture Teacher Perceptions of Problems in Student Retention.

ERIC Educational Resources Information Center

Dyer, James E.; Breja, Lisa M.; Ball, Anna L.

2003-01-01

A four-round Delphi study of secondary agriculture teachers (17, 17, 22, and 21 responses) identified and rated student retention problems. Consensus was reached on these items: scheduling difficulties, lack of counselor support, image, increased graduation requirements, college entrance requirements, competition from other activities, block…

Assessment Leaders' Perspectives of Institutional Cultures of Assessment: A Delphi Study

ERIC Educational Resources Information Center

Fuller, Matthew; Henderson, Susan; Bustamante, Rebecca

2015-01-01

Institutional cultures of assessment are praised as beneficial to student learning. Yet, extant studies have not explored the theoretical foundations and pragmatic approaches to shaping cultures of assessment. The researchers used the Delphi method to explore 10 higher education assessment leaders' attitudes and theoretical perspectives regarding…

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study.

PubMed

Blackwood, Bronagh; Ringrow, Suzanne; Clarke, Mike; Marshall, John; Rose, Louise; Williamson, Paula; McAuley, Danny

2015-08-20

Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children. We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes. The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Establishing core outcome sets for phenylketonuria (PKU) and medium-chain Acyl-CoA dehydrogenase (MCAD) deficiency in children: study protocol for systematic reviews and Delphi surveys.

PubMed

Potter, Beth K; Hutton, Brian; Clifford, Tammy J; Pallone, Nicole; Smith, Maureen; Stockler, Sylvia; Chakraborty, Pranesh; Barbeau, Pauline; Garritty, Chantelle M; Pugliese, Michael; Rahman, Alvi; Skidmore, Becky; Tessier, Laure; Tingley, Kylie; Coyle, Doug; Greenberg, Cheryl R; Korngut, Lawrence; MacKenzie, Alex; Mitchell, John J; Nicholls, Stuart; Offringa, Martin; Schulze, Andreas; Taljaard, Monica

2017-12-19

Inherited metabolic diseases (IMD) are a large group of rare single-gene disorders that are typically diagnosed early in life. There are important evidence gaps related to the comparative effectiveness of therapies for IMD, which are in part due to challenges in conducting randomized controlled trials (RCTs) for rare diseases. Registry-based RCTs present a unique opportunity to address these challenges provided the registries implement standardized collection of outcomes that are important to patients and their caregivers and to clinical providers and healthcare systems. Currently there is no core outcome set (COS) for studies evaluating interventions for paediatric IMD. This protocol outlines a study that will establish COS for each of two relatively common IMD in children, phenylketonuria (PKU) and medium-chain acyl-CoA dehydrogenase (MCAD) deficiency. This two-part study is registered with the Core Outcome Measures in Effectiveness Trials (COMET) initiative. Part 1 includes a rapid review and development of an evidence map to identify a comprehensive listing of outcomes reported in past studies of PKU and MCAD deficiency. The review follows established methods for knowledge synthesis, including a comprehensive search strategy, two stages of screening citations against inclusion/exclusion criteria by two reviewers working independently, and extraction of important data elements from eligible studies, including details of the outcomes collected and outcome measurement instruments. The review findings will inform part 2 of our study, a set of Delphi surveys to establish consensus on the highest priority outcomes for each condition. Healthcare providers, families of children with PKU or MCAD deficiency, and health system decision-makers will be invited to participate in two to three rounds of Delphi surveys. The design of the surveys will involve parents of children with IMD who are part of a family advisory forum. This protocol is a crucial step in developing the capacity to launch RCTs with meaningful outcomes that address comparative effectiveness questions in the field of paediatric IMD. Such trials will contribute high-quality evidence to inform decision-making by patients and their family members, clinicians, and policy-makers.

Defining a Bobath clinical framework - A modified e-Delphi study.

PubMed

Vaughan-Graham, Julie; Cott, Cheryl

2016-11-01

To gain consensus within the expert International Bobath Instructors Training Association (IBITA) on a Bobath clinical framework on which future efficacy studies can be based. A three-round modified e-Delphi approach was used with 204 full members of the IBITA. Twenty-one initial statements were generated from the literature. Consensus was defined a priori as at least 80% of the respondents with a level of agreement on a Likert scale of 4 or 5. The Delphi questionnaire for each round was available online for two weeks. Summary reports and subsequent questionnaires were posted within four weeks. Ninety-four IBITA members responded, forming the Delphi panel, of which 68 and 66 responded to Rounds Two and Three, respectively. The 21 initial statements were revised to 17 statements and five new statements in Round Two in which eight statements were accepted and two statements were eliminated. Round Three presented 12 revised statements, all reaching consensus. The Delphi was successful in gaining consensus on a Bobath clinical framework in a geographically diverse expert association, identifying the unique components of Bobath clinical practice. Discussion throughout all three Rounds revolved primarily around the terminology of atypical and compensatory motor behavior and balance.

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists

PubMed Central

2017-01-01

Purpose This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. Methods A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects’ responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Results Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Conclusion Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience. PMID:28900069

Current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination: an expert Delphi survey among dental hygienists.

PubMed

Hwang, Yoon-Sook; Kang, Hyun-Sook; Kim, Soo-Hwa; Moon, Hee-Jung; Lee, Sun-Mi; Jung, Jae-Yeon; Hwang, Su-Jeong; Ha, Jung-Eun

2017-01-01

This study aimed to investigate current issues and areas for improvement in the Korean Dental Hygienist National Licensing Examination (KDHNLE) through an expert Delphi survey. A Delphi survey was conducted from May through August 2016 in Korea. This Delphi survey included 20 persons representing the field of dental hygiene (7 groups from various dental hygiene-related organizations). The Delphi survey was administered through e-mail as 3 rounds of questionnaire surveys regarding the issues facing the KDHNLE and potential solutions to those challenges. The primary Delphi survey was an open questionnaire. In each round, subjects' responses were categorized according to the detailed themes of their responses. The minimum value of the content validity ratio of the survey results was determined by the number of panels participating in the Delphi survey. Issues facing the KDHNLE were identified from the results of the Delphi survey. The following 4 items had an average importance score of 4.0 or higher and were considered as important by over 85% of the panels: the failure of the practical test to reflect actual clinical settings, the focus of the practical test on dental scaling, the gap between the items evaluated on the national examination and actual practical work, and insufficiency in strengthening the expertise of licensed dental hygienists. The following items were suggested for improvement: more rigorous rater training, adjustment of the difficulty of the licensing examination, the introduction of a specialized dental hygienist system, and more rigorous refresher training for licensed dental hygienists. Based on the above results, the KDHNLE should be improved according to the core competencies of dental hygienists, including on-site clinical practice experience.

Multidisciplinary Delphi Development of a Scale to Evaluate Team Function in Obstetric Emergencies: The PETRA Scale.

PubMed

Balki, Mrinalini; Hoppe, David; Monks, David; Cooke, Mary Ellen; Sharples, Lynn; Windrim, Rory

2017-06-01

The objective of this study was to develop a new interdisciplinary teamwork scale, the Perinatal Emergency: Team Response Assessment (PETRA), for the management of obstetric crises, through consensus agreement of obstetric caregivers. This prospective study was performed using expert consensus, based on a Delphi method. The study investigators developed a new PETRA tool, specifically related to obstetric crisis management, based on the existing literature and discussions among themselves. The scale was distributed to a selected panel of experts in the field for the Delphi process. After each round of Delphi, every component of the scale was analyzed quantitatively by the percentage of agreement ratings and each comment reviewed by the blinded investigators. The assessment scale was then modified, with components of less than 80% agreement removed from the scale. The process was repeated on three occasions to reach a consensus and final PETRA scale. Fourteen of 24 invited experts participated in the Delphi process. The original PETRA scale included six categories and 48 items, one global scale item, and a 3-point rubric for rating. The overall percentage agreement by experts in the first, second, and third rounds was 95.0%, 93.2%, and 98.5%, respectively. The final scale after the third round of Delphi consisted of the following seven categories: shared mental model, communication, situational awareness, leadership, followership, workload management, and positive/effective behaviours and attitudes. There were 34 individual items within these categories, each with a 5-point rating rubric (1 = unacceptable to 5 = perfect). Using a structured Delphi method, we established the face and content validity of this assessment scale that focuses on important aspects of interdisciplinary teamwork in the management of obstetric crises. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique.

PubMed

Shawahna, Ramzi; Masri, Dina; Al-Gharabeh, Rawan; Deek, Rawan; Al-Thayba, Lama; Halaweh, Masa

2016-02-01

To develop and achieve formal consensus on a definition of medication administration errors and scenarios that should or should not be considered as medication administration errors in hospitalised patient settings. Medication administration errors occur frequently in hospitalised patient settings. Currently, there is no formal consensus on a definition of medication administration errors or scenarios that should or should not be considered as medication administration errors. This was a descriptive study using Delphi technique. A panel of experts (n = 50) recruited from major hospitals, nursing schools and universities in Palestine took part in the study. Three Delphi rounds were followed to achieve consensus on a proposed definition of medication administration errors and a series of 61 scenarios representing potential medication administration error situations formulated into a questionnaire. In the first Delphi round, key contact nurses' views on medication administration errors were explored. In the second Delphi round, consensus was achieved to accept the proposed definition of medication administration errors and to include 36 (59%) scenarios and exclude 1 (1·6%) as medication administration errors. In the third Delphi round, consensus was achieved to consider further 14 (23%) and exclude 2 (3·3%) as medication administration errors while the remaining eight (13·1%) were considered equivocal. Of the 61 scenarios included in the Delphi process, experts decided to include 50 scenarios as medication administration errors, exclude three scenarios and include or exclude eight scenarios depending on the individual clinical situation. Consensus on a definition and scenarios representing medication administration errors can be achieved using formal consensus techniques. Researchers should be aware that using different definitions of medication administration errors, inclusion or exclusion of medication administration error situations could significantly affect the rate of medication administration errors reported in their studies. Consensual definitions and medication administration error situations can be used in future epidemiology studies investigating medication administration errors in hospitalised patient settings which may permit and promote direct comparisons of different studies. © 2015 John Wiley & Sons Ltd.

[Delphi study to identify the management skills of nursing executives].

PubMed

Yañez, M R; Avila, J A; Bermudez, M I; De Miguel, I; Bellver, V; Guilabert, M; Mira, J J

2016-01-01

To determine and update the skills map for the position of Nurse Administrator in hospitals and Primary Care. An observational, descriptive, cross-sectional study based on a Delphi technique was conducted in hospital and Primary Care settings. Two nominal groups with 15 nurses each were used to define the contents of the questionnaire 0 in the Delphi technique. All nurses registered in the professional associations of Alicante, Castellón and Valencia were invited to participate. The results of the Delphi study was submitted to factor analysis to identify the set of skills and, subsequently, compare them with the offer of post-graduate course in colleges and universities during the 2014-15 academic year. Forty-five competences were extracted during the Nominal groups. In total, 705 nurses replied to the first wave in the Delphi Technique, and 394 in the second (response rate of 56%). Factorial analysis grouped the skills chosen into 10 factors: managing people, conflict management, independent learning, ethics, emotional balance, commitment, self-discipline, continuous improvement, critical-thinking, and innovation. Four skills groups identified in this study (emotional balancing, commitment, self-discipline and courage) were not usually included in the post-graduate courses The nurse administrator skills should be related to relational and ethical behaviour. The training offer of the post-graduate courses must be reoriented. Copyright © 2015 SECA. Published by Elsevier Espana. All rights reserved.

A Classical Delphi Study to Identify the Barriers of Pursuing Green Information and Communication Technologies

ERIC Educational Resources Information Center

Gotay, Jose Antonio

2013-01-01

This qualitative, classical Delphi study served to explore the apparent lack of corporate commitment to prioritized Green Information Communication Technologies (ICTs), which could delay the economic and social benefits for maximizing the use of natural energy resources in a weak economy. The purpose of this study was to examine the leadership…

A Delphi Study on Technology Enhanced Learning (TEL) Applied on Computer Science (CS) Skills

ERIC Educational Resources Information Center

Porta, Marcela; Mas-Machuca, Marta; Martinez-Costa, Carme; Maillet, Katherine

2012-01-01

Technology Enhanced Learning (TEL) is a new pedagogical domain aiming to study the usage of information and communication technologies to support teaching and learning. The following study investigated how this domain is used to increase technical skills in Computer Science (CS). A Delphi method was applied, using three-rounds of online survey…

African American Parental Beliefs about Resiliency: A Delphi Study

ERIC Educational Resources Information Center

Jones, Vita; Higgins, Kyle; Boone, Randall; Miller, Susan P.; Sileo, Nancy

2014-01-01

This study involved a Delphi inquiry concerning the characteristics of resiliency specific to African American children/youth. The study was conducted with a large group of African American parents who were considered experts in resiliency because they had graduated from high school and had at least one child who had graduated from high school.…

Research Priorities for YouTube and Video-Sharing Technologies: A Delphi Study

ERIC Educational Resources Information Center

Snelson, Chareen; Rice, Kerry; Wyzard, Constance

2012-01-01

Online video-sharing services, particularly YouTube, have gained an audience of billions of users including educators and scholars. While the academic literature provides some evidence that YouTube has been studied and written about, little is known about priorities for YouTube research. The study employed the Delphi method to obtain a consensus…

Financial Leadership Competencies for Public College and University Presidential Leaders in Georgia: A Delphi Study

ERIC Educational Resources Information Center

Jones, Susan M.

2011-01-01

The purpose of the mixed-method Delphi study is to identify the financial leadership competencies considered most important in operating public higher education institutions. The current study also determined whether differences existed in the perceptions of participants' age, level of education, years of service as a president, the number of…

Critical Guidelines for U.S.-Based Counselor Educators When Working Transnationally: A Delphi Study

ERIC Educational Resources Information Center

Smith, Paul H.; Benshoff, James M.; Gonzalez, Laura M.

2018-01-01

U.S.-based counselor education faculty increasingly are participating in transnational experiences, such as global research and study abroad. The purpose of this study was to develop guidelines for U.S.-based counselor educators when working transnationally. Using Delphi methodology, 69 consensus guidelines were developed from an expert panel.…

Issues Facing Urban Agriscience Teachers: A Delphi Study

ERIC Educational Resources Information Center

Warner, Wendy J.; Washburn, Shannon G.

2009-01-01

This national study used the Delphi technique to identify the issues facing urban agriscience teachers. The first round of the study used a questionnaire with one open-ended question to generate responses from the expert panel. In the second round, respondents were asked to rate their level of agreement with 72 issues identified in round one using…

The Delphi Method Online: Medical Expert Consensus Via the Internet

PubMed Central

Cam, Kenneth M.; McKnight, Patrick E.; Doctor, Jason N.

2002-01-01

Delphi is an expert consensus method. The theory behind the Delphi method is that the interaction of experts may lead to a reduction in individual bias. We have developed software that carries out all aspects of the Delphi method via the Internet. The Delphi method online consists of three components: 1) authorship, 2) interactive polling, and 3) reporting/results. We hope that researchers use this tool in future medical expert systems.

Current and Emerging Ethical Issues in Counseling: A Delphi Study of Expert Opinions

ERIC Educational Resources Information Center

Herlihy, Barbara; Dufrene, Roxane L.

2011-01-01

A Delphi study was conducted to ascertain the opinions of panel experts regarding the most important current and emerging ethical issues facing the counseling profession. Expert opinions on ethical issues in counselor preparation also were sought. Eighteen panelists responded to 3 rounds of data collection interspersed with feedback. Themes that…

Supervising Counsellors and Psychotherapists Who Work with Trauma: A Delphi Study

ERIC Educational Resources Information Center

West, Angela

2010-01-01

In this study the Delphi technique was used to identify the main supervision issues that require attention and consideration when supervising counsellors and psychotherapists working with trauma. A panel of supervisors, who were additionally experienced in working with trauma in adulthood, completed a series of three questionnaires comprising two…

Towards an Understanding of Instructional Design Heuristics: An Exploratory Delphi Study

ERIC Educational Resources Information Center

York, Cindy S.; Ertmer, Peggy A.

2011-01-01

Evidence suggests that experienced instructional designers often use heuristics and adapted models when engaged in the instructional design problem-solving process. This study used the Delphi technique to identify a core set of heuristics designers reported as being important to the success of the design process. The overarching purpose of the…

The Conduct of Socially Valid Investigation by Culturally Diverse Researchers: A Delphi Study

ERIC Educational Resources Information Center

Dutta, Alo; Kundu, Madan; Chan, Fong

2010-01-01

Minority researchers have traditionally exhibited a need for and interest in investigating non-mainstream issues involving diverse communities. Since faculty at colleges and universities within the United States are largely Caucasian, research on issues relevant to marginalized groups is lacking. This three-stage Delphi study was designed to…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Helping Competencies of Student Affairs Professionals: A Delphi Study

ERIC Educational Resources Information Center

Reynolds, Amy L.

2011-01-01

The purpose of this study was to gather student affairs professionals' perceptions of the knowledge and skills needed to effectively help students. Using the Delphi method, 159 entry-level and mid-level student affairs administrators from institutions across the United States were surveyed regarding their perceptions of the helping skills they use…

Achieving Next Generation Science Standards through Agricultural Contexts: A Delphi Study of Outdoor Education Experts

ERIC Educational Resources Information Center

Meals, Anthony; Washburn, Shannon

2015-01-01

A Delphi survey was conducted with 30 outdoor education experts in Kansas. Participant responses helped frame a Kansas definition of outdoor education and identified essential educational goals and outcomes, critical components for effective outdoor education programming, and barriers facing outdoor education in Kansas. The study highlights…

The Stammering Information Programme: A Delphi Study

ERIC Educational Resources Information Center

Berquez, Ali E.; Cook, Frances M.; Millard, Sharon K.; Jarvis, Effie

2011-01-01

Purpose: To find out what information children, parents and education staff feel would be important to know to support a child who stutters in the educational environment, in order to develop appropriate resources. Method: A Delphi study was carried out to seek the opinions of experts about the information to include. A structured six stage…

The Future of Information Literacy in Academic Libraries: A Delphi Study

ERIC Educational Resources Information Center

Saunders, Laura

2009-01-01

Information literacy is a central tenet of academic librarianship. However, technological advancements coupled with drastic changes in users' information needs and expectations are having a great impact on this service, leading practitioners to wonder how programs may evolve. Based on a Delphi study, this article surveyed 13 information literacy…

Qualitative Delphi Study of Factors Influencing Data Center Investment in Eco-Innovations

ERIC Educational Resources Information Center

Stewart, M. Bennett

2016-01-01

This qualitative investigation explored the diffusion of eco-innovations within the U.S. data center industry from 2007 to 2015 whose adoption was intended to decouple digital economy growth from environmental impact. Using diffusion of innovation theory to inform the study, and synthesizing subject matter expert input from a Delphi panel…

Building a Privacy, Ethics, and Data Access Framework for Real World Computerised Medical Record System Data: A Delphi Study. Contribution of the Primary Health Care Informatics Working Group.

PubMed

Liyanage, H; Liaw, S-T; Di Iorio, C T; Kuziemsky, C; Schreiber, R; Terry, A L; de Lusignan, S

2016-11-10

Privacy, ethics, and data access issues pose significant challenges to the timely delivery of health research. Whilst the fundamental drivers to ensure that data access is ethical and satisfies privacy requirements are similar, they are often dealt with in varying ways by different approval processes. To achieve a consensus across an international panel of health care and informatics professionals on an integrated set of privacy and ethics principles that could accelerate health data access in data-driven health research projects. A three-round consensus development process was used. In round one, we developed a baseline framework for privacy, ethics, and data access based on a review of existing literature in the health, informatics, and policy domains. This was further developed using a two-round Delphi consensus building process involving 20 experts who were members of the International Medical Informatics Association (IMIA) and European Federation of Medical Informatics (EFMI) Primary Health Care Informatics Working Groups. To achieve consensus we required an extended Delphi process. The first round involved feedback on and development of the baseline framework. This consisted of four components: (1) ethical principles, (2) ethical guidance questions, (3) privacy and data access principles, and (4) privacy and data access guidance questions. Round two developed consensus in key areas of the revised framework, allowing the building of a newly, more detailed and descriptive framework. In the final round panel experts expressed their opinions, either as agreements or disagreements, on the ethics and privacy statements of the framework finding some of the previous round disagreements to be surprising in view of established ethical principles. This study develops a framework for an integrated approach to ethics and privacy. Privacy breech risk should not be considered in isolation but instead balanced by potential ethical benefit.

Delphi`s DETOXSM process: Preparing to treat high organic content hazardous and mixed wastes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robertson, D.T.; Rogers, T.W.; Goldblatt, S.D.

1998-12-31

The US Department of Energy (DOE) Federal Energy Technology Center is sponsoring a full-scale technology demonstration of Delphi Research, Inc.`s patented DETOX{sup SM} catalytic wet chemical oxidation waste treatment process at the Savannah River Site (SRS) in South Carolina. The process is being developed primarily to treat hazardous and mixed wastes within the DOE complex as an alternative to incineration, but it has significant potential to treat wastes in the commercial sector. The results of the demonstration will be intensively studied and used to validate the technology. A critical objective in preparing for the demonstration was the successful completion ofmore » a programmatic Operational Readiness Review. Readiness Reviews are required by DOE for all new process startups. The Readiness Review provided the vehicle to ensure that Delphi was ready to start up and operate the DETOX{sup SM} process in the safest manner possible by implementing industry accepted management practices for safe operation. This paper provides an overview of the DETOX{sup SM} demonstration at SRS, and describes the crucial areas of the Readiness Review that marked the first steps in Delphi`s transition from a technology developer to an operating waste treatment services provider.« less

Using a Delphi process to establish consensus on emergency medicine clerkship competencies.

PubMed

Penciner, Rick; Langhan, Trevor; Lee, Richard; McEwen, Jill; Woods, Robert A; Bandiera, Glen

2011-01-01

Currently, there is no consensus on the core competencies required for emergency medicine (EM) clerkships in Canada. Existing EM curricula have been developed through informal consensus or local efforts. The Delphi process has been used extensively as a means for establishing consensus. The purpose of this project was to define core competencies for EM clerkships in Canada, to validate a Delphi process in the context of national curriculum development, and to demonstrate the adoption of the CanMEDS physician competency paradigm in the undergraduate medical education realm. Using a modified Delphi process, we developed a consensus amongst a panel of expert emergency physicians from across Canada utilizing the CanMEDS 2005 Physician Competency Framework. Thirty experts from nine different medical schools across Canada participated on the panel. The initial list consisted of 152 competencies organized in the seven domains of the CanMEDS 2005 Physician Competency Framework. After the second round of the Delphi process, the list of competencies was reduced to 62 (59% reduction). This study demonstrated that a modified Delphi process can result in a strong consensus around a realistic number of core competencies for EM clerkships. We propose that such a method could be used by other medical specialties and health professions to develop rotation-specific core competencies.

A core outcome set for localised prostate cancer effectiveness trials: protocol for a systematic review of the literature and stakeholder involvement through interviews and a Delphi survey.

PubMed

MacLennan, Steven; Bekema, Hendrika J; Williamson, Paula R; Campbell, Marion K; Stewart, Fiona; MacLennan, Sara J; N'Dow, James M O; Lam, Thomas B L

2015-03-04

Prostate cancer is a growing health problem worldwide. The management of localised prostate cancer is controversial. It is unclear which of several surgical, radiotherapeutic, ablative, and surveillance treatments is the most effective. All have cost, process and recovery, and morbidity implications which add to treatment decision-making complexity for patients and healthcare professionals. Evidence from randomised controlled trials (RCTs) is not optimal because of uncertainty as to what constitutes important outcomes. Another issue hampering evidence synthesis is heterogeneity of outcome definition, measurement, and reporting. This project aims to determine which outcomes are the most important to patients and healthcare professionals, and use these findings to recommend a standardised core outcome set for comparative effectiveness trials of treatments for localised prostate cancer, to optimise decision-making. The range of potentially important outcomes and measures will be identified through systematic reviews of the literature and semi-structured interviews with patients. A consultation exercise involving representatives from two key stakeholder groups (patients and healthcare professionals) will ratify the list of outcomes to be entered into a three round Delphi study. The Delphi process will refine and prioritise the list of identified outcomes. A methodological substudy (nested RCT design) will also be undertaken. Participants will be randomised after round one of the Delphi study to one of three feedback groups, based on different feedback strategies, in order to explore the potential impact of feedback strategies on participant responses. This may assist the design of a future core outcome set and Delphi studies. Following the Delphi study, a final consensus meeting attended by representatives from both stakeholder groups will determine the final recommended core outcome set. This study will inform clinical practice and future trials of interventions of localised prostate cancer by standardising a core outcome set which should be considered in comparative effectiveness studies for localised prostate cancer.

Defining consensus norms for palliative care of people with intellectual disabilities in Europe, using Delphi methods: A White Paper from the European Association of Palliative Care

PubMed Central

Tuffrey-Wijne, Irene; McLaughlin, Dorry; Curfs, Leopold; Dusart, Anne; Hoenger, Catherine; McEnhill, Linda; Read, Sue; Ryan, Karen; Satgé, Daniel; Straßer, Benjamin; Westergård, Britt-Evy; Oliver, David

2015-01-01

Background: People with intellectual disabilities often present with unique challenges that make it more difficult to meet their palliative care needs. Aim: To define consensus norms for palliative care of people with intellectual disabilities in Europe. Design: Delphi study in four rounds: (1) a taskforce of 12 experts from seven European countries drafted the norms, based on available empirical knowledge and regional/national guidelines; (2) using an online survey, 34 experts from 18 European countries evaluated the draft norms, provided feedback and distributed the survey within their professional networks. Criteria for consensus were clearly defined; (3) modifications and recommendations were made by the taskforce; and (4) the European Association for Palliative Care reviewed and approved the final version. Setting and participants: Taskforce members: identified through international networking strategies. Expert panel: a purposive sample identified through taskforce members’ networks. Results: A total of 80 experts from 15 European countries evaluated 52 items within the following 13 norms: equity of access, communication, recognising the need for palliative care, assessment of total needs, symptom management, end-of-life decision making, involving those who matter, collaboration, support for family/carers, preparing for death, bereavement support, education/training and developing/managing services. None of the items scored less than 86% agreement, making a further round unnecessary. In light of respondents’ comments, several items were modified and one item was deleted. Conclusion: This White Paper presents the first guidance for clinical practice, policy and research related to palliative care for people with intellectual disabilities based on evidence and European consensus, setting a benchmark for changes in policy and practice. PMID:26346181

Developing the E-Delphi System: A Web-Based Forecasting Tool for Educational Research.

ERIC Educational Resources Information Center

Chou, Chien

2002-01-01

Discusses use of the Delphi technique and describes the development of an electronic version, called e-Delphi, in which questionnaire construction and communication with panel members was accomplished using the Web. Explains system function and interface and discusses evaluation of the e-Delphi system. (Author/LRW)

Gaining consensus on family carer needs when caring for someone dying at home to develop the Carers' Alert Thermometer (CAT): a modified Delphi study.

PubMed

Knighting, Katherine; O'Brien, Mary R; Roe, Brenda; Gandy, Rob; Lloyd-Williams, Mari; Nolan, Mike; Jack, Barbara A

2016-01-01

To report a multi-phase modified Delphi study conducted with carers and professionals to identify the priority areas for inclusion in an alert screening tool for carers providing support to someone dying at home. Internationally, there is a growing emphasis on increasing choice for patients who wish to die at home which relies heavily on care provided by the unpaid family carers. Family carers can have high levels of unmet needs comprising their psychological and physical health and their ability to provide effective care and support. Development of an alert tool to identify carers' needs in everyday practice required identification and consensus of the priority areas of need for inclusion. Multi-phase modified Delphi study and instrument development. Qualitative and quantitative data collection took place between 2011-2013 with 111 carers and 93 professionals to identify carers' needs and gain consensus on the priority areas for inclusion in the alert tool. An expert panel stage and final evidence review post-Delphi were used. The Delphi panels had high levels of agreement and consensus. Ten areas of carer need across two themes of 'the current caring situation' and 'the carer's own health and well-being' were prioritized for inclusion in the alert tool. An optional end-of-life planning question was included following the final stages. The results provide evidence of carers' needs to be assessed, areas for consideration in the education of those who support carers and someone dying at home and targeting of services, while demonstrating the usefulness and adaptability of the Delphi method. © 2015 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

Identification of the Competencies Needed to Apply Social Marketing to Extension Programming: Results of a Delphi Study

ERIC Educational Resources Information Center

Warner, Laura A.; Stubbs, Eric; Murphrey, Theresa Pesl; Huynh, Phuong

2016-01-01

The purpose of this study was to identify the specific competencies needed to apply social marketing, a promising approach to behavior change, to Extension programming. A modified Delphi study was used to achieve group consensus among a panel of experts on the skills, characteristics, and knowledge needed to successfully apply this behavior change…

Teacher Leadership: A Delphi Study of Factors in Building Teacher Leadership Capacity in Elementary Educational Organizations

ERIC Educational Resources Information Center

Castilleja Gray, Beatrice

2016-01-01

Purpose: The purpose of this qualitative study was to identify and describe the most important factors that motivate or deter teachers in deciding to take on the informal or formal role of teacher-leader in Riverside County elementary school districts. Methodology: Endemic of a Delphi method, the instruments used within this study collected data…

Understanding and Defining Cognitive Style and Learning Style: A Delphi Study in the Context of Educational Psychology

ERIC Educational Resources Information Center

Armstrong, Steven J.; Peterson, Elizabeth R.; Rayner, Stephen G.

2012-01-01

This report outlines the findings from a Delphi study designed to establish consensus on the definitions of cognitive style and learning style amongst an international style researcher community. The study yields long-needed definitions for each construct that reflect high levels of agreement. In a field that has been criticised for a bewildering…

DIET@NET: Best Practice Guidelines for dietary assessment in health research.

PubMed

Cade, Janet E; Warthon-Medina, Marisol; Albar, Salwa; Alwan, Nisreen A; Ness, Andrew; Roe, Mark; Wark, Petra A; Greathead, Katharine; Burley, Victoria J; Finglas, Paul; Johnson, Laura; Page, Polly; Roberts, Katharine; Steer, Toni; Hooson, Jozef; Greenwood, Darren C; Robinson, Sian

2017-11-15

Dietary assessment is complex, and strategies to select the most appropriate dietary assessment tool (DAT) in epidemiological research are needed. The DIETary Assessment Tool NETwork (DIET@NET) aimed to establish expert consensus on Best Practice Guidelines (BPGs) for dietary assessment using self-report. The BPGs were developed using the Delphi technique. Two Delphi rounds were conducted. A total of 131 experts were invited, and of these 65 accepted, with 48 completing Delphi round I and 51 completing Delphi round II. In all, a total of 57 experts from North America, Europe, Asia and Australia commented on the 47 suggested guidelines. Forty-three guidelines were generated, grouped into the following four stages: Stage I. Define what is to be measured in terms of dietary intake (what? who? and when?); Stage II. Investigate different types of DATs; Stage III. Evaluate existing tools to select the most appropriate DAT by evaluating published validation studies; Stage IV. Think through the implementation of the chosen DAT and consider sources of potential biases. The Delphi technique consolidated expert views on best practice in assessing dietary intake. The BPGs provide a valuable guide for health researchers to choose the most appropriate dietary assessment method for their studies. These guidelines will be accessible through the Nutritools website, www.nutritools.org .

A Delphi Investigation into Future Trends in E-Learning in Israel

ERIC Educational Resources Information Center

Aharony, Noa; Bronstein, Jenny

2014-01-01

The purpose of this study is to investigate the views and opinions of e-learning experts regarding future trends in the e-learning arena. The Delphi technique was chosen as a method of study. This technique is an efficient and effective group communication process designed to systematically elicit judgments from experts in their selected area of…

Views and Dreams: A Delphi Investigation into Library 2.0 Applications

ERIC Educational Resources Information Center

Bronstein, Jenny; Aharony, Noa

2009-01-01

The study's purpose was to investigate the views and opinions of librarians about the implementation of Web 2.0 technologies into library operations and services. The Delphi technique was chosen as the method of inquiry in this study, in which a group of panelists graded the desirability and probability of a list of statements. Thirty-nine…

Increasing Activeness and Learning Outcomes by Developing Borland Delphi 7.0 Application as Instructional Media

ERIC Educational Resources Information Center

Setyorini, Dyna; Churiyah, Madziatul

2016-01-01

This study aims to produce instructional media of petty cash fund with Borland Delphi 7.0 application in the Finance Administration subject, Managing Petty Cash Fund material in class XII APK in Vocational High School (SMK) Negeri 1 Pasuruan, East Java, Indonesia. This study used "Research and Development" (R&D) design procedures…

Designing Graduate-Level Plant Breeding Curriculum: A Delphi Study of Private Sector Stakeholder Opinions

ERIC Educational Resources Information Center

Miller, Jane K.; Repinski, Shelby L.; Hayes, Kathryn N.; Bliss, Frederick A.; Trexler, Cary J.

2011-01-01

A broad-based survey using the Delphi method was conducted to garner current information from private sector stakeholders and build consensus opinions supporting key ideas for enhancing plant breeder education and training. This study asked respondents to suggest and rate topics and content they deemed most important to plant breeding graduate…

Identifying Areas of Tension in the Field of Technology-Enhanced Learning: Results of an International Delphi Study

ERIC Educational Resources Information Center

Plesch, Christine; Kaendler, Celia; Rummel, Nikol; Wiedmann, Michael; Spada, Hans

2013-01-01

Despite steady progress in research in technology-enhanced learning (TEL), the translation of research findings and technology into educational practices falls short of expectations. We present five Areas of Tension which were identified and evaluated in an international Delphi study on TEL. These tensions might impede a more comprehensive…

The Underutilization of Information and Communication Technology-Assisted Collaborative Project-Based Learning among International Educators: A Delphi Study

ERIC Educational Resources Information Center

Kramer, Barry S.; Walker, Andrew E.; Brill, Jennifer M.

2007-01-01

This study explores the barriers associated with teachers implementing information and communication technology-assisted collaborative project-based learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of…

Greenhouse Facility Management Experts Identification of Competencies and Teaching Methods to Support Secondary Agricultural Education Instructors: A Modified Delphi Study

ERIC Educational Resources Information Center

Franklin, Edward A.

2011-01-01

In this study the Delphi technique has been used to develop a list of educational competencies for preparing secondary agricultural education instructors to effectively manage their school greenhouse facilities. The use of specialized facilities in agricultural education requires appropriate preparation of agricultural education teachers. The…

Identifying Threshold Concepts for Information Literacy: A Delphi Study

ERIC Educational Resources Information Center

Townsend, Lori; Hofer, Amy R.; Hanick, Silvia Lin; Brunetti, Korey

2016-01-01

This study used the Delphi method to engage expert practitioners on the topic of threshold concepts--core ideas and processes in a discipline that students need to grasp in order to progress in their learning, but that are often unspoken or unrecognized by expert practitioners--for information literacy. A panel of experts considered two questions:…

Emerging Issues in the Utilization of Weblogs in Higher Education Classrooms

ERIC Educational Resources Information Center

Ayao-ao, Shirley

2014-01-01

This paper examines the emerging issues in the utilization of weblogs in Philippine higher education and how these issues affect the performance of students. This study used a modified Delphi method. The Delphi panel consisted of 12 experts in the integration of technology, particularly blogs, in their teaching. The study yielded the following…

Trends that FCS Education Should Address: A Delphi Study Reveals Top 16

ERIC Educational Resources Information Center

Alexander, Karen L.; Davis, Kimberlee

2011-01-01

This study used the Delphi method to identify trends of importance to family and consumer sciences (FCS) education. A panel of 21 FCS education experts identified 16 trends and evaluated them by importance, desirability, feasibility, and confidence in validity of the trend. Nutrition appeared as a top priority, followed by consumer economics. The…

Trails research: where do we go from here?

Treesearch

Michael A. Schuett; Patricia Seiser

2002-01-01

This paper describes a recent study focusing on trails research needs. This study was supported by American Trails. Using a Delphi technique, 86 trails experts representing a variety of federal, state and local agencies, nonprofits, and trail uses were queried by email on trails research needs. A Delphi technique is a prognostic tool for dealing with complex problems...

Knowledge as an Aspect of Scientific Competence for Citizenship: Results of a Delphi Study in Spain

ERIC Educational Resources Information Center

España-Ramos, Enrique; González-García, Francisco José; Blanco-López, Ángel; Franco-Mariscal, Antonio Joaquín

2016-01-01

This article focuses on scientific knowledge as one aspect of the scientific competencies that citizens should ideally possess. The analysis is based on a Delphi study we conducted with Spanish experts from different science-related fields. The results showed that although the experts proposed several examples of scientific knowledge, the degree…

The Essential Components of Coach Training for Mental Health Professionals: A Delphi Study

ERIC Educational Resources Information Center

Moriarity, Marlene Therese

2010-01-01

Purpose. The purpose of this study was to discover how coach training experts define coaching and what they would identify to be the essential components of a coach training program for mental health professionals. Methods. A panel of nine experts, through an iterative Delphi process of responding to three rounds of questionnaires, provided…

A Delphi Study: The Characteristics of Democratic Schools

ERIC Educational Resources Information Center

Korkmaz, H. Eylem; Erden, Münire

2014-01-01

The authors aim to identify characteristics of democratic schools. The Delphi technique used in this study is based on attaining a consensus among a group of experts over 3 rounds with 22 experts from 9 countries participating in the first round. By the end of the third round, 339 items referring to democratic school characteristics were…

A Delphi Study to Understand Relational Bonds in Supervision and Their Effect on Rehabilitation Counselor Disclosure in the Public Rehabilitation Program

ERIC Educational Resources Information Center

Magnuson, Lori Anne

2012-01-01

The scholarly literature surrounding counselor supervision suggests that relational bonds built on liking, trusting, and caring between supervisors and counselors positively impact counselor willingness to disclose practice errors and ethical issues in supervision. This Delphi study explored the opinions of expert public rehabilitation supervisors…

The Semiconductor Industry and Emerging Technologies: A Study Using a Modified Delphi Method

ERIC Educational Resources Information Center

Jordan, Edgar A.

2010-01-01

The purpose of this qualitative descriptive study was to determine what leaders in the semiconductor industry thought the future of computing would look like and what emerging materials showed the most promise to overcome the current theoretical limit of 10 nanometers for silicon dioxide. The researcher used a modified Delphi technique in two…

Exploring Research Themes in Public Engagement within a Natural History Museum: A Modified Delphi Approach

ERIC Educational Resources Information Center

Seakins, Amy; Dillon, Justin

2013-01-01

The primacy of the research question in designing studies affords an opportunity for enhancing collaborations between researchers and "practitioners". This paper describes the use of a modified Delphi technique to co-generate research questions for a collaborative research study co-funded by a university and a natural history museum.…

Identifying Core Mobile Learning Faculty Competencies Based Integrated Approach: A Delphi Study

ERIC Educational Resources Information Center

Elbarbary, Rafik Said

2015-01-01

This study is based on the integrated approach as a concept framework to identify, categorize, and rank a key component of mobile learning core competencies for Egyptian faculty members in higher education. The field investigation framework used four rounds Delphi technique to determine the importance rate of each component of core competencies…

Characteristics of Viable and Sustainable Workers for the Year 2015.

ERIC Educational Resources Information Center

Dean, Brenda Pennington; West, Russell

A two-round Delphi study was conducted to identify the characteristics of viable and sustainable employees in northeastern Tennessee in 2015. The Delphi panel selected for the study consisted of 25 experts who represented a cross-section of the businesses and communities in the 10-county area of northeastern Tennessee served by Walters State…

Development of criteria for evaluating clinical response in thyroid eye disease using a modified Delphi technique.

PubMed

Douglas, Raymond S; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A; Cahill, Kenneth; Dolman, Peter J; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J; Khanna, Dinesh

2009-09-01

To identify components of a provisional clinical response index for thyroid eye disease using a modified Delphi technique. The International Thyroid Eye Disease Society conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in thyroid eye disease. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty-four respondents participated in the Delphi 1 survey, providing 220 unique items. Ninety-two members (100% of the respondents from Delphi 1 plus 8 new participants) responded in Delphi 2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi 3 (67 criteria were excluded because of redundancy). Criteria with a mean greater than 6 (1 = least appropriate to 9 = most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for thyroid eye disease. These measures will be iteratively refined for use in multicenter clinical trials.

Development of criteria for evaluating clinical response in thyroid eye disease (CRI-TED) using a modified Delphi technique

PubMed Central

Douglas, Raymond S.; Tsirbas, Angelo; Gordon, Mark; Lee, Diana; Khadavi, Nicole; Garneau, Helene Chokron; Goldberg, Robert A.; Cahill, Kenneth; Dolman, Peter J.; Elner, Victor; Feldon, Steve; Lucarelli, Mark; Uddin, Jimmy; Kazim, Michael; Smith, Terry J.; Khanna, Dinesh

2014-01-01

To identify components of a provisional clinical response index for thyroid eye disease (CRI-TED) using a modified Delphi technique. The International Thyroid Eye Disease Society (ITEDS) conducted a structured, 3-round Delphi exercise establishing consensus for a core set of measures for clinical trials in TED. The steering committee discussed the results in a face-to-face meeting (nominal group technique) and evaluated each criterion with respect to its feasibility, reliability, redundancy, and validity. Redundant measures were consolidated or excluded. Criteria were parsed into 11 domains for the Delphi surveys. Eighty four respondents participated in the Delphi-1 survey, providing 220 unique items. Ninety- two members (100% of the respondents from Delphi 1 plus eight new participants) responded in Delphi-2 and rated the same 220 items. Sixty-four members (76% of participants) rated 153 criteria in Delphi-3 (67 criteria were excluded due to redundancy). Criteria with a mean greater than 6 (1 least appropriate to 9 most appropriate) were further evaluated by the nominal group technique and provisional core measures were chosen. Using a Delphi exercise, we developed provisional core measures for assessing disease activity and severity in clinical trials of therapies for TED. These measures will be iteratively refined for use in multicenter clinical trials. PMID:19752424

The use of advanced web-based survey design in Delphi research.

PubMed

Helms, Christopher; Gardner, Anne; McInnes, Elizabeth

2017-12-01

A discussion of the application of metadata, paradata and embedded data in web-based survey research, using two completed Delphi surveys as examples. Metadata, paradata and embedded data use in web-based Delphi surveys has not been described in the literature. The rapid evolution and widespread use of online survey methods imply that paper-based Delphi methods will likely become obsolete. Commercially available web-based survey tools offer a convenient and affordable means of conducting Delphi research. Researchers and ethics committees may be unaware of the benefits and risks of using metadata in web-based surveys. Discussion paper. Two web-based, three-round Delphi surveys were conducted sequentially between August 2014 - January 2015 and April - May 2016. Their aims were to validate the Australian nurse practitioner metaspecialties and their respective clinical practice standards. Our discussion paper is supported by researcher experience and data obtained from conducting both web-based Delphi surveys. Researchers and ethics committees should consider the benefits and risks of metadata use in web-based survey methods. Web-based Delphi research using paradata and embedded data may introduce efficiencies that improve individual participant survey experiences and reduce attrition across iterations. Use of embedded data allows the efficient conduct of multiple simultaneous Delphi surveys across a shorter timeframe than traditional survey methods. The use of metadata, paradata and embedded data appears to improve response rates, identify bias and give possible explanation for apparent outlier responses, providing an efficient method of conducting web-based Delphi surveys. © 2017 John Wiley & Sons Ltd.

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature.

PubMed

Moreira, Danilo Gomes; Costello, Joseph T; Brito, Ciro J; Adamczyk, Jakub G; Ammer, Kurt; Bach, Aaron J E; Costa, Carlos M A; Eglin, Clare; Fernandes, Alex A; Fernández-Cuevas, Ismael; Ferreira, José J A; Formenti, Damiano; Fournet, Damien; Havenith, George; Howell, Kevin; Jung, Anna; Kenny, Glen P; Kolosovas-Machuca, Eleazar S; Maley, Matthew J; Merla, Arcangelo; Pascoe, David D; Priego Quesada, Jose I; Schwartz, Robert G; Seixas, Adérito R D; Selfe, James; Vainer, Boris G; Sillero-Quintana, Manuel

2017-10-01

The importance of using infrared thermography (IRT) to assess skin temperature (t sk ) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n = 24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants' demographic information, camera/room or environment setup and recording/analysis of t sk using IRT. The results of the Delphi produced the checklist entitled "Thermographic Imaging in Sports and Exercise Medicine (TISEM)" which is a proposal to standardize the collection and analysis of t sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique. Copyright © 2017 Elsevier Ltd. All rights reserved.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

PubMed

Bank, Ilana; Cheng, Adam; McLeod, Peter; Bhanji, Farhan

2015-11-01

By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees' knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as "key curriculum topics." We have iteratively identified a consensus for the content of a national simulation-based curriculum.

Towards an International Classification for Patient Safety: a Delphi survey.

PubMed

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-02-01

Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. International web-based survey of expert opinion. Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach.

PubMed

Skela-Savič, Brigita; Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-06-01

There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and 'change making' should become an intrinsic part of everyone's job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: 'Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.' The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science.

Towards an International Classification for Patient Safety: a Delphi survey

PubMed Central

Thomson, Richard; Lewalle, Pierre; Sherman, Heather; Hibbert, Peter; Runciman, William; Castro, Gerard

2009-01-01

Objective Interpretation and comparison of patient safety information have been compromised by the lack of a common understanding of the concepts involved. The World Alliance set out to develop an International Classification for Patient Safety (ICPS) to address this, and to test the relevance and acceptability of the draft ICPS and progressively refine it prior to field testing. Design Two-stage Delphi survey. Quantitative and qualitative analyses informed the review of the ICPS. Setting International web-based survey of expert opinion. Participants Experts in the fields of patient safety, health policy, reporting systems, safety and quality control, classification theory and development, health informatics, consumer advocacy, law and medicine; 253 responded to the first round survey, 30% of whom responded to the second round. Results In the first round, 14% felt that the conceptual framework was missing at least one class, although it was apparent that most respondents were actually referring to concepts they felt should be included within the classes rather than the classes themselves. There was a need for clarification of several components of the classification, particularly its purpose, structure and depth. After revision and feedback, round 2 results were more positive, but further significant changes were made to the conceptual framework and to the major classes in response to concerns about terminology and relationships between classes. Conclusions The Delphi approach proved invaluable, as both a consensus-building exercise and consultation process, in engaging stakeholders to support completion of the final draft version of the ICPS. Further refinement will occur. PMID:19147596

Role of local government in responding to environmental health challenges: a case study of Chungnam.

PubMed

Myung, Hyung-Nam; Lee, Hoo-Young

2017-01-01

The purpose of this study is to introduce the establishment process, policy target, and projects for "Chungnam's master plan on environmental health policy (2017-2020)" as the local government's role in addressing local environmental health challenges. We first analyzed existing studies and social issues on the media related to "Chungnam's master plan" to understand Chungnam's environmental health status and discussed domestic and international policy trends and related plans. An environmental health perception questionnaire survey and a Delphi expert questionnaire survey were conducted among provincial residents to collect various actors' opinions on Chungnam's environmental health issues and policy. An expert advisory panel was launched, and a residents' voice workshop and cities-and-guns-policy-suggestion workshop were held. The vision of Chungnam's environmental health policy is minimizing environmental hazards. We finally selected "Pleasant environment, healthy people, happy Chungnam" to represent the will to shape a pleasant environment and prevent and manage health damages for a happy Chungnam. We selected five strategies based on status analysis and a review of domestic and international policy trends and related plans and identified 2 targets (policy objectives) to accomplish the strategies. The strategies to achieve the first target, "Leader in environmental health policy: Chungnam," include 'Empowering active provincial capabilities,' 'Setting up province-specific systems for environmental health surveys and research,' and 'Preventing and managing newly emerging pollutants.' The strategies for the second target, "Everyone is healthy: Chungnam," include 'Relieving health inequalities among vulnerable regions and residents' and 'Enlarging the resident-friendly environmental health policy.' We developed 29 projects in total, according to these strategies. The establishment of "Chungnam's master plan" is highly valuable; we developed it through discussion involving diverse actors to address environmental health challenges together. It is necessary to continue to strengthen participation, communication, and cooperation among actors to develop an environmental health policy model for the future.

Competencies Needed by Korean HRD Master's Graduates: A Comparison between the ASTD WLP Competency Model and the Korean Study

ERIC Educational Resources Information Center

Lee, Yonghak

2009-01-01

The primary purpose of this study was to identify competencies needed by current human resource development (HRD) master's degree graduate students in Korea. The study used a quantitative method, the Delphi technique, in combination with a qualitative method consisting of a series of in-depth interviews. The Delphi technique was conducted using a…

Recommended Skill Requirements of Recent Management Information Systems Graduates for Employment: A Modified Delphi Study

ERIC Educational Resources Information Center

Strnad, Michael A., Sr.

2013-01-01

The purpose of this Modified Delphi study was to achieve a consensus and forecast a prediction from expert IT hiring managers on what skills are required of MIS graduates for employment. In doing so, guidance could be provided to academic leaders who design curricula for MIS students on the required skills for employment. This study was conducted…

Seeking an oracle: using the Delphi process to develop practice guidelines for the treatment of endometriosis with Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George T; Little, Paul

2007-11-01

For most complementary and alternative medicine interventions, the absence of a high-quality evidence base to define good practice presents a serious problem for clinicians, educators, and researchers. The Delphi process may offer a pragmatic way to establish good practice guidelines until more rigorous forms of assessment can be undertaken. To use a modified Delphi to develop good practice guidelines for a feasibility study exploring the role of Chinese herbal medicine (CHM) in the treatment of endometriosis. To compare the outcomes from Delphi with data derived from a systematic review of the Chinese language database. An expert group was convened for a three-round Delphi that initially produced key statements relating to the CHM diagnosis and treatment of endometriosis (round 1) and then anonymously rated these on a 1-7 Likert scale (rounds 2 and 3). Statements with a median score of 5 and above were regarded as demonstrating positive group consensus. The differential diagnoses within Chinese Medicine and rating of the clinical value of individual herbs were then contrasted with comparable data from a review of Chinese language reports in the Chinese Biomedical Retrieval System (1978-2002), and China Academy of Traditional Chinese Medicine (1985-2002) databases and the Chinese TCM and magazine literature (1984-2004) databases. Consensus (good practice) guidelines for the CHM treatment of endometriosis relating to common diagnostic patterns, herb selection, dosage, and patient management were produced. The Delphi guidelines demonstrated a high degree of congruence with the information from the Chinese language databases. In the absence of rigorous evidence, Delphi offers a way to synthesize expert knowledge relating to diagnosis, patient management, and herbal selection in the treatment of endometriosis. The limitations of the expert group and the inability of Delphi to capture the subtle nuances of individualized clinical decision-making limit the usefulness of this approach.

Cross-cultural adaptation of the delphi definitions of low back pain prevalence (German DOLBaPP).

PubMed

Leonhardt, Marja; Liebers, Falk; Dionne, Clermont E; Latza, Ute

2014-11-25

Assessed dimensions of low back pain (LBP) vary in prevalence studies. This may explain the heterogeneity in frequency estimates. To standardize definitions of LBP, an English consensus with 28 experts from 12 countries developed the "Delphi Definitions of Low Back Pain Prevalence" (DOLBaPP). The optimal definition and the shorter minimal definition with the related questionnaires for online, paper, and face-to-face use and telephone surveys are suitable for population-based studies. The definitions have to be adapted to different languages and cultures to provide comparable frequency estimates. The objective was to culturally adapt and pre-test the English definitions and corresponding Delphi DOLBaPP questionnaire forms into German. The German DOLBaPP adaptation was conducted using the systematic approach suggested by Beaton et al. A pre-test of the Delphi DOLBaPP optimal paper questionnaire including an additional evaluation form was conducted in a sample of 121 employees (mainly office workers). In order to evaluate the comprehensibility, usability, applicability, and completeness of the adapted questionnaire, response to the questionnaire and 6 closed evaluation questions were analyzed descriptively. Qualitative methods were used for the 3 open questions of the evaluation form. The cultural adaptation of the DOLBaPP for a German-speaking audience required little linguistic adaptation. Conceptual equivalence was difficult for the expression "low back pain". The expert committee considered the face validity of the pre-final version of the related Delphi DOLBaPP questionnaires as good. In the pre-test, most participants (95%) needed less than 5 minutes to fill in the optimal Delphi DOLBaPP questionnaire. They were generally positive regarding length, wording, diagram, and composition. All subjects with LBP (n=61 out of 121 - 50.4%) answered the questions on functional limitation, sciatic pain, frequency and duration of symptoms as well as pain severity. The results indicate that the cross-cultural German adaptation of the DOLBaPP Definitions and the corresponding questionnaires was successful. The definitions can be used in epidemiological studies to measure the prevalence of LBP. Some critical issues were raised regarding the general features of the Delphi DOLBaPP questionnaires. Future research is needed to evaluate these instruments.

Identifying Dispositions That Matter: Reaching for Consensus Using a Delphi Study

ERIC Educational Resources Information Center

Bair, Mary Antony

2017-01-01

This article describes how one institution used the Delphi technique to identify and operationalize key professional dispositions to be addressed in its teacher education program. Participants included teacher educators, methods course instructors, and school administrators. Data collection occurred in three phases, with the results of each phase…

Using Delphi Methodology to Design Assessments of Teachers' Pedagogical Content Knowledge

ERIC Educational Resources Information Center

Manizade, Agida Gabil; Mason, Marguerite M.

2011-01-01

Descriptions of methodologies that can be used to create items for assessing teachers' "professionally situated" knowledge are lacking in mathematics education research literature. In this study, researchers described and used the Delphi method to design an instrument to measure teachers' pedagogical content knowledge. The instrument focused on a…

Competencies for Leaders of Volunteers During the Next Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

Using the Delphi technique, a nationwide panel of experts identified 33 competencies that volunteer administrators (VAs) will need during the next decade and categorized them into these five constructs: organizational leadership; systems leadership; organizational culture; personal skills; and management skills. Twelve barriers to acquiring the…

Single-Parent Nontraditional Students: Faculty Support within the Classroom Environment

ERIC Educational Resources Information Center

Allen-Drewry, Lisa M.

2017-01-01

Purpose: The purpose of this Delphi study was to explore single-parent nontraditional student experiences within nontraditional university classroom environments and to determine methods for providing better support within the classroom setting. Methodology: The Delphi technique was conducted through 3 survey rounds to explore ways professors and…

Identifying Competencies for Volunteer Administrators for the Coming Decade: A National Delphi Study.

ERIC Educational Resources Information Center

Boyd, Barry L.

2003-01-01

A Delphi panel of 13 experts categorized 33 competencies for volunteer administration into 5 constructs: organizational leadership, systems leadership, organizational culture, personal skills, and management skills. Twelve barriers to acquiring competencies and 21 methods to address them were identified. (Contains 24 references.) (SK)

A Delphi Study and Initial Validation of Counselor Supervision Competencies

ERIC Educational Resources Information Center

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

A Study to Identify the Training Needs of Life Insurance Sales Representatives in Taiwan Using the Delphi Approach

ERIC Educational Resources Information Center

Fan, Chiang Ku; Cheng, Chen-Liang

2006-01-01

This article reports a study conducted to identify the needs for continuing professional development for life insurance sales representatives and to examine the competencies needed by those sales representatives. A modified Delphi technique was used. Most life insurance companies in the USA implement an education and training plan advocated by the…

An Analysis of Factors that Inhibit Business Use of User-Centered Design Principles: A Delphi Study

ERIC Educational Resources Information Center

Hilton, Tod M.

2010-01-01

The use of user-centered design (UCD) principles has a positive impact on the use of web-based interactive systems in customer-centric organizations. User-centered design methodologies are not widely adopted in organizations due to intraorganizational factors. A qualitative study using a modified Delphi technique was used to identify the factors…

Phase 2 of CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study of Problems with Language Development--Terminology

ERIC Educational Resources Information Center

Bishop, Dorothy V. M.; Snowling, Margaret J.; Thompson, Paul A.; Greenhalgh, Trisha

2017-01-01

Background: Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider…

"Normal" and "Inappropriate" Childhood Sexual Behaviours: Findings from a Delphi Study of Professionals in the United Kingdom

ERIC Educational Resources Information Center

Vosmer, Susanne; Hackett, Simon; Callanan, Margie

2009-01-01

This paper presents the results of a three-stage Delphi study examining the current level of consensus among 24 professionals in the United Kingdom regarding definitions of and distinctions between normal, inappropriate and sexually abusive behaviours in children under 10 years, as well as factors influencing their views. Although firm conclusions…

Alcohol Policies and Alcohol-Related Motor Vehicle Crash Fatalities Among Young People in the US.

PubMed

Hadland, Scott E; Xuan, Ziming; Sarda, Vishnudas; Blanchette, Jason; Swahn, Monica H; Heeren, Timothy C; Voas, Robert B; Naimi, Timothy S

2017-03-01

Motor vehicle crashes (MVCs) are a leading cause of death among young people in the United States. We examined the relationship between states' alcohol policy environments and alcohol-related MVC fatalities among children, adolescents, and young adults under the minimum legal drinking age of 21 years. We used the Alcohol Policy Scale (APS), an assessment of 29 alcohol policies across 50 states and Washington, DC, developed with the assistance of an interdisciplinary Delphi panel. Using the Fatality Analysis Reporting System, we examined APS scores in relation to fatalities of people ≤20 years old from 2000 to 2013 occurring in crashes in which ≥1 involved driver had a blood alcohol content ≥0.08%. Logistic regression was used with a 1-year lag between policies and MVC fatalities and adjusted for potential confounders. Of 84 756 MVC fatalities of those ≤20 years old during the study period, 23 757 (28.0%) were alcohol related, including deaths of 11 006 (46.3%) drivers, 10 212 (43.0%) passengers, and 2539 (10.7%) pedestrians, cyclists, and others. People killed in alcohol-related MVCs were predominantly male (72.7%) and older (65.5% were 18-20 years old), and 51.2% were non-Hispanic white. Restrictive policy environments were associated with fewer fatalities (adjusted odds ratio, 0.91 per 10-percentage-point increase in APS score; 95% confidence interval, 0.89-0.94). The association was observed for drivers and passengers, male and female decendents, and children, adolescents, and young adults. More restrictive alcohol policies are associated with reduced alcohol-related MVC mortality among young people. Studies should scrutinize the relationship between policies and fatalities to highlight mechanisms. Copyright © 2017 by the American Academy of Pediatrics.

Emerging Technologies Program Integration Report. Volume 2. Background, Delphi and Workshop Data. Appendices

DTIC Science & Technology

1987-05-04

FTIILE COP’ AD-A196 840 EMERGING TECHNOLOGIES PROGRAM INTEGRATION REPORT VOLUME II BACKGROUND, DELPHI AND WORKSHOP DATA, APPENDICES . -- PREPARED...Security Classification) Emerging Technologies Program Integration Report Volume II: Background, Delphi and Workshop Data; Appendices (U) 12 PERSONAL...volumes of this integration report assess and synthesize information gathered through a Delphi survey, defense needs prioritization workshops, and

DelPhi Web Server: A comprehensive online suite for electrostatic calculations of biological macromolecules and their complexes

PubMed Central

Sarkar, Subhra; Witham, Shawn; Zhang, Jie; Zhenirovskyy, Maxim; Rocchia, Walter; Alexov, Emil

2011-01-01

Here we report a web server, the DelPhi web server, which utilizes DelPhi program to calculate electrostatic energies and the corresponding electrostatic potential and ionic distributions, and dielectric map. The server provides extra services to fix structural defects, as missing atoms in the structural file and allows for generation of missing hydrogen atoms. The hydrogen placement and the corresponding DelPhi calculations can be done with user selected force field parameters being either Charmm22, Amber98 or OPLS. Upon completion of the calculations, the user is given option to download fixed and protonated structural file, together with the parameter and Delphi output files for further analysis. Utilizing Jmol viewer, the user can see the corresponding structural file, to manipulate it and to change the presentation. In addition, if the potential map is requested to be calculated, the potential can be mapped onto the molecule surface. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver. PMID:24683424

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers.

PubMed

Reavley, Nicola J; Ross, Anna M; Killackey, Eoin; Jorm, Anthony F

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students' academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions.

Development of guidelines for tertiary education institutions to assist them in supporting students with a mental illness: a Delphi consensus study with Australian professionals and consumers

PubMed Central

Ross, Anna M.; Killackey, Eoin; Jorm, Anthony F.

2013-01-01

Background. The age at which most young people are in tertiary education is also the age of peak onset for mental illness. Because mental health problems can have adverse effects on students’ academic performance and welfare, institutions require guidance how they can best provide support. However, the scientific evidence for how best to do this is relatively limited. Therefore a Delphi expert consensus study was carried out with professional and consumer experts. Methods. A systematic review of websites, books and journal articles was conducted to develop a 172 item survey containing strategies that institutions might use to support students with a mental illness. Two panels of Australian experts (74 professionals and 35 consumers) were recruited and independently rated the items over three rounds, with strategies reaching consensus on importance written into the guidelines. Results. The overall response rate across three rounds was 83% (80% consumers, 85% professionals). 155 strategies were endorsed as essential or important by at least 80% of panel members. The endorsed strategies provided information on policy, measures to promote support services, service provision, accessibility of support services, relationships between services, other types of support and issues associated with reasonable adjustments. They also provided guidance on the procedures the institutions should have for making staff aware of issues associated with mental illness, mental illness training, support for staff and communicating with a student with a mental illness. They also covered student rights and responsibilities, the procedures the institutions should have for making students aware of issues associated with mental illness, dealing with mental health crises, funding and research and evaluation. Conclusions. The guidelines provide guidance for tertiary institutions to assist them in supporting students with a mental illness. It is hoped that they may be used to inform policy and practice in tertiary institutions. PMID:23638380

[Application of Delphi method in traditional Chinese medicine clinical research].

PubMed

Bi, Ying-fei; Mao, Jing-yuan

2012-03-01

In recent years, Delphi method has been widely applied in traditional Chinese medicine (TCM) clinical research. This article analyzed the present application situation of Delphi method in TCM clinical research, and discussed some problems presented in the choice of evaluation method, classification of observation indexes and selection of survey items. On the basis of present application of Delphi method, the author analyzed the method on questionnaire making, selection of experts, evaluation of observation indexes and selection of survey items. Furthermore, the author summarized the steps of application of Delphi method in TCM clinical research.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

ERIC Educational Resources Information Center

Sakhnini, Sohair; Blonder, Ron

2015-01-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: "What are the essential concepts of NST that should be taught in high school"? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science…

An international delphi survey for the definition of the variables for the development of new classification criteria for periodic fever aphtous stomatitis pharingitis cervical adenitis (PFAPA).

PubMed

Vanoni, Federica; Federici, Silvia; Antón, Jordi; Barron, Karyl S; Brogan, Paul; De Benedetti, Fabrizio; Dedeoglu, Fatma; Demirkaya, Erkan; Hentgen, Veronique; Kallinich, Tilmann; Laxer, Ronald; Russo, Ricardo; Toplak, Natasa; Uziel, Yosef; Martini, Alberto; Ruperto, Nicolino; Gattorno, Marco; Hofer, Michael

2018-04-18

Diagnosis of Periodic fever, aphthous stomatitis, pharyngitis and cervical adenitis (PFAPA) is currently based on a set of criteria proposed in 1999 modified from Marshall's criteria. Nevertheless no validated evidence based set of classification criteria for PFAPA has been established so far. The aim of this study was to identify candidate classification criteria PFAPA syndrome using international consensus formation through a Delphi questionnaire survey. A first open-ended questionnaire was sent to adult and pediatric clinicians/researchers, asking to identify the variables thought most likely to be helpful and relevant for the diagnosis of PFAPA. In a second survey, respondents were asked to select, from the list of variables coming from the first survey, the 10 features that they felt were most important, and to rank them in descending order from most important to least important. The response rate to the first and second Delphi was respectively 109/124 (88%) and 141/162 (87%). The number of participants that completed the first and second Delphi was 69/124 (56%) and 110/162 (68%). From the first Delphi we obtained a list of 92 variables, of which 62 were selected in the second Delphi. Variables reaching the top five position of the rank were regular periodicity, aphthous stomatitis, response to corticosteroids, cervical adenitis, and well-being between flares. Our process led to identification of features that were felt to be the most important as candidate classification criteria for PFAPA by a large sample of international rheumatologists. The performance of these items will be tested further in the next phase of the study, through analysis of real patient data.

BCQ+: a body constitution questionnaire to assess Yang-Xu. Part I: establishment of a first final version through a Delphi process.

PubMed

Su, Yi-Chang; Chen, Li-Li; Lin, Jun-Dai; Lin, Jui-Shan; Huang, Yi-Chia; Lai, Jim-Shoung

2008-12-01

Assessing an individual's level of Yang deficiency (Yang-Xu) by its manifestations is a frequent issue in traditional Chinese medicine (TCM) clinical trials. To this end, an objective, reliable and rigorous diagnostic tool is required. This study aimed to develop a first final version of the Yang-Xu Constitution Questionnaire. We conducted 3 steps to develop such an objective measurement tool: 1) the research team was formed and a panel of 26 experts was selected for the Delphi process; 2) items for the questionnaire were generated by literature review and a Delphi process; items were reworded into colloquial questions; face and content validity of the items were evaluated through a Delphi process again; 3) the difficulty of the questionnaire was evaluated in a pilot study with 81 subjects aged 20-60 years. The literature review retrieved 35 relevant items which matched the definition of 'constitution' and 'Yang-Xu'. After a first Delphi process, 22 items were retained and translated into colloquial questions. According to the second part of the Delphi process, the content validity index of each of the 22 questions ranged between 0.85-1. These 22 questions were evaluated by 81 subjects, 2 questions that were hard to tell the difference were combined; 3 questions were modified after the research team had discussed the participants' feedback. Finally, the questionnaire was established with 21 questions. This first final version of a questionnaire to assess Yang-Xu constitution with considerable face and content validity may serve as a basis to develop an advanced Yang-Xu questionnaire. 2008 S. Karger AG, Basel.

Consulting the oracle: ten lessons from using the Delphi technique in nursing research.

PubMed

Keeney, Sinead; Hasson, Felicity; McKenna, Hugh

2006-01-01

The aim of this paper was to provide insight into the Delphi technique by outlining our personal experiences during its use over a 10-year period in a variety of applications. As a means of achieving consensus on an issue, the Delphi research method has become widely used in healthcare research generally and nursing research in particular. The literature on this technique is expanding, mainly addressing what it is and how it should be used. However, there is still much confusion and uncertainty surrounding it, particularly about issues such as modifications, consensus, anonymity, definition of experts, how 'experts' are selected and how non-respondents are pursued. This issues that arise when planning and carrying out a Delphi study include the definition of consensus; the issue of anonymity vs. quasi-anonymity for participants; how to estimate the time needed to collect the data, analyse each 'round', feed back results to participants, and gain their responses to this feedback; how to define and select the 'experts' who will be asked to participate; how to enhance response rates; and how many 'rounds' to conduct. Many challenges and questions are raised when using the Delphi technique, but there is no doubt that it is an important method for achieving consensus on issues where none previously existed. Researchers need to adapt the method to suit their particular study.

Reconsidering Planning and Management of Medical Devices Procurement in Public Health Services in Cyprus.

PubMed

Theodorou, Mamas; Georgiou, Marina; Nikolentzos, Athanasios; Bellali, Thalia

2015-04-19

Hospital procurement is a crucial field for any health care system, not only for economic reasons but also for reasons related to the quality and safety of the services provided. That is why the process of procurement is, in most countries, governed by a strict legal framework and policy mechanisms. This study investigates the problems and inefficiencies associated with the procurement of medical devices in public hospitals in Cyprus and formulates empirically documented proposals for improvement. Using the Delphi method, a group of 38 experts approach the procurement system in Cyprus from different angles, achieving high rates of consensus on 35 different statements on the weaknesses and problems of the current medical device procurement system, as well as presenting proposals and recommendations for improvement. The findings are highly valuable for future policy initiatives in Cyprus in the light of the economic crisis and the expected implementation of the new General Health Insurance System (GeSY), which the Government of the Republic of Cyprus and the Troika has agreed.

Reflections of Tomorrow: Lifelong Learning and the Public Library (A Delphi Study). Excerpts.

ERIC Educational Resources Information Center

Weingand, Darlene E.

This study focuses on the question of whether the public library can or will be one of the non-formal providers of lifelong learning in Minnesota, and uses the Delphi method to discover in what way the public library as it is perceived by various publics could become an active participant in this dimension of the educational process. Five groups…

What Are We Aiming For?--A Delphi Study on the Development of Civic Scientific Literacy in Sweden

ERIC Educational Resources Information Center

Chang Rundgren, Shu-Nu; Rundgren, Carl-Johan

2017-01-01

Based on the EU FP 7 project, PROFILES, this article presents our findings from a three-round Delphi study conducted in Sweden that aimed at establishing a consensus on how science education should be developed for citizens to enhance civic scientific literacy. A total of 100 stakeholders (9th graders, school teachers, scientists, and science…

Workplace Issues in Extension--A Delphi Study of Extension Educators

ERIC Educational Resources Information Center

Kroth, Michael; Peutz, Joey

2011-01-01

Using the Delphi technique, expert Extension educators identified and prioritized those workplace issues they believe will be the most important to attract, motivate, and retain Extension educators/agents over the next 5 to 7 years. Obtaining and then utilizing a talented, highly motivated workforce during a period when many will be retiring will…

Identifying the Professional Development Needs of Adjunct Faculty Using an Online Delphi

ERIC Educational Resources Information Center

Cuddie, Stephani B.

2016-01-01

The purpose of this online Delphi was to explore the professional development needs and preferences of adjunct faculty, specifically those who teach online. The study involved adjunct faculty who were categorized by their self-selected type of adjunct faculty member: specialist, aspiring academic, professional/freelancer, and career-ender. Through…

Incorporating Nonparametric Statistics into Delphi Studies in Library and Information Science

ERIC Educational Resources Information Center

Ju, Boryung; Jin, Tao

2013-01-01

Introduction: The Delphi technique is widely used in library and information science research. However, many researchers in the field fail to employ standard statistical tests when using this technique. This makes the technique vulnerable to criticisms of its reliability and validity. The general goal of this article is to explore how…

Determining e-Portfolio Elements in Learning Process Using Fuzzy Delphi Analysis

ERIC Educational Resources Information Center

Mohamad, Syamsul Nor Azlan; Embi, Mohamad Amin; Nordin, Norazah

2015-01-01

The present article introduces the Fuzzy Delphi method results obtained in the study on determining e-Portfolio elements in learning process for art and design context. This method bases on qualified experts that assure the validity of the collected information. In particular, the confirmation of elements is based on experts' opinion and…

Expert Consensus on Characteristics of Wisdom: A Delphi Method Study

ERIC Educational Resources Information Center

Jeste, Dilip V.; Ardelt, Monika; Blazer, Dan; Kraemer, Helena C.; Vaillant, George; Meeks, Thomas W.

2010-01-01

Purpose: Wisdom has received increasing attention in empirical research in recent years, especially in gerontology and psychology, but consistent definitions of wisdom remain elusive. We sought to better characterize this concept via an expert consensus panel using a 2-phase Delphi method. Design and Methods: A survey questionnaire comprised 53…

Quality Characteristics of a Graduate Teacher Education Program in Graphic Communications: Results from a Delphi Research Study.

ERIC Educational Resources Information Center

Clark, Aaron C.; Scales, Alice Y.

2000-01-01

Investigates characteristics of a quality program in graphic communications teacher education with involvement of professionals in the field. Uses the Delphi technique to achieve consensus on the characteristics that they felt compromised a good educational program for future graphics teachers. (Contains 27 references.) (Author/YDS)

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study

PubMed Central

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-01

Objectives To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Setting Hospitals and community health centres in Taiwan. Method A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. Participants 15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Results Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. Conclusions The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. PMID:28093428

Research on evaluation of third-party governance operation services for environmental pollution

NASA Astrophysics Data System (ADS)

Xu, Bingsheng; Ling, Lin; Jin, Huang

2017-11-01

This paper focuses on the evaluation of third-party governance operation services for environmental pollution, and determines the evaluation indicator system composed of 5 primary indicators as the basic competence of enterprise, operation of equipment, technique economics, environmental benefit and management level, and 26 secondary indicators via policies and regulations, standards, literature research and expert consultation in combination with the composition elements, service value judgment factors and full-life cycle of the work, providing theoretical support for the effect evaluation of third-governance over the environmental pollution in China. Then, the hierarchical analytic matrix is formed by analyzing the environmental pollution governance evaluation indicator system via analytic hierarchy process and scoring the importance of various indicators by experts by applying the Delphi method. The feature vector of the matrix is then calculated to obtain the weight of each indicator and verify the effectiveness of the Delphi method and obtain the comprehensive weight by judging the consistency of the matrix, so as to finally determine the overall ordering level of the importance of secondary indicators.

Development of ethical rules for boundaries of touch in complementary medicine--outcomes of a Delphi process.

PubMed

Schiff, Elad; Ben-Arye, Eran; Shilo, Margalit; Levy, Moti; Schachter, Leora; Weitchner, Na'ama; Golan, Ofra; Stone, Julie

2010-11-01

The practice of complementary medicine (CAM) often involves touch. The unique philosophy of many CAM therapies, and the setting in which treatments are provided create a therapeutic space which may be less clearly defined than in conventional settings - a space in which the boundaries between professional touch and personal/intimate touch may become easily obscured. Thus, complementary therapists need clear definitions and firm boundaries in order to maintain therapeutic efficacy and commitment. The aim of the process described in this article, was to develop ethical guidelines for boundaries of touch that will promote the safety and protection of the public which use CAM. Through a modified Delphi process, a diverse group of CAM practitioners, physicians, ethicists, legal consultants, health policy specialists, and representatives from the public, developed Ethical Rules for Boundaries of Touch in CAM. These guidelines may be implemented in ethical codes of professional CAM organizations, and also serve as a foundation for curriculums in ethics in CAM schools. Copyright © 2010 Elsevier Ltd. All rights reserved.

How to use the nominal group and Delphi techniques.

PubMed

McMillan, Sara S; King, Michelle; Tully, Mary P

2016-06-01

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how 'consensus' is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of 'experts.' Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.

Identification of retention strategies for neurosurgeons in Iran: Results from expert panels.

PubMed

Rafiei, Sima; Abdollahzadeh, Sina; Hashemi, Fariba; Ranjbar, Mohammad

2017-04-04

Background: The key challenge is how to encourage and retain health professionals in their work location. There is a list of policy options for this purpose but applying an appropriate and effective set of strategies requires a country level research. Our study aimed to identify retention strategies for neurosurgeons and examine both the importance and feasibility of the identified strategies using expert panels' point of view. Methods: First of all, a literature review was conducted to identify retention strategies for physicians. Then to gain consensus on the strategies and determine their importance and feasibility an expert panel was organized and a modified Delphi process was used. Results: A total of 40 strategies were identified by the panel classified in seven categories of income and economic factors, professional/job factors, clinical infrastructure, personal/family factors, living condition and welfare, educational factors and career development, governmental regulations and management policies. Conclusion: Based on the study results, three areas of economic incentives, personal and professional factors got the greatest priority in health professional planning for retention purposes.

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

PubMed Central

Barry, Emma; O'Brien, Kirsty; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-01-01

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Design Two-round modified Delphi consensus method. Setting Irish and UK general practice. Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. PMID:27601499

Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique.

PubMed

Shawahna, Ramzi; Haddad, Aseel; Khawaja, Baraa; Raie, Rand; Zaneen, Sireen; Edais, Tasneem

2016-10-01

Background Medication dispensing errors (MDEs) are frequent in community pharmacy practice. A definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice were not previously approached using formal consensus techniques. Objective This study was conducted to achieve consensus on a definition of MDEs and a wide range of scenarios that should or should not be considered as MDEs in Palestinian community pharmacy practice by a panel of community pharmacists. Setting Community pharmacy practice in Palestine. Method This was a descriptive study using the Delphi technique. A panel of fifty community pharmacists was recruited from different geographical locations of the West Bank of Palestine. A three round Delphi technique was followed to achieve consensus on a proposed definition of MDEs and 83 different scenarios representing potential MDEs using a nine-point scale. Main outcome measure Agreement or disagreement of a panel of community pharmacists on a proposed definition of MDEs and a series of scenarios representing potential MDEs. Results In the first Delphi round, views of key contact community pharmacists on MDEs were explored and situations representing potential MDEs were collected. In the second Delphi round, consensus was achieved to accept the proposed definition and to include 49 (59 %) of the 83 proposed scenarios as MDEs. In the third Delphi round, consensus was achieved to include further 13 (15.7 %) scenarios as MDEs, exclude 9 (10.8 %) scenarios and the rest of 12 (14.5 %) scenarios were considered equivocal based on the opinions of the panelists. Conclusion Consensus on a definition of MDEs and scenarios representing MDE situations in Palestinian community pharmacy practice was achieved using a formal consensus technique. The use of consensual definitions and scenarios representing MDE situations in community pharmacy practice might minimize methodological variations and their significant effects on the number and rate of MDEs reported in different studies.

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique.

PubMed

Barry, Emma; O'Brien, Kirsty; Moriarty, Frank; Cooper, Janine; Redmond, Patrick; Hughes, Carmel M; Bennett, Kathleen; Fahey, Tom; Smith, Susan M

2016-09-06

There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings. Two-round modified Delphi consensus method. Irish and UK general practice. A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel. 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2). The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Verification of a quality management theory: using a delphi study.

PubMed

Mosadeghrad, Ali Mohammad

2013-11-01

A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence.

Verification of a Quality Management Theory: Using a Delphi Study

PubMed Central

Mosadeghrad, Ali Mohammad

2013-01-01

Background: A model of quality management called Strategic Collaborative Quality Management (SCQM) model was developed based on the quality management literature review, the findings of a survey on quality management assessment in healthcare organisations, semi-structured interviews with healthcare stakeholders, and a Delphi study on healthcare quality management experts. The purpose of this study was to verify the SCQM model. Methods: The proposed model was further developed using feedback from thirty quality management experts using a Delphi method. Further, a guidebook for its implementation was prepared including a road map and performance measurement. Results: The research led to the development of a context-specific model of quality management for healthcare organisations and a series of guidelines for its implementation. Conclusion: A proper model of quality management should be developed and implemented properly in healthcare organisations to achieve business excellence. PMID:24596883

What are the essential features of resilience for informal caregivers of people living with dementia? A Delphi consensus examination.

PubMed

Joling, Karlijn J; Windle, Gill; Dröes, Rose-Marie; Huisman, Martijn; Hertogh, Cees M P M; Woods, Robert T

2017-05-01

Few studies have examined what might enable or prevent resilience in carers of people with dementia. Consequently, there are limited insights as to how it should be understood, defined and measured. This creates challenges for research, and also practice in terms of how it might best be promoted. This study aimed to address these limitations and add new insights, identifying the essential features of resilience in dementia caregiving. A Delphi consensus study was conducted, consulting a multi-disciplinary panel of informal caregivers and experts with relevant professional expertise. Panellists rated the relevance of various statements addressing essential components of resilience; 'adversity' and 'successful caregiving' on a 5-point Likert scale. Based on the median and Inter Quartile Range, the most relevant statements with moderate consensus were proposed in Round 2 in which panellists selected up to five statements in order of importance. Moderate consensus was reached for all statements after two rounds. Patients' behavioural problems and feeling competent as a caregiver were selected by both caregivers and professionals as essential resilience features. Caregivers also emphasized the importance of social support, the quality of the relationship with their relative and enjoying spending time together. Professionals considered coping skills, experiencing positive aspects of caregiving, and a good quality of life of caregivers most relevant. The essential elements of resilience selected from multiple stakeholder perspectives can be used to select appropriate outcomes for intervention studies and give guidance to policy to support caregivers more effectively and better tailored to their needs.

Developing performance indicators for clinical governance in dimensions of risk management and clinical effectiveness.

PubMed

Azami-Aghdash, Saber; Tabrizi, Jafar Sadegh; Sadeghi-Bazargani, Homayoun; Hajebrahimi, Sakineh; Naghavi-Behzad, Mohammad

2015-04-01

This study has been designed and conducted to develop domestic indicators for evaluating the performance of clinical governance in dimensions of risk management and clinical effectiveness. This study implemented a 5-stage process including conducting a comprehensive literature review, expert panel (∼ 1000 h per person per session, 11 experts), semi-structured interviews, a 2-round Delphi study (33 experts were in attendance) and a final expert panel (8 experts were in attendance). East Azerbaijan-Iran Province. Fifty-six specialists and experts in different fields of medical sciences. Importance and applicability of indicators. Using a thorough literature review, 361 indicators (129 risk management indicators in 4 dimensions and 232 clinical effectiveness indicators in 18 dimensions) were found. After conducting expert panels and interviews, the number of indicators decreased to 168 cases (65 risk management indicators in 4 dimensions and 103 clinical effectiveness indicators in 12 dimensions). Two rounds of Delphi identified four indicators that were omitted. The members of the final expert panel agreed on 113 indicators (43 risk management indicators in 4 dimensions and 70 clinical effectiveness indicators in 11 dimensions). In this study, indicators for assessing clinical governance in domains of risk management and clinical effectiveness were designed that can be used by policy-makers and other authorities for improving the quality of services and evaluating the performance of clinical governance. Those indicators can be used with slight modifications in other countries having healthcare systems similar to that of Iran. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

DelPhi web server v2: incorporating atomic-style geometrical figures into the computational protocol.

PubMed

Smith, Nicholas; Witham, Shawn; Sarkar, Subhra; Zhang, Jie; Li, Lin; Li, Chuan; Alexov, Emil

2012-06-15

A new edition of the DelPhi web server, DelPhi web server v2, is released to include atomic presentation of geometrical figures. These geometrical objects can be used to model nano-size objects together with real biological macromolecules. The position and size of the object can be manipulated by the user in real time until desired results are achieved. The server fixes structural defects, adds hydrogen atoms and calculates electrostatic energies and the corresponding electrostatic potential and ionic distributions. The web server follows a client-server architecture built on PHP and HTML and utilizes DelPhi software. The computation is carried out on supercomputer cluster and results are given back to the user via http protocol, including the ability to visualize the structure and corresponding electrostatic potential via Jmol implementation. The DelPhi web server is available from http://compbio.clemson.edu/delphi_webserver.

The promise of complementarity: Using the methods of foresight for health workforce planning.

PubMed

Rees, Gareth H; Crampton, Peter; Gauld, Robin; MacDonell, Stephen

2018-05-01

Health workforce planning aims to meet a health system's needs with a sustainable and fit-for-purpose workforce, although its efficacy is reduced in conditions of uncertainty. This PhD breakthrough article offers foresight as a means of addressing this uncertainty and models its complementarity in the context of the health workforce planning problem. The article summarises the findings of a two-case multi-phase mixed method study that incorporates actor analysis, scenario development and policy Delphi. This reveals a few dominant actors of considerable influence who are in conflict over a few critical workforce issues. Using these to augment normative scenarios, developed from existing clinically developed model of care visions, a number of exploratory alternative descriptions of future workforce situations are produced for each case. Their analysis reveals that these scenarios are a reasonable facsimile of plausible futures, though some are favoured over others. Policy directions to support these favoured aspects can also be identified. This novel approach offers workforce planners and policy makers some guidance on the use of complimentary data, methods to overcome the limitations of conventional workforce forecasting and a framework for exploring the complexities and ambiguities of a health workforce's evolution.

Defining products for a new health technology assessment agency in Madrid, Spain: a survey of decision makers.

PubMed

Andradas, Elena; Blasco, Juan-Antonio; Valentín, Beatriz; López-Pedraza, María-José; Gracia, Francisco-Javier

2008-01-01

The aim of this study was to explore the needs and requirements of decision makers in our regional healthcare system for health technology assessment (HTA) products to support portfolio development planning for a new HTA agency in Madrid, Spain. A Delphi study was conducted during 2003. Questionnaires were developed based on a review of products and services offered by other agency members of the International Network of Agencies for Health Technology Assessment, and included preference and prioritization questions to evaluate twenty-two different products and services. The initial Delphi panel involved eighty-seven experts from twenty-one public hospitals, eleven primary healthcare centers, six private hospitals, and eight departments of the Regional Ministry of Health of the Community of Madrid. The global participation rate was 83.9 percent. Ten of the twenty-two possible products were rated of high interest by more than 80 percent of respondents. Important differences in preferences and priorities were detected across different settings. Public hospitals and primary healthcare centers shared a more "micro" perspective, preferring classic technology-centered HTA products, whereas private hospitals and Ministry representatives demanded more "macro" products and services such as organizational model and information system assessments. The high participation rate supports the representativeness of the results for our regional context. The strategic development of an HTA portfolio based on decision makers' needs and requirements as identified in this type of exercise should help achieve a better impact on policy development and decision making.

The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: A consensus methods approach

PubMed Central

Macrae, Rhoda; Lillo-Crespo, Manuel; Rooney, Kevin D

2017-01-01

Abstract Introduction There is a limited body of research in the field of healthcare improvement science (HIS). Quality improvement and ‘change making’ should become an intrinsic part of everyone’s job, every day in all parts of the healthcare system. The lack of theoretical grounding may partly explain the minimal transfer of health research into health policy. Methods This article seeks to present the development of the definition for healthcare improvement science. A consensus method approach was adopted with a two-stage Delphi process, expert panel and consensus group techniques. A total of 18 participants were involved in the expert panel and consensus group, and 153 answers were analysed as a part of the Delphi survey. Participants were researchers, educators and healthcare professionals from Scotland, Slovenia, Spain, Italy, England, Poland, and Romania. Results A high level of consensus was achieved for the broad definition in the 2nd Delphi iteration (86%). The final definition was agreed on by the consensus group: ‘Healthcare improvement science is the generation of knowledge to cultivate change and deliver person-centred care that is safe, effective, efficient, equitable and timely. It improves patient outcomes, health system performance and population health.’ Conclusions The process of developing a consensus definition revealed different understandings of healthcare improvement science between the participants. Having a shared consensus definition of healthcare improvement science is an important step forward, bringing about a common understanding in order to advance the professional education and practice of healthcare improvement science. PMID:28289467

Initiation of biological agents in patients with ankylosing spondylitis: results of a Delphi study by the ASAS Group

PubMed Central

Pham, T; van der Heijde, D; Calin, A; Khan, M; van der Linden, S.; Bellamy, N; Dougados, M

2003-01-01

Background: There is ample evidence of important symptomatic efficacy of tumour necrosis factor α (TNFα) inhibition in ankylosing spondylitis (AS). Moreover, studies suggest that anti-TNF could be considered as the first disease controlling antirheumatic treatment (DC-ART) for AS. Objective: To determine precisely which patients with AS are most likely to benefit from anti-TNFα treatment because of the cost and possible long term side effects of such treatment. Methods: Assessment in Ankylosing Spondylitis (ASAS) members were asked to use a Delphi technique to name the characteristics of patients with AS for whom they would start DC-ART, in three different clinical presentations (isolated axial involvement, peripheral arthritis, enthesitis). Results: Among the 62 invited ASAS members, more than 50% actively participated in the four phases of definition according to the Delphi technique. For each of the three clinical presentations, a combination of five to six domains was proposed, with an evaluation instrument and a cut off point defining a minimum level of activity for each domain. Conclusion: This study provides a profile for a patient with AS for considering initiation of biological agents that reflects the opinion of the ASAS members, using a Delphi exercise. Further studies are required to assess their relevance and their consistency with clinical practice. PMID:12922951

Identifying the features of an exercise addiction: A Delphi study

PubMed Central

Macfarlane, Lucy; Owens, Glynn; Cruz, Borja del Pozo

2016-01-01

Objectives There remains limited consensus regarding the definition and conceptual basis of exercise addiction. An understanding of the factors motivating maintenance of addictive exercise behavior is important for appropriately targeting intervention. The aims of this study were twofold: first, to establish consensus on features of an exercise addiction using Delphi methodology and second, to identify whether these features are congruous with a conceptual model of exercise addiction adapted from the Work Craving Model. Methods A three-round Delphi process explored the views of participants regarding the features of an exercise addiction. The participants were selected from sport and exercise relevant domains, including physicians, physiotherapists, coaches, trainers, and athletes. Suggestions meeting consensus were considered with regard to the proposed conceptual model. Results and discussion Sixty-three items reached consensus. There was concordance of opinion that exercising excessively is an addiction, and therefore it was appropriate to consider the suggestions in light of the addiction-based conceptual model. Statements reaching consensus were consistent with all three components of the model: learned (negative perfectionism), behavioral (obsessive–compulsive drive), and hedonic (self-worth compensation and reduction of negative affect and withdrawal). Conclusions Delphi methodology allowed consensus to be reached regarding the features of an exercise addiction, and these features were consistent with our hypothesized conceptual model of exercise addiction. This study is the first to have applied Delphi methodology to the exercise addiction field, and therefore introduces a novel approach to exercise addiction research that can be used as a template to stimulate future examination using this technique. PMID:27554504

Effective self-management strategies for bipolar disorder: A community-engaged Delphi Consensus Consultation study.

PubMed

Michalak, Erin E; Suto, Melinda J; Barnes, Steven J; Hou, Sharon; Lapsley, Sara; Scott, Mike W; Murray, Greg; Austin, Jehannine; Elliott, Nusha Balram; Berk, Lesley; Crest Bd

2016-12-01

Self-management represents an important complement to psychosocial treatments for bipolar disorder (BD), but research is limited. Specifically, little is known about self-management approaches for elevated mood states; this study investigated self-management strategies for: (1) maintaining balance in mood, and (2) stopping progression into hypomania/mania. To identify the common components of BD self-management, Delphi Consensus Consultation methods were combined with a Community-Based Participatory Research (CBPR) approach across five study phases: (1) Qualitative dataset content analysis; (2) Academic/grey literature reviews; (3) Content analysis; (4) Two Delphi rounds (rating strategies on a 5-point Likert scale, Very Unhelpful-Very Helpful), and; (5) Quantitative analysis and interpretation. Participants were people with BD and healthcare providers. Phases 1 and 2 identified 262 and 3940 candidate strategies, respectively; 3709 were discarded as duplicates/unintelligible. The remaining 493 were assessed via Delphi methods in Phase 4: 101 people with BD and 52 healthcare providers participated in Round 1; 83 of the BD panel (82%) and 43 of the healthcare provider panel (83%) participated in Round 2-exploratory factor analysis (EFA) was conducted on Round 2 results. EFA was underpowered and sample was not ethnically diverse, limiting generalizability. High concordance was observed in ratings of strategy effectiveness between the two panels. Future research could usefully investigate the provisional discovery here of underlying factors which link individual strategies. For example, 'maintaining hope' underpinned strategies for maintaining balance, and 'decreasing use of stimulants' underpinned strategies to interrupt hypo/manic ascent. There is merit in combining CBPR and Delphi methods. Copyright © 2016 Elsevier B.V. All rights reserved.

COS-STAR: a reporting guideline for studies developing core outcome sets (protocol).

PubMed

Kirkham, Jamie J; Gorst, Sarah; Altman, Douglas G; Blazeby, Jane; Clarke, Mike; Devane, Declan; Gargon, Elizabeth; Williamson, Paula R

2015-08-22

Core outcome sets can increase the efficiency and value of research and, as a result, there are an increasing number of studies looking to develop core outcome sets (COS). However, the credibility of a COS depends on both the use of sound methodology in its development and clear and transparent reporting of the processes adopted. To date there is no reporting guideline for reporting COS studies. The aim of this programme of research is to develop a reporting guideline for studies developing COS and to highlight some of the important methodological considerations in the process. The study will include a reporting guideline item generation stage which will then be used in a Delphi study. The Delphi study is anticipated to include two rounds. The first round will ask stakeholders to score the items listed and to add any new items they think are relevant. In the second round of the process, participants will be shown the distribution of scores for all stakeholder groups separately and asked to re-score. A final consensus meeting will be held with an expert panel and stakeholder representatives to review the guideline item list. Following the consensus meeting, a reporting guideline will be drafted and review and testing will be undertaken until the guideline is finalised. The final outcome will be the COS-STAR (Core Outcome Set-STAndards for Reporting) guideline for studies developing COS and a supporting explanatory document. To assess the credibility and usefulness of a COS, readers of a COS development report need complete, clear and transparent information on its methodology and proposed core set of outcomes. The COS-STAR guideline will potentially benefit all stakeholders in COS development: COS developers, COS users, e.g. trialists and systematic reviewers, journal editors, policy-makers and patient groups.

An Empirical Investigation of Entrepreneurship Intensity in Iranian State Universities

ERIC Educational Resources Information Center

Mazdeh, Mohammad Mahdavi; Razavi, Seyed-Mostafa; Hesamamiri, Roozbeh; Zahedi, Mohammad-Reza; Elahi, Behin

2013-01-01

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted…

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

ERIC Educational Resources Information Center

Johnston, Lynette M.; Wiedmann, Martin; Orta-Ramirez, Alicia; Oliver, Haley F.; Nightingale, Kendra K.; Moore, Christina M.; Stevenson, Clinton D.; Jaykus, Lee-Ann

2014-01-01

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well-qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty-nine…

Remediation System Evaluation, Delphi Corporation Site in Vandalia, Ohio

EPA Pesticide Factsheets

This RSE pertains to aspects of the corrective action underway at two neighboring plants, the Delphi Energy and Chassis Systems Plant and Delphi Safety and Interior Systems Plant, collectively referred to as the “facility” in this report.

A European Research Agenda for Somatic Symptom Disorders, Bodily Distress Disorders, and Functional Disorders: Results of an Estimate-Talk-Estimate Delphi Expert Study.

PubMed

van der Feltz-Cornelis, Christina M; Elfeddali, Iman; Werneke, Ursula; Malt, Ulrik F; Van den Bergh, Omer; Schaefert, Rainer; Kop, Willem J; Lobo, Antonio; Sharpe, Michael; Söllner, Wolfgang; Löwe, Bernd

2018-01-01

Background: Somatic Symptom Disorders (SSD), Bodily Distress Disorders (BDD) and functional disorders (FD) are associated with high medical and societal costs and pose a substantial challenge to the population and health policy of Europe. To meet this challenge, a specific research agenda is needed as one of the cornerstones of sustainable mental health research and health policy for SSD, BDD, and FD in Europe. Aim: To identify the main challenges and research priorities concerning SSD, BDD, and FD from a European perspective. Methods: Delphi study conducted from July 2016 until October 2017 in 3 rounds with 3 workshop meetings and 3 online surveys, involving 75 experts and 21 European countries. EURONET-SOMA and the European Association of Psychosomatic Medicine (EAPM) hosted the meetings. Results: Eight research priorities were identified: (1) Assessment of diagnostic profiles relevant to course and treatment outcome. (2) Development and evaluation of new, effective interventions. (3) Validation studies on questionnaires or semi-structured interviews that assess chronic medical conditions in this context. (4) Research into patients preferences for diagnosis and treatment. (5) Development of new methodologic designs to identify and explore mediators and moderators of clinical course and treatment outcomes (6). Translational research exploring how psychological and somatic symptoms develop from somatic conditions and biological and behavioral pathogenic factors. (7) Development of new, effective interventions to personalize treatment. (8) Implementation studies of treatment interventions in different settings, such as primary care, occupational care, general hospital and specialty mental health settings. The general public and policymakers will benefit from the development of new, effective, personalized interventions for SSD, BDD, and FD, that will be enhanced by translational research, as well as from the outcomes of research into patient involvement, GP-patient communication, consultation-liaison models and implementation. Conclusion: Funding for this research agenda, targeting these challenges in coordinated research networks such as EURONET-SOMA and EAPM, and systematically allocating resources by policymakers to this critical area in mental and physical well-being is urgently needed to improve efficacy and impact for diagnosis and treatment of SSD, BDD, and FD across Europe.

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England.

PubMed

Halvorsrud, Kristoffer; Flynn, Darren; Ford, Gary A; McMeekin, Peter; Bhalla, Ajay; Balami, Joyce; Craig, Dawn; White, Phil

2018-02-22

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke. A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR). Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography. The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Which Social Values Are Considered in Iranian Health System?

PubMed

Rashidian, Arash; Arab, Mohammad; Vaez Mahdavi, Mohammadreza; Ashtarian, Koimars; Mostafavi, Hakimeh

2018-05-01

Health systems have a set of limited resources for meeting the needs of communities. Health priority setting based on criteria and values is inevitable in such situation. This paper aims to identify the social values that are considered in Iranian health system. This qualitative study was conducted in 3 steps including collecting national documents and literature review, interviewing key informants, and a 2 round Delphi. Interviews and documents were analyzed through thematic framework analysis. Statistical guidance was applied for determining consensus cut-off in Delphi technique. Five social values including freedom of choice, equity, solidarity, severity of disease(s), and burden of disease(s) were considered more important than other values in the health priority setting decisions. Moreover, 2 non-value based factors including conflict of interest and lobbying had a high effect on decision making. Most health policy makers decide based on Egalitarian school, but restriction of resources in the country decreases the outcome. Moreover, personal judgments and preferences sometimes affect their decisions. It seems that developing a value-based framework and making it as a national guidance could have affirmative effect on health administers decisions. © 2018 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study.

PubMed

van Lier, Lisanne I; Bosmans, Judith E; van Hout, Hein P J; Mokkink, Lidwine B; van den Hout, Wilbert B; de Wit, G Ardine; Dirksen, Carmen D; Nies, Henk L G R; Hertogh, Cees M P M; van der Roest, Henriëtte G

2017-12-19

Differences between country-specific guidelines for economic evaluations complicate the execution of international economic evaluations. The aim of this study was to develop cross-European recommendations for the identification, measurement and valuation of resource use and lost productivity in economic evaluations using a Delphi procedure. A comprehensive literature search was conducted to identify European guidelines on the execution of economic evaluations or costing studies as part of economic evaluations. Guideline recommendations were extracted by two independent reviewers and formed the basis for the first round of the Delphi study, which was conducted among European health economic experts. During three written rounds, consensus (agreement of 67% or higher) was sought on items concerning the identification, measurement and valuation of costs. Recommendations from 18 guidelines were extracted. Consensus among 26 panellists from 17 European countries was reached on 61 of 68 items. The recommendations from the Delphi study are to adopt a societal perspective, to use patient report for measuring resource use and lost productivity, to value both constructs with use of country-specific standardized/unit costs and to use country-specific discounting rates. This study provides consensus-based cross-European recommendations on how to measure and value resource use and lost productivity in economic evaluations. These recommendations are expected to support researchers, healthcare professionals, and policymakers in executing and appraising economic evaluations performed in international contexts.

The impact of the internet on community pharmacy practice: a comparison of a Delphi panel's forecast with emerging trends.

PubMed

Holmes, Erin R; Tipton, David J; Desselle, Shane P

2002-01-01

The purpose of this study was to forecast the impact of Internet pharmacy commerce on various stakeholders. A panel of experts assembled from a list of academicians in the social and administrative pharmaceutical sciences participated in a three-iteration Delphi procedure. Feedback from the aggregate responses of the panel was used to construct questionnaires employed in subsequent iterations of the Delphi. The panel converged to form a consensus upon a variety of issues. They forecasted the attainment of a 10-15% share in the market of prescription and over-the-counter pharmaceuticals through on-line purchases, the formation of strategic alliances among stakeholders in the drug distribution process, a shift in marketing strategies by brick-and-mortar stores, an increase in the prevalence of niching among pharmacy service providers and a subsequent growth in the implementation of cognitive services throughout the industry. With few exceptions, the forecast produced by the Delphi panel appears to be coming to fruition.

Using Delphi technique in a consensual curriculum for periodontics.

PubMed

Fried, Hana; Leao, Anna Thereza

2007-11-01

Periodontics has experienced several important conceptual changes in the last few decades. As such, it is important to have a periodontics curriculum built upon the expertise of specialists in that discipline and reflecting those changes. The main goal of this study was to attain a consensus, through the use of the Delphi technique, on the topics that should be included in a periodontics curriculum for undergraduate dental students. A sample of periodontics lecturers from nine dental schools in two Brazilian cities was used, and a Delphi technique approach was followed to investigate sample member perceptions on the subject. Participants received four postal mail questionnaires asking them to rate and rerate eighty-nine topics for possible inclusion in the curriculum. A descriptive analysis was conducted, and topic frequencies were calculated. Topics rated as highly important for inclusion were the following: health, ailment, prevention, etiology, epidemiology, diagnosis, and treatment. The Delphi technique approach proved successful in involving periodontics lecturers in the design of a periodontics curriculum for undergraduate dental students.

Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique.

PubMed

Ferguson, Niall D; Davis, Aileen M; Slutsky, Arthur S; Stewart, Thomas E

2005-06-01

The objective of this study is to describe the implementation of formal consensus techniques in the development of a clinical definition for acute respiratory distress syndrome. A Delphi consensus process was conducted using e-mail. Sixteen panelists who were both researchers and opinion leaders were systematically recruited. The Delphi technique was performed over 4 rounds on the background of an explicit definition framework. Item generation was performed in round 1, item reduction in rounds 2 and 3, and definition evaluation in round 4. Explicit consensus thresholds were used throughout. Of the 16 panelists, 11 actually participated in developing a definition that met a priori consensus rules on the third iteration. New incorporations in the Delphi definition include the use of a standardized oxygenation assessment and the documentation of either a predisposing factor or decreased thoracic compliance. The panelists rated the Delphi definition as acceptable to highly acceptable (median score, 6; range, 5-7 on a 7-point Likert scale). We conclude that it is feasible to consider using formal consensus in the development of future definitions of acute respiratory distress syndrome. Testing of sensibility, reliability, and validity are needed for this preliminary definition; these test results should be incorporated into future iterations of this definition.

Determinants of innovation within health care organizations: literature review and Delphi study.

PubMed

Fleuren, Margot; Wiefferink, Karin; Paulussen, Theo

2004-04-01

When introducing innovations to health care, it is important to gain insight into determinants that may facilitate or impede the introduction, in order to design an appropriate strategy for introducing the innovation. To obtain an overview of determinants of innovations in health care organizations, we carried out a literature review and a Delphi study. The Delphi study was intended to achieve consensus among a group of implementation experts on determinants identified from the literature review. We searched 11 databases for articles published between 1990 and 2000. The keywords varied according to the specific database. We also searched for free text. Forty-four implementation experts (implementation researchers, programme managers, and implementation consultants/advisors) participated in the Delphi study. The following studies were selected: (i) studies describing innovation processes, and determinants thereof, in health care organizations; (ii) studies where the aim of the innovations was to change the behaviour of health professionals; (iii) studies where the health care organizations provided direct patient care; and (iv) studies where only empirical studies were included. Two researchers independently selected the abstracts and analysed the articles. The determinants were divided into four categories: characteristics of the environment, characteristics of the organization, characteristics of the user (health professional), and characteristics of the innovation. When analysing the determinants, a distinction was made between systematically designed and non-systematically designed studies. In a systematic study, a determinant analysis was performed and the innovation strategy was adapted to these determinants. Furthermore, the determinants were associated with the degree of implementation, and both users and non-users of the innovation were asked about possible determinants. In the Delphi study, consensus was defined as agreement among 75% of the experts on both the influence of a determinant and the direction towards which that influence tended (i.e. facilitating, impeding, or neutral). From the initial 2239 abstracts, 57 studies were retrieved and 49 determinants were identified that affected (impeded or facilitated) the innovation process. The experts identified one other determinant. Seventeen studies had a more-or-less systematic design; the others did not. After three rounds, consensus was reached on the influence of 49 out of 50 determinants. The results of the literature review matched those found in the Delphi study, and 50 potentially relevant determinants of innovation processes were identified. Many of the innovation studies had several methodological flaws, such as not adjusting innovation strategies to relevant determinants of the innovation process, or that data on determinants were gathered only from non-users. Furthermore, the degree of implementation was evaluated in several ways, which made comparison difficult.

Factors that act as facilitators and barriers to nurse leaders’ participation in health policy development

PubMed Central

2014-01-01

Background Health policies impact on nursing profession and health care. Nurses' involvement in health policy development ensures that health care is safe, of a high quality, accessible and affordable. Numerous factors influence nurse leaders' ability to be politically active in influencing health policy development. These factors can be facilitators or barriers to their participation. There is scant research evidence from Eastern African region that draws attention to this topic. This paper reports part of the larger study. The objectives reported in this paper were those aimed to: build consensus on factors that act as facilitators and barriers to nurse leaders' participation in health policy development in Kenya, Uganda and Tanzania. Methods A Delphi survey was applied which included: expert panelists, iterative rounds, statistical analysis, and consensus building. The expert panelists were purposively selected and included national nurse leaders in leadership positions in East Africa. Data collection was done, in three iterative rounds, and utilized a questionnaire with open and closed ended questions. 78 expert panelists were invited to participate in the study; the response rate was 47% of these 64.8% participated in the second round and of those 100% participated in the third round. Data analysis was done by examining the data for the most commonly occurring categories for the open ended questions and descriptive statistics for structured questions. Results The findings of the study indicate that both facilitators and barriers exist. The former include: being involved in health policy development, having knowledge and skills, enhancing the image of nursing and enabling structures and processes. The latter include: lack of involvement, negative image of nursing and structures and processes which exclude them. Conclusion There is a window of opportunity to enhance national nurse leaders' participation in health policy development. Nurse leaders have a key role in mentoring, supporting and developing future nurse policy makers. PMID:25053921

Intimate Partner Violence Programs in a Children's Hospital: Comprehensive Assessment Utilizing a Delphi Instrument.

PubMed

Randell, Kimberly A; Evans, Sarah E; O'Malley, Donna; Dowd, M Denise

2015-03-01

The purpose of this study was to conduct a baseline assessment of intimate partner violence (IPV) practices in a pediatric hospital system. The Delphi Instrument for Hospital-based Domestic Violence Programs was used to assess the structure and components of the hospital system's IPV practices. Through key stakeholder interviews, we also assessed IPV practices in individual patient care areas. Qualitative analysis of interview data used a grounded theory approach. The hospital scored 17 of 100 points on the Delphi instrument assessment. Key areas of weakness identified by the Delphi instrument and interviews included lack of coordinated provider training and evaluation of IPV-related processes and no standards for IPV screening, safety assessment, and documentation. Most interviewees supported addressing IPV; all identified barriers to IPV screening at individual provider and institutional levels. Institutional barriers included lack of a standardized response to IPV disclosure, need for individualized screening protocols for different patient care settings, lack of standardized provider training, concerns about overextending social work resources, and lack of resources for hospital staff experiencing vicarious trauma. Individual barriers included concern that screening may harm physician-patient-family relationships and the perception that physicians are unwilling to address psychosocial issues. The Delphi Instrument for Hospital-based Domestic Violence Programs identified weaknesses and key areas for improvement in IPV practices. Deficiencies revealed by the Delphi instrument were affirmed by individual interview results. Institutional and individual provider level barriers must be addressed to optimize IPV practices in a pediatric hospital system. Copyright © 2015 by the American Academy of Pediatrics.

Developing the International Business Curriculum: Results and Implications of a Delphi Study on the Futures of Teaching and Learning in International Business

ERIC Educational Resources Information Center

Zettinig, Peter; Vincze, Zsuzsanna

2008-01-01

This article presents the results of a Delphi study concerning the futures of teaching and learning in International Business (IB), a topic that has been receiving a lot of discussion during recent years. Based on our findings we identify two dimensions which may be at the core and instrumental for developing the value proposition of IB. The first…

[Study on commercial specification of atractylodes based on Delphi method].

PubMed

Wang, Hao; Chen, Li-Xiao; Huang, Lu-Qi; Zhang, Tian-Tian; Li, Ying; Zheng, Yu-Guang

2016-03-01

This research adopts "Delphi method" to evaluate atractylodes traditional traits and rank correlation. By using methods of mathematical statistics the relationship of the traditional identification indicators and atractylodes goods rank correlation was analyzed, It is found that the main characteristics affectingatractylodes commodity specifications and grades of main characters wereoil points of transaction,color of transaction,color of surface,grain of transaction,texture of transaction andspoilage. The study points out that the original "seventy-six kinds of medicinal materials commodity specification standards of atractylodes differentiate commodity specification" is not in conformity with the actual market situation, we need to formulate corresponding atractylodes medicinal products specifications and grades.This study combined with experimental results "Delphi method" and the market actual situation, proposed the new draft atractylodes commodity specifications and grades, as the new atractylodes commodity specifications and grades standards. It provides a reference and theoretical basis. Copyright© by the Chinese Pharmaceutical Association.

A modified Delphi study of structures and processes related to medicines management for elderly hospitalised patients in the United Arab Emirates.

PubMed

Al Shemeili, Saeed; Klein, Susan; Strath, Alison; Fares, Saleh; Stewart, Derek

2016-10-01

The structures and processes around the management of medicines for elderly, hospitalized patients are ill defined. This study aimed to determine consensus related to strategic and operational approaches in the United Arab Emirates. A modified Delphi technique, consensus study with first round statements developed from systematic reviews related to medicines management. Normalization process theory and the theoretical domains framework were applied in the construction of statements, organized into key elements of medicines management: guidelines for medicines management, medicines reconciliation, medicines selection, prescribing and review, medicines adherence, medicines counselling, health professional training and evaluation research. Seventy per cent (summative agree and strongly agree) was set as the target for consensus. Thirty panellists were recruited, representing senior physicians working within geriatrics, hospital pharmacy and nursing directors, chief health professionals (including social workers) and policy makers within the Health Authority of Abu Dhabi and academics. A high level of consensus was obtained for most statements relating to the structures and processes of medicines management. While consensus was not achieved for targeting only those patients with medicines related issues, it was achieved for focusing on all elderly admissions. Similarly, consensus was not achieved for which professions were most suited to roles but was achieved for trained and competent staff. High levels of consensus were obtained for structures and processes of medicines management relating to elderly hospitalized patients. Trained and competent health professionals were preferred to specific professions for any tasks and that all elderly patients and not targeted patients should be the focus for medicines management. © 2016 John Wiley & Sons, Ltd.

A Delphi-Based Approach for Detecting Key E-Learning Trends in Postgraduate Education: The Spanish Case

ERIC Educational Resources Information Center

Lopez-Catalan, Blanca; Bañuls, Victor A.

2017-01-01

Purpose: The purpose of this paper is to present the results of national level Delphi study carried out in Spain aimed at providing inputs for higher education administrators and decision makers about key e-learning trends for supporting postgraduate courses. Design/methodology/approach: The ranking of the e-learning trends is based on a…

Using the Delphi Method for Selecting Effective Rehabilitation Practices for Case Study Research: Methods, Challenges, and Solutions and Implications for Future Research

ERIC Educational Resources Information Center

Fleming, Allison R.; Boeltzig-Brown, Heike; Foley, Susan M.

2015-01-01

Purpose: We describe a modified Delphi method used to select effective state vocational rehabilitation agency practices to prioritize rehabilitation services for individuals with most significant disabilities within the context of Order of Selection, an area where there is little known and published. Specifically, we describe how we applied the…

Issues and Needs in Rural Early Childhood Special Education Services in Florida: A Delphi Study.

ERIC Educational Resources Information Center

Weiss, Keith E.; Correa, Vivian I.

A Delphi Technique was used to examine the problems of early childhood special education programs in rural Florida. Two rounds of questionnaires were completed by a panel of early childhood special education administrators and teachers from 14 of Florida's 27 rural counties. In response to the questionnaires, the panel developed 51 problem-related…

Future of the Korea national parks: a preliminary Delphi study of key experts

Treesearch

Byung-kyu Lee; Wilbur F. LaPage

2002-01-01

A preliminary Delphi survey of a panel of key experts who are very knowledgeable of Korean national parks was conducted between February and March in 2001. Park professionals, environmental NGO directors, interested citizens, and retirees identified issues facing the Korean park system (Wave1). Findings from wave I of the survey provided the baseline for a series of...

Development of an Adolescent Alcohol Misuse Intervention Based on the Prototype Willingness Model: A Delphi Study

ERIC Educational Resources Information Center

Davies, Emma; Martin, Jilly; Foxcroft, David

2016-01-01

Purpose: The purpose of this paper is to report on the use of the Delphi method to gain expert feedback on the identification of behaviour change techniques (BCTs) and development of a novel intervention to reduce adolescent alcohol misuse, based on the Prototype Willingness Model (PWM) of health risk behaviour. Design/methodology/approach: Four…

Developing a tool for the preparation of GMP audit of pharmaceutical contract manufacturer.

PubMed

Linna, Anu; Korhonen, Mirka; Mannermaa, Jukka-Pekka; Airaksinen, Marja; Juppo, Anne Mari

2008-06-01

Outsourcing is rapidly growing in the pharmaceutical industry. When the manufacturing activities are outsourced, control of the product's quality has to be maintained. One way to confirm contract manufacturer's GMP (Good Manufacturing Practice) compliance is auditing. Audits can be supported for instance by using GMP questionnaires. The objective of this study was to develop a tool for the audit preparation of pharmaceutical contract manufacturers and to validate its contents by using Delphi method. At this phase of the study the tool was developed for non-sterile finished product contract manufacturers. A modified Delphi method was used with expert panel consisting of 14 experts from pharmaceutical industry, authorities and university. The content validity of the developed tool was assessed by a Delphi questionnaire round. The response rate in Delphi questionnaire round was 86%. The tool consisted of 103 quality items, from which 90 (87%) achieved the pre-defined agreement rate level (75%). Thirteen quality items which did not achieve the pre-defined agreement rate were excluded from the tool. The expert panel suggested only minor changes to the tool. The results show that the content validity of the developed audit preparation tool was good.

Distribution network connection pricing framework and methodology: identification of areas of improvement for Sarawak Energy Berhad Connection Charges Guidelines through modified delphi method

NASA Astrophysics Data System (ADS)

Tan, J. K.; Abas, N.

2017-07-01

Complaints on issues and matters related to connection charges have been very common for electricity supply utility companies around the world including Sarawak Energy Berhad. In order to identify the areas that can be improved, a mixed method of exploratory research involving qualitative and quantitative methods have been designed and undertaken rather than a single method of survey. This will ensure a more comprehensive and detailed understanding of the issues from various target groups. The method is designed under three phases, employing Modified Delphi Technique for phase 1 through a series of stake holder engagements, online and offline survey questionnaires to be filled by internal wiring contractors for phase 2 whilst under phase 3, case studies shall be carried out on the issues identified from phase 1 and phase 2 of the study. This paper presented the findings from the Modified Delphi Technique. The findings revealed that there are areas of improvement for Sarawak Energy Berhad connection guidelines in term of differentiation of dedicated and shared assets which leads to unfairness to the connecting customers, inconsistency and non-transparent in charging. The findings of Modified Delphi Technique shall be used for implementation of phase 2 and phase 3 of the study.

Expert Consensus for Discharge Referral Decisions Using Online Delphi

PubMed Central

Bowles, Kathy H.; Holmes, John H.; Naylor, Mary D.; Liberatore, Matthew; Nydick, Robert

2003-01-01

This paper describes the results of using a modified Delphi approach designed to achieve consensus from eight discharge planning experts regarding the decision to refer hospitalized older adults for post-discharge follow-up. Experts reviewed 150 cases using an online website designed to facilitate their interaction and efforts to reach agreement on the need for a referral for post-discharge care and the appropriate site for such care. In contrast to an average of eight weeks to complete just 50 cases using the traditional mail method, the first online Delphi round for 150 cases were completed in six weeks. Data provided by experts suggest that online Delphi is a time efficient and acceptable methodology for reaching group consensus. Other benefits include instant access to Delphi decision results, live knowledge of the time requirements and progress of each expert, and cost savings in postage, paper, copying, and storage of paper documents. This online Delphi methodology is highly recommended. PMID:14728143

Identifying seminal papers in the Australasian Journal on Ageing 1982-2011: a Delphi consensus approach.

PubMed

Parkinson, Lynne; Richardson, Kristy; Sims, Jane; Wells, Yvonne; Naganathan, Vasi; Brooke, Elizabeth; Lindley, Richard

2013-10-01

The aim of this study was to identify seminal Australasian Journal on Ageing papers published over 30 years through a Delphi consensus process. The main data collection was a three-round Delphi consensus study with 38 past and current members of the Australasian Journal on Ageing Editorial Board, Editorial Team and Management Committee. Three papers were agreed as top-ranking. One of the top-ranking articles was also highly cited. One article was published in the 1990 s, two in 2001. While it is difficult to judge how well the top-ranking papers represent seminal papers arising over 30 years, these papers do represent three different research strengths in Australasia, they do span three different disciplines, and they do reflect some of the diversity that characterises ageing research in Australasia over 30 years. © 2013 ACOTA.

Essential Concepts of Nanoscale Science and Technology for High School Students Based on a Delphi Study by the Expert Community

NASA Astrophysics Data System (ADS)

Sakhnini, Sohair; Blonder, Ron

2015-07-01

Nanoscale science and technology (NST) is an important new field in modern science. In the current study, we seek to answer the question: 'What are the essential concepts of NST that should be taught in high school'? A 3-round Delphi study methodology was applied based on 2 communities of experts in nanotechnology research and science education. Eight essential concepts in NST were identified. Each concept is accompanied by its explanation, definition, importance and includes subcategories that compose it. Three concepts emerged in the Delphi study, which were not identified before: functionality, classification of nanomaterials, and the making of nanotechnology. Differences between the concepts suggested by the 2 communities of experts were found. The results of this study serve as a tool to examine different nanotechnology programs that were reported thus far and to make recommendations for designing a NST program for high school students that includes the essential concepts.

Role of local government in responding to environmental health challenges: a case study of Chungnam

PubMed Central

Lee, Hoo-Young

2017-01-01

The purpose of this study is to introduce the establishment process, policy target, and projects for “Chungnam’s master plan on environmental health policy (2017-2020)” as the local government’s role in addressing local environmental health challenges. We first analyzed existing studies and social issues on the media related to “Chungnam’s master plan” to understand Chungnam’s environmental health status and discussed domestic and international policy trends and related plans. An environmental health perception questionnaire survey and a Delphi expert questionnaire survey were conducted among provincial residents to collect various actors’ opinions on Chungnam’s environmental health issues and policy. An expert advisory panel was launched, and a residents’ voice workshop and cities-and-guns-policy-suggestion workshop were held. The vision of Chungnam’s environmental health policy is minimizing environmental hazards. We finally selected “Pleasant environment, healthy people, happy Chungnam” to represent the will to shape a pleasant environment and prevent and manage health damages for a happy Chungnam. We selected five strategies based on status analysis and a review of domestic and international policy trends and related plans and identified 2 targets (policy objectives) to accomplish the strategies. The strategies to achieve the first target, “Leader in environmental health policy: Chungnam,” include ‘Empowering active provincial capabilities,’ ‘Setting up province-specific systems for environmental health surveys and research,’ and ‘Preventing and managing newly emerging pollutants.’ The strategies for the second target, “Everyone is healthy: Chungnam,” include ‘Relieving health inequalities among vulnerable regions and residents’ and ‘Enlarging the resident-friendly environmental health policy.’ We developed 29 projects in total, according to these strategies. The establishment of “Chungnam’s master plan” is highly valuable; we developed it through discussion involving diverse actors to address environmental health challenges together. It is necessary to continue to strengthen participation, communication, and cooperation among actors to develop an environmental health policy model for the future. PMID:29198098

Setting priorities for non-regulatory animal health in Ireland: results from an expert Policy Delphi study and a farmer priority identification survey.

PubMed

More, Simon J; McKenzie, Ken; O'Flaherty, Joe; Doherty, Michael L; Cromie, Andrew R; Magan, Mike J

2010-07-01

Agriculture is a very important contributor to the Irish economy. In Ireland, national animal health services have been a government, rather than an industry, responsibility. In 2009, Animal Health Ireland (AHI) was established to provide a partnership approach to national leadership of non-regulatory animal health issues (those not subject to national and/or EU regulation). The objectives of this study were to elicit opinion from experts and farmers about non-regulatory animal health issues facing Irish livestock industries, including prioritisation of animal health issues and identification of opportunities to maximise the effective use of AHI resources. The study was conducted with experts using Policy Delphi methodology over three rounds, and with farmers using a priority identification survey. Non-regulatory bovine diseases/conditions were prioritised by both experts and farmers based on impact and international competitiveness. For each high-priority disease/condition, experts were asked to provide an assessment based on cost, impact, international perception, impediment to international market access and current resource usage effectiveness. Further information was also sought from experts about resource allocation preferences, methods to improve education and coordination, and innovative measures to improve prevention and management. There was close agreement between responses from experts and dairy farmers: each gave highest priority to 3 diseases with a biosecurity risk (subsequently termed 'biosecure diseases') (bovine viral diarrhoea [BVD], infectious bovine rhinotracheitis [IBR], paratuberculosis) and 4 diseases/conditions generally without a biosecurity risk ('non-biosecure diseases/conditions') (fertility, udder health/milk quality, lameness, calf health). Beef farmers also prioritised parasitic conditions and weanling pneumonia. The adverse impact of biosecure diseases is currently considered relatively minor by experts, but would increase substantially in time. There are already substantial costs to farms and agribusiness from non-biosecure diseases/conditions. Experts preferred an equal allocation of resources between these biosecure and non-biosecure diseases/conditions, with emphasis on adopting/adapting international models, education and awareness-raising. The results from this study provide robust insights about non-regulatory animal health priorities in Ireland, as perceived by experts and farmers, using methodologies that are both transparent and inclusive. They have already been extremely influential in shaping national policy, as a foundation for interdisciplinary (and multi-agency) cooperation, as a contribution to efforts to encourage stakeholder responsibility-taking, and to ongoing development of postgraduate and undergraduate veterinary education in Ireland. Copyright (c) 2010. Published by Elsevier B.V.

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study.

PubMed

Mascherek, Anna C; Schwappach, David L B

2016-08-05

Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Patient safety priorities in mental healthcare in Switzerland: a modified Delphi study

PubMed Central

Mascherek, Anna C

2016-01-01

Objective Identifying patient safety priorities in mental healthcare is an emerging issue. A variety of aspects of patient safety in medical care apply for patient safety in mental care as well. However, specific aspects may be different as a consequence of special characteristics of patients, setting and treatment. The aim of the present study was to combine knowledge from the field and research and bundle existing initiatives and projects to define patient safety priorities in mental healthcare in Switzerland. The present study draws on national expert panels, namely, round-table discussion and modified Delphi consensus method. Design As preparation for the modified Delphi questionnaire, two round-table discussions and one semistructured questionnaire were conducted. Preparative work was conducted between May 2015 and October 2015. The modified Delphi was conducted to gauge experts' opinion on priorities in patient safety in mental healthcare in Switzerland. In two independent rating rounds, experts made private ratings. The modified Delphi was conducted in winter 2015. Results Nine topics were defined along the treatment pathway: diagnostic errors, non-drug treatment errors, medication errors, errors related to coercive measures, errors related to aggression management against self and others, errors in treatment of suicidal patients, communication errors, errors at interfaces of care and structural errors. Conclusions Patient safety is considered as an important topic of quality in mental healthcare among experts, but it has been seriously neglected up until now. Activities in research and in practice are needed. Structural errors and diagnostics were given highest priority. From the topics identified, some are overlapping with important aspects of patient safety in medical care; however, some core aspects are unique. PMID:27496233

Expert consensus regarding drivers of antimicrobial stewardship in companion animal veterinary practice: a Delphi study.

PubMed

Currie, Kay; King, Caroline; Nuttall, Tim; Smith, Matt; Flowers, Paul

2018-03-23

Antimicrobial resistance (AMR) is a global challenge facing both human and animal healthcare professionals; an effective response to this threat requires a 'One-Health' approach to antimicrobial stewardship (AMS) to preserve important antibiotics for urgent clinical need. However, understanding of barriers and enablers to effective AMS behaviour in companion animal veterinary practice is currently limited. We conducted a Delphi study of 16 nationally recognised experts from UK-based veterinary policymakers, university academics and leaders of professional bodies. This Delphi study sought to identify veterinary behaviours which experts believe contribute to AMR and form vital aspects of AMS. Analysis of Delphi findings indicated a perceived hierarchy of behaviours, the most influential being antibiotic prescribing behaviours and interactions with clients. Other veterinary behaviours perceived as being important related to interactions with veterinary colleagues; infection control practices; and the use of diagnostic tests to confirm infection. Key barriers and enablers to AMS within each of these behavioural domains were identified. Specific interventions to address important barriers and enablers are recommended. To the authors' knowledge, this is the first study to establish expert consensus at a national level about which 'behaviours' (aspects of veterinarian practice) should be targeted in relation to AMR and AMS in companion animal veterinary practice. © British Veterinary Association (unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Efficacy and the Strength of Evidence of U.S. Alcohol Control Policies

PubMed Central

Nelson, Toben F.; Xuan, Ziming; Babor, Thomas; Brewer, Robert D.; Chaloupka, Frank J.; Gruenewald, Paul; Holder, Harold; Klitzner, Michael; Mosher, James; Ramirez, Rebecca L.; Reynolds, Robert; Toomey, Traci L.; Naimi, Timothy S.

2013-01-01

Background Public policy can limit alcohol consumption and its associated harms, but no direct comparison of the relative efficacy of alcohol control policies exists for the U.S. Purpose To identify alcohol control policies and develop quantitative ratings of their efficacy and strength of evidence. Methods In 2010, a Delphi panel of ten U.S. alcohol policy experts identified and rated the efficacy of alcohol control policies for reducing binge drinking and alcohol-impaired driving among both the general population and youth, and the strength of evidence informing the efficacy of each policy. The policies were nominated based on scientific evidence and potential for public health impact. Analysis was conducted in 2010–2012. Results Panelists identified and rated 47 policies. Policies limiting price received the highest ratings, with alcohol taxes receiving the highest ratings for all four outcomes. Highly rated policies for reducing binge drinking and alcohol-impaired driving in the general population were also highly rated among youth, although several policies were rated more highly for youth compared with the general population. Policy efficacy ratings for the general population and youth were positively correlated for reducing both binge drinking (r = 0.50) and alcohol-impaired driving (r = 0.45). The correlation between efficacy ratings for reducing binge drinking and alcohol-impaired driving was strong for the general population (r = 0.88) and for youth (r = 0.85). Efficacy ratings were positively correlated with strength-of-evidence ratings. Conclusions Comparative policy ratings can help characterize the alcohol policy environment, inform policy discussions, and identify future research needs. PMID:23790985

78 FR 48468 - Delphi Corporation, Electronics and Safety Division, Including On-Site Leased Workers From...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

..., Electronics and Safety Division, Including On-Site Leased Workers From Securitas, Bartech, Flint Janitorial... Adjustment Assistance on May 20, 2013, applicable to workers of Delphi Corporation, Electronics and Safety... on- site at the Flint, Michigan location of Delphi Corporation, Electronics and Safety Division. The...

Delphi: An Overview, An Application, Some Lessons.

ERIC Educational Resources Information Center

Moore, Carl M.; Coke, James G.

This paper discusses Delphi-a method of utilizing individuals' knowledge, judgment, and opinions to address complex questions and applies the method to a community planning project in Stow, Ohio. There are four phases of any Delphi: (1) exploring the subject under discussion, with each individual contributing pertinent information, (2) reaching an…

75 FR 20383 - Delphi Thermal Systems Currently Known as General Motors Components Holdings LLC, Lockport...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-19

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-63,818] Delphi Thermal Systems... 25, 2008, applicable to workers of Delphi Thermal Systems, Lockport Operations, Lockport, New York... workers are engaged in activities related to the production of automotive heat exchanger products and HVAC...

Use of a Computer-Mediated Delphi Process to Validate a Mass Casualty Conceptual Model

PubMed Central

CULLEY, JOAN M.

2012-01-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters. PMID:21076283

Use of a computer-mediated Delphi process to validate a mass casualty conceptual model.

PubMed

Culley, Joan M

2011-05-01

Since the original work on the Delphi technique, multiple versions have been developed and used in research and industry; however, very little empirical research has been conducted that evaluates the efficacy of using online computer, Internet, and e-mail applications to facilitate a Delphi method that can be used to validate theoretical models. The purpose of this research was to develop computer, Internet, and e-mail applications to facilitate a modified Delphi technique through which experts provide validation for a proposed conceptual model that describes the information needs for a mass-casualty continuum of care. Extant literature and existing theoretical models provided the basis for model development. Two rounds of the Delphi process were needed to satisfy the criteria for consensus and/or stability related to the constructs, relationships, and indicators in the model. The majority of experts rated the online processes favorably (mean of 6.1 on a seven-point scale). Using online Internet and computer applications to facilitate a modified Delphi process offers much promise for future research involving model building or validation. The online Delphi process provided an effective methodology for identifying and describing the complex series of events and contextual factors that influence the way we respond to disasters.

The intellectual developmental disorders Mexico study: situational diagnosis, burden, genomics and intervention proposal.

PubMed

Lazcano-Ponce, Eduardo; Katz, Gregorio; Rodríguez-Valentín, Rocío; Castro, Filipa de; Allen-Leigh, Betania; Márquez-Caraveo, María Elena; Ramírez-García, Miguel Ángel; Arroyo-García, Eduardo; Medina-Mora, María Elena; Ángeles, Gustavo; Urquieta-Salomón, José Edmundo; Salvador-Carulla, Luis

2016-01-01

This study aims to generate evidence on intellectual development disorders (IDD) in Mexico. IDD disease burden will be estimated with a probabilistic model, using population-based surveys. Direct and indirect costs of catastrophic expenses of families with a member with an IDD will be evaluated. Genomic characterization of IDD will include: sequencing participant exomes and performing bioinformatics analyses to identify de novo or inherited variants through trio analysis; identifying genetic variants associated with IDD, and validating randomly selected variants by polymerase chain reaction (PCR) and sequencing or real-time quantitative PCR (qPCR). Delphi surveys will be done on best practices for IDD diagnosis and management. An external evaluation will employ qualitative case studies of two social and labor inclusion programs for people with IDD. The results will constitute scientific evidence for the design, promotion and evaluation of public policies, which are currently absent on IDD.

Building Adaptive Capacity with the Delphi Method and Mediated Modeling for Water Quality and Climate Change Adaptation in Lake Champlain Basin

NASA Astrophysics Data System (ADS)

Coleman, S.; Hurley, S.; Koliba, C.; Zia, A.; Exler, S.

2014-12-01

Eutrophication and nutrient pollution of surface waters occur within complex governance, social, hydrologic and biophysical basin contexts. The pervasive and perennial nutrient pollution in Lake Champlain Basin, despite decades of efforts, exemplifies problems found across the world's surface waters. Stakeholders with diverse values, interests, and forms of explicit and tacit knowledge determine water quality impacts through land use, agricultural and water resource decisions. Uncertainty, ambiguity and dynamic feedback further complicate the ability to promote the continual provision of water quality and ecosystem services. Adaptive management of water resources and land use requires mechanisms to allow for learning and integration of new information over time. The transdisciplinary Research on Adaptation to Climate Change (RACC) team is working to build regional adaptive capacity in Lake Champlain Basin while studying and integrating governance, land use, hydrological, and biophysical systems to evaluate implications for adaptive management. The RACC team has engaged stakeholders through mediated modeling workshops, online forums, surveys, focus groups and interviews. In March 2014, CSS2CC.org, an interactive online forum to source and identify adaptive interventions from a group of stakeholders across sectors was launched. The forum, based on the Delphi Method, brings forward the collective wisdom of stakeholders and experts to identify potential interventions and governance designs in response to scientific uncertainty and ambiguity surrounding the effectiveness of any strategy, climate change impacts, and the social and natural systems governing water quality and eutrophication. A Mediated Modeling Workshop followed the forum in May 2014, where participants refined and identified plausible interventions under different governance, policy and resource scenarios. Results from the online forum and workshop can identify emerging consensus across scales and sectors and be simulated in adaptation scenarios within integrated models. Comparing interventions and scenarios to existing and planned policy and governance systems in Lake Champlain Basin allows for new feedback to build adaptive capacity to identify key leverage points in the coupled natural and human system.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study.

PubMed

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D

2017-01-01

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Panelist's responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. Copyright® by the International Brazilian Journal of Urology.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

PubMed Central

Morris, Christopher; Hoogenes, Jen; Shayegan, Bobby; Matsumoto, Edward D.

2017-01-01

ABSTRACT Introduction As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely. Materials and methods We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions. Results Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process. Conclusions Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees. PMID:28379668

The Desired Learning Outcomes of School-Based Nutrition/Physical Activity Health Education: A Health Literacy Constructed Delphi Survey of Finnish Experts

ERIC Educational Resources Information Center

Ormshaw, Michael James; Kokko, Sami Petteri; Villberg, Jari; Kannas, Lasse

2016-01-01

Purpose: The purpose of this paper is to utilise the collective opinion of a group of Finnish experts to identify the most important learning outcomes of secondary-level school-based health education, in the specific domains of physical activity and nutrition. Design/ Methodology/ Approach: The study uses a Delphi survey technique to collect the…

A Delphi Study of Additive Manufacturing Applicability for United States Air Force Civil Engineer Contingency Operations

DTIC Science & Technology

2015-03-26

10 Table 2. Additive Manufacturing Categories (ASTM International , 2012) ..................... 14 Table 3. Delphi... flexibility in the design and structure of manufactured parts. It also allows for the creation of thousands of possible parts or tools from a single...machine. These benefits of 3 precision and flexibility in design and manufacturing show promising possibilities for addressing the general nature of

A Modified Delphi to Identify the Significant Works Pertaining to the Understanding of Reading Comprehension and Content Analysis of the Identified Works

ERIC Educational Resources Information Center

Zunker, Norma D.; Pearce, Daniel L.

2012-01-01

The first part of this study explored the significant works pertaining to the understanding of reading comprehension using a Modified Delphi Method. A panel of reading comprehension experts identified 19 works they considered to be significant to the understanding of reading comprehension. The panel of experts identified the reasons they…

Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach.

PubMed

Dreesen, Mira; Foulon, Veerle; Hiele, Martin; Vanhaecht, Kris; De Pourcq, Lutgart; Pironi, Loris; Van Gossum, André; Arends, Jann; Cuerda, Cristina; Thul, Paul; Bozzetti, Frederico; Willems, Ludo

2013-05-01

Clear recommendations on how to guide patients with cancer on home parenteral nutrition (HPN) are lacking as the use of HPN in this population remains a controversial issue. Therefore, the aims of this study were to rank treatment recommendations and main outcome indicators to ensure high-quality care and to indicate differences in care concerning benign versus malignant patients. Treatment recommendations, identified from published guidelines, were used as a starting point for a two-round Delphi approach. Comments and additional interventions proposed in the first round were reevaluated in the second round. Ordinal logistic regression with SPSS 2.0 was used to identify differences in care concerning benign versus malignant patients. Twenty-seven experts from five European countries completed two Delphi rounds. After the second Delphi round, the top three most important outcome indicators were (1) quality of life (QoL), (2) incidence of hospital readmission and (3) incidence of catheter-related infections. Forty-two interventions were considered as important for quality of care (28/42 based on published guidelines; 14/42 newly suggested by Delphi panel). The topics 'Liver disease' and 'Metabolic bone disease' were considered less important for cancer patients, together with use of infusion pumps (p = 0.004) and monitoring of vitamins and trace elements (p = 0.000). Monitoring of QoL is considered more important for cancer patients (p = 0.03). Using a two-round Delphi approach, we developed a minimal set of 42 interventions that may be used to determine quality of care in HPN patients with malignancies. This set of interventions differs from a similar set developed for benign patients.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

The setting of standards for agricultural nitrogen emissions: a case study of the Delphi technique.

PubMed

Angus, A J; Hodge, I D; McNally, S; Sutton, M A

2003-12-01

The Delphi technique is a means of aggregating the judgement of a panel of experts in order to improve the quality of decision-making. This paper provides a case study of the technique by undertaking a three-round Delphi study to determine a package of best available techniques to reduce nitrogen emissions from a poultry unit under the Integrated Pollution Prevention and Control Directive (IPPC). Forms of nitrogen addressed included ammonia (NH3), nitrous oxide (N2O) nitrogen oxides (NOx), dusts and nitrate (NO3-), with the study providing a means to prioritise the pollution concerns on different spatial scales. The priority pollutant issues were the contribution of NH3 to eutrophication, the global cooling effect of NH4+ aerosol, the role of NH4+ as a vector for atmospheric transport of NOx and SO2, the contribution of N2O to global warming, and NO3- leaching. Reduced nitrogen (NHx) was rated as a priority on all scales, while N2O and NO3- were rated as priorities only on global and local scales, respectively. The study indicated the need for abatement techniques at each stage of poultry rearing and waste management, with particular attention to reduce NH3 emissions, reflecting the priority pollutant concerns. Measures identified by the panel include maintenance of dry litter, low emission removal of litter from housing and storage of litter under cover. Once the litter has left the farm, this should either be used as a biofuel for electricity generation or rapidly incorporated into agricultural soils. The amounts and timing of manure application should be tuned to crop needs. Uncertainties in the Delphi technique limit its suitability as a stand-alone decision making tool. However, the Delphi technique proved useful in identifying priority pollutant issues, areas of agreement, disagreement and where information is lacking. This demonstrates its use when dealing with the complex issues of prioritising pollution issues and abatement approaches.

DELPHI: An introduction to output layout and data content

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, C.F.

1994-08-16

DELPHI was the data summary and interpretation code used by gas diagnostics personnel during the period from 1968 through 1986. It was written by Floyd Momyer, and went through several revisions during its period of use. Described here is the final version, which provided the most extensive set of summary tables. Earlier versions of the code lacked some of the capabilities of the final version, but what they did include was of substantially the same format. DELPHI was run against most available input decks in the mid 1980s. Microfiche and hardcopy output were generated. Both now reside in our archives.more » These reruns used modified input decks, which may not have had the proper {open_quotes}trigger{close_quotes} to instruct DELPHI to output some tables. These tables could, therefore be missing from a printout even though the necessary data was present. Also, modifications to DELPHI did, in some instances, eliminate DELPHIs` capability to correctly output some of the earlier optional tables. This monologue is intended to compliment the archived printout, and to provide enough insight so that someone unfamiliar with the techniques of Gas Diagnostics can retrieve the results at some future date. DELPHI last ran on the CDC-7600 machines, and was not converted to run on the Crays when the CDC-7600`s were decommissioned. DELPHI accepted data from various analytical systems, set up data summary tables, and combined preshot tracer and detector data with these results to calculate the total production of measured species and the indicated fission yields and detector conversions.« less

Experiences and wisdom behind the numbers: qualitative analysis of the National Action Alliance for Suicide Prevention's Research Prioritization Task Force stakeholder survey.

PubMed

Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a stakeholder survey including 716 respondents from 49 U.S. states and 18 foreign countries. To conduct a qualitative analysis on responses from individuals representing four main stakeholder groups: attempt and loss survivors, researchers, providers, and policy/administrators. This article focuses on a qualitative analysis of the early-round, open-ended responses collected in a modified online Delphi process, and, as an illustration of the research method, focuses on analysis of respondents' views of the role of life and emotional skills in suicide prevention. Content analysis was performed using both inductive and deductive code and category development and systematic qualitative methods. After the inductive coding was completed, the same data set was re-coded using the 12 Aspirational Goals (AGs) identified by the Delphi process. Codes and thematic categories produced from the inductive coding process were, in some cases, very similar or identical to the 12 AGs (i.e., those dealing with risk and protective factors, provider training, preventing reattempts, and stigma). Other codes highlighted areas that were not identified as important in the Delphi process (e.g., cultural/social factors of suicide, substance use). Qualitative and mixed-methods research are essential to the future of suicide prevention work. By design, qualitative research is explorative and appropriate for complex, culturally embedded social issues such as suicide. Such research can be used to generate hypotheses for testing and, as in this analysis, illuminate areas that would be missed in an approach that imposed predetermined categories on data. Published by Elsevier Inc.

Developing a service platform definition to promote evidence-based planning and funding of the mental health service system.

PubMed

Lee, Yong Yi; Meurk, Carla S; Harris, Meredith G; Diminic, Sandra; Scheurer, Roman W; Whiteford, Harvey A

2014-11-26

Ensuring that a mental health system provides 'value for money' requires policy makers to allocate resources to the most cost-effective interventions. Organizing cost-effective interventions into a service delivery framework will require a concept that can guide the mapping of evidence regarding disorder-level interventions to aggregations of services that are meaningful for policy makers. The 'service platform' is an emerging concept that could be used to this end, however no explicit definition currently exists in the literature. The aim of this study was to develop a service platform definition that is consistent with how policy makers conceptualize the major elements of the mental health service system and to test the validity and utility of this definition through consultation with mental health policy makers. We derived a provisional definition informed by existing literature and consultation with experienced mental health researchers. Using a modified Delphi method, we obtained feedback from nine Australian policy makers. Respondents provided written answers to a questionnaire eliciting their views on the acceptability, comprehensibility and usefulness of a service platform definition which was subject to qualitative analysis. Overall, respondents understood the definition and found it both acceptable and useful, subject to certain conditions. They also provided suggestions for its improvement. Our findings suggest that the service platform concept could be a useful way of aggregating mental health services as a means for presenting priority setting evidence to policy makers in mental health. However, further development and testing of the concept is required.

Developing a Service Platform Definition to Promote Evidence-Based Planning and Funding of the Mental Health Service System

PubMed Central

Lee, Yong Yi; Meurk, Carla S.; Harris, Meredith G.; Diminic, Sandra; Scheurer, Roman W.; Whiteford, Harvey A.

2014-01-01

Ensuring that a mental health system provides ‘value for money’ requires policy makers to allocate resources to the most cost-effective interventions. Organizing cost-effective interventions into a service delivery framework will require a concept that can guide the mapping of evidence regarding disorder-level interventions to aggregations of services that are meaningful for policy makers. The ‘service platform’ is an emerging concept that could be used to this end, however no explicit definition currently exists in the literature. The aim of this study was to develop a service platform definition that is consistent with how policy makers conceptualize the major elements of the mental health service system and to test the validity and utility of this definition through consultation with mental health policy makers. We derived a provisional definition informed by existing literature and consultation with experienced mental health researchers. Using a modified Delphi method, we obtained feedback from nine Australian policy makers. Respondents provided written answers to a questionnaire eliciting their views on the acceptability, comprehensibility and usefulness of a service platform definition which was subject to qualitative analysis. Overall, respondents understood the definition and found it both acceptable and useful, subject to certain conditions. They also provided suggestions for its improvement. Our findings suggest that the service platform concept could be a useful way of aggregating mental health services as a means for presenting priority setting evidence to policy makers in mental health. However, further development and testing of the concept is required. PMID:25431877

Capturing Heterogeneity in Medical Marijuana Policies: A Taxonomy of Regulatory Regimes Across the United States.

PubMed

Chapman, Susan A; Spetz, Joanne; Lin, Jessica; Chan, Krista; Schmidt, Laura A

2016-07-28

There is considerable movement in the U.S. to legalize use of cannabis for medicinal purposes. Twenty-three U.S. states and the District of Columbia have laws that decriminalize use of marijuana for medicinal purposes. Most prior studies of state medical marijuana laws and their association with overall marijuana use, adolescent use, crime rates, and alcohol traffic fatalities have used a binary coding of whether the state had a medical marijuana law or not. Mixed results from these studies raise the question of whether this method for measuring policy characteristics is adequate. Our objective was to develop a validated taxonomy of medical marijuana laws that will allow researchers to measure variation in aspects of medical marijuana statutes as well as their overall restrictiveness. We used a modified Delphi technique using detailed and validated data about each state's medical marijuana law. Three senior researchers coded elements of the state laws in initiation of use, quantity allowed, regulations around distribution, and overall restrictiveness. We used 2013 data from the U.S. National Survey on Drug Use and Health to assess validity of the taxonomy. Results indicate substantial state-level variation in medical marijuana policies. Validation analysis supported the taxonomy's validity for all four dimensions with the largest effect sizes for the quantity allowed in the state's medical marijuana policy. This analysis demonstrates the potential importance of nondichotomous measurement of medical marijuana laws in studies of their impact. These findings may also be useful to states that are considering medical marijuana laws, to understand the potential impact of characteristics of those laws.

Using the Delphi Technique to Support Curriculum Development

ERIC Educational Resources Information Center

Sitlington, Helen Barbara; Coetzer, Alan John

2015-01-01

Purpose: The purpose of this paper is to present an analysis of the use of the Delphi technique to support curriculum development with a view to enhancing existing literature on use of the technique for renewal of business course curricula. Design/methodology/approach: The authors outline the Delphi process for obtaining consensus amongst a…

The Delphi Method for Graduate Research

ERIC Educational Resources Information Center

Skulmoski, Gregory J.; Hartman, Francis T.; Krahn, Jennifer

2007-01-01

The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process…

Identifying Core Concepts of Cybersecurity: Results of Two Delphi Processes

ERIC Educational Resources Information Center

Parekh, Geet; DeLatte, David; Herman, Geoffrey L.; Oliva, Linda; Phatak, Dhananjay; Scheponik, Travis; Sherman, Alan T.

2018-01-01

This paper presents and analyzes results of two Delphi processes that polled cybersecurity experts to rate cybersecurity topics based on importance, difficulty, and timelessness. These ratings can be used to identify core concepts--cross-cutting ideas that connect knowledge in the discipline. The first Delphi process identified core concepts that…

Terminating Sequential Delphi Survey Data Collection

ERIC Educational Resources Information Center

Kalaian, Sema A.; Kasim, Rafa M.

2012-01-01

The Delphi survey technique is an iterative mail or electronic (e-mail or web-based) survey method used to obtain agreement or consensus among a group of experts in a specific field on a particular issue through a well-designed and systematic multiple sequential rounds of survey administrations. Each of the multiple rounds of the Delphi survey…

Emergency medicine in the developing world: a Delphi study.

PubMed

Hodkinson, Peter W; Wallis, Lee A

2010-07-01

Emergency medicine (EM) as a specialty has developed rapidly in the western world, but remains largely immature in developing nations. There is an urgent need for emergency services, but no clear guidelines are available on the priorities for establishing EM in the developing world. This study seeks to establish consensus on key areas of EM development in developing world settings, with respect to scope of EM, staffing needs, training requirements, and research priorities. A three-round Delphi study was conducted via e-mail. A panel was convened of 50 EM specialists or equivalent, with experience in or interest in EM in the developing world. In the first round, panelists provided free-text statements on scope, staffing, training, and research priorities for EM in the developing world. A five-point Likert scale was used to rate agreement with the statements in Rounds 2 and 3. Consensus statements are presented as a series of synopsis statements for each of the four major themes. A total of 168 of 208 statements (81%) had reached consensus at the end of the study. Key areas in which consensus was reached included EM being a specialist-driven service, with substantial role for nonphysicians. International training courses should be adapted to local needs. EM research in developing countries should be clinically driven and focus on local issues of importance. The scope and function of EM and relationships with other specialties are defined. Unambiguous principles are laid out for the development of the specialty in developing world environments. The next step required in this process is translation into practical guidelines for the development of EM in developing world settings where they may be used to drive policy, protocols, and research. 2010 by the Society for Academic Emergency Medicine

Using a Delphi approach to develop a strategy for A&E in defence nursing.

PubMed

Kenward, Gary; Berry, Andy; Despres, Julian; McLeod, Judith

The Armed Forces has seen an increase in the number of operational deployments overseas and a greater demand for Accident and Emergency (A&E) trained nurses. This article describes a modified Delphi study used to contribute to the development of a strategy for emergency nursing in the Defence Nursing Services. Twenty-eight A&E specialists took part and the key issues raised were recruitment and retention, staff development, new roles, research priorities, increased internal recruitment of A&E nurses to meet operational demands, and the need for a structured career pathway to help retention. The most pressing areas requiring research were evaluation of the nurse practitioner role, clinical competencies and managing heat injuries in the operational setting. The modified Delphi study provided a valuable and detailed insight into the challenges and aspirations of the military A&E nursing cadre and has assisted in developing a strategy for emergency nursing.

Study of multi-muon bundles in cosmic ray showers detected with the DELPHI detector at LEP

NASA Astrophysics Data System (ADS)

Delphi Collaboration; Abreu, P.; Adam, W.; Adzic, P.; Albrecht, T.; Alemany-Fernandez, R.; Allmendinger, T.; Allport, P. P.; Amaldi, U.; Amapane, N.; Amato, S.; Anashkin, E.; Andreazza, A.; Andringa, S.; Anjos, N.; Antilogus, P.; Apel, W.-D.; Arnoud, Y.; Ask, S.; Asman, B.; Augustinus, A.; Baillon, P.; Ballestrero, A.; Bambade, P.; Barbier, R.; Bardin, D.; Barker, G. J.; Baroncelli, A.; Battaglia, M.; Baubillier, M.; Becks, K.-H.; Begalli, M.; Behrmann, A.; Ben-Haim, E.; Benekos, N.; Benvenuti, A.; Berat, C.; Berggren, M.; Bertrand, D.; Besancon, M.; Besson, N.; Bloch, D.; Blom, M.; Bluj, M.; Bonesini, M.; Boonekamp, M.; Booth, P. S. L.; Borisov, G.; Botner, O.; Bouquet, B.; Bowcock, T. J. V.; Boyko, I.; Bracko, M.; Brenner, R.; Brodet, E.; Bruckman, P.; Brunet, J. M.; Buschbeck, B.; Buschmann, P.; Calvi, M.; Camporesi, T.; Canale, V.; Carena, F.; Castro, N.; Cavallo, F.; Chapkin, M.; Charpentier, Ph.; Checchia, P.; Chierici, R.; Chliapnikov, P.; Chudoba, J.; Chung, S. U.; Cieslik, K.; Collins, P.; Contri, R.; Cosme, G.; Cossutti, F.; Costa, M. J.; Crennell, D.; Cuevas, J.; D'Hondt, J.; da Silva, T.; da Silva, W.; Della Ricca, G.; de Angelis, A.; de Boer, W.; de Clercq, C.; de Lotto, B.; de Maria, N.; de Min, A.; de Paula, L.; di Ciaccio, L.; di Simone, A.; Doroba, K.; Drees, J.; Eigen, G.; Ekelof, T.; Ellert, M.; Elsing, M.; Espirito Santo, M. C.; Fanourakis, G.; Fassouliotis, D.; Feindt, M.; Fernandez, J.; Ferrer, A.; Ferro, F.; Flagmeyer, U.; Foeth, H.; Fokitis, E.; Fulda-Quenzer, F.; Fuster, J.; Gandelman, M.; Garcia, C.; Gavillet, Ph.; Gazis, E.; Gokieli, R.; Golob, B.; Gomez-Ceballos, G.; Goncalves, P.; Graziani, E.; Grosdidier, G.; Grzelak, K.; Guy, J.; Haag, C.; Hallgren, A.; Hamacher, K.; Hamilton, K.; Haug, S.; Hauler, F.; Hedberg, V.; Hennecke, M.; Herr, H.; Hoffman, J.; Holmgren, S.-O.; Holt, P. J.; Houlden, M. A.; Jackson, J. N.; Jarlskog, G.; Jarry, P.; Jeans, D.; Johansson, E. K.; Jonsson, P.; Joram, C.; Jungermann, L.; Kapusta, F.; Katsanevas, S.; Katsoufis, E.; Kernel, G.; Kersevan, B. P.; Kerzel, U.; King, B. T.; Kjaer, N. J.; Kluit, P.; Kokkinias, P.; Kourkoumelis, C.; Kouznetsov, O.; Krumstein, Z.; Kucharczyk, M.; Lamsa, J.; Leder, G.; Ledroit, F.; Leinonen, L.; Leitner, R.; Lemonne, J.; Lepeltier, V.; Lesiak, T.; Liebig, W.; Liko, D.; Lipniacka, A.; Lopes, J. H.; Lopez, J. M.; Loukas, D.; Lutz, P.; Lyons, L.; MacNaughton, J.; Malek, A.; Maltezos, S.; Mandl, F.; Marco, J.; Marco, R.; Marechal, B.; Margoni, M.; Marin, J.-C.; Mariotti, C.; Markou, A.; Martinez-Rivero, C.; Masik, J.; Mastroyiannopoulos, N.; Matorras, F.; Matteuzzi, C.; Mazzucato, F.; Mazzucato, M.; McNulty, R.; Meroni, C.; Migliore, E.; Mitaroff, W.; Mjoernmark, U.; Moa, T.; Moch, M.; Moenig, K.; Monge, R.; Montenegro, J.; Moraes, D.; Moreno, S.; Morettini, P.; Mueller, U.; Muenich, K.; Mulders, M.; Mundim, L.; Murray, W.; Muryn, B.; Myatt, G.; Myklebust, T.; Nassiakou, M.; Navarria, F.; Nawrocki, K.; Nicolaidou, R.; Nikolenko, M.; Oblakowska-Mucha, A.; Obraztsov, V.; Olshevski, A.; Onofre, A.; Orava, R.; Osterberg, K.; Ouraou, A.; Oyanguren, A.; Paganoni, M.; Paiano, S.; Palacios, J. P.; Palka, H.; Papadopoulou, Th. D.; Pape, L.; Parkes, C.; Parodi, F.; Parzefall, U.; Passeri, A.; Passon, O.; Peralta, L.; Perepelitsa, V.; Perrotta, A.; Petrolini, A.; Piedra, J.; Pieri, L.; Pierre, F.; Pimenta, M.; Piotto, E.; Podobnik, T.; Poireau, V.; Pol, M. E.; Polok, G.; Pozdniakov, V.; Pukhaeva, N.; Pullia, A.; Rames, J.; Read, A.; Rebecchi, P.; Rehn, J.; Reid, D.; Reinhardt, R.; Renton, P.; Richard, F.; Ridky, J.; Rivero, M.; Rodriguez, D.; Romero, A.; Ronchese, P.; Roudeau, P.; Rovelli, T.; Ruhlmann-Kleider, V.; Ryabtchikov, D.; Sadovsky, A.; Salmi, L.; Salt, J.; Sander, C.; Savoy-Navarro, A.; Schwickerath, U.; Sekulin, R.; Shellard, R. C.; Siebel, M.; Sisakian, A.; Smadja, G.; Smirnova, O.; Sokolov, A.; Sopczak, A.; Sosnowski, R.; Spassov, T.; Stanitzki, M.; Stocchi, A.; Strauss, J.; Stugu, B.; Szczekowski, M.; Szeptycka, M.; Szumlak, T.; Tabarelli, T.; Taffard, A. C.; Tegenfeldt, F.; Timmermans, J.; Tkatchev, L.; Tobin, M.; Todorovova, S.; Tome, B.; Tonazzo, A.; Tortosa, P.; Travnicek, P.; Treille, D.; Tristram, G.; Trochimczuk, M.; Troncon, C.; Turluer, M.-L.; Tyapkin, I. A.; Tyapkin, P.; Tzamarias, S.; Uvarov, V.; Valenti, G.; van Dam, P.; van Eldik, J.; van Remortel, N.; van Vulpen, I.; Vegni, G.; Veloso, F.; Venus, W.; Verdier, P.; Verzi, V.; Vilanova, D.; Vitale, L.; Vrba, V.; Wahlen, H.; Washbrook, A. J.; Weiser, C.; Wicke, D.; Wickens, J.; Wilkinson, G.; Winter, M.; Witek, M.; Yushchenko, O.; Zalewska, A.; Zalewski, P.; Zavrtanik, D.; Zhuravlov, V.; Zimin, N. I.; Zintchenko, A.; Zupan, M.

2007-11-01

The DELPHI detector at LEP has been used to measure multi-muon bundles originating from cosmic ray interactions with air. The cosmic events were recorded in “parasitic mode” between individual e+e- interactions and the total live time of this data taking is equivalent to 1.6 × 106 s. The DELPHI apparatus is located about 100 m underground and the 84 metres rock overburden imposes a cutoff of about 52 GeV/c on muon momenta. The data from the large volume Hadron Calorimeter allowed the muon multiplicity of 54,201 events to be reconstructed. The resulting muon multiplicity distribution is compared with the prediction of the Monte Carlo simulation based on CORSIKA/QGSJET01. The model fails to describe the abundance of high multiplicity events. The impact of QGSJET internal parameters on the results is also studied.

[Modified Delphi method in the constitution of school sanitation standard].

PubMed

Yin, Xunqiang; Liang, Ying; Tan, Hongzhuan; Gong, Wenjie; Deng, Jing; Luo, Jiayou; Di, Xiaokang; Wu, Yue

2012-11-01

To constitute school sanitation standard using modified Delphi method, and to explore the feasibility and the predominance of Delphi method in the constitution of school sanitation standard. Two rounds of expert consultations were adopted in this study. The data were analyzed with SPSS15.0 to screen indices of school sanitation standard. Thirty-two experts accomplished the 2 rounds of consultations. The average length of expert service was (24.69 ±8.53) years. The authority coefficient was 0.729 ±0.172. The expert positive coefficient was 94.12% (32/34) in the first round and 100% (32/32) in the second round. The harmonious coefficients of importance, feasibility and rationality in the second round were 0.493 (P<0.05), 0.527 (P<0.01), and 0.535 (P<0.01), respectively, suggesting unanimous expert opinions. According to the second round of consultation, 38 indices were included in the framework. Theoretical analysis, literature review, investigation and so on are generally used in health standard constitution currently. Delphi method is a rapid, effective and feasible method in this field.

Welche Kompetenzen brauchen betriebliche Weiterbildner in Zukunft? Ergebnisse einer Delphi-Studie in einem Industrieunternehmen (Qualifications Needed by Educational Staff Working in the Field of Further Education in the Industrial Sector--Results of a Delphi-study Carried out in an Industrial Enterprise).

ERIC Educational Resources Information Center

Harteis, Christian; Prenzel, Manfred

1998-01-01

Attempts to reveal the qualifications that will become important, due to technological change and growing internationalization of competition, for trainers (educational staff) in industrial enterprises. Indicates that the results lead to a view of further education within firms as a service that is subject to competition on the open market. (CMK)

Measuring Best Practices for Workplace Safety, Health, and Well-Being: The Workplace Integrated Safety and Health Assessment.

PubMed

Sorensen, Glorian; Sparer, Emily; Williams, Jessica A R; Gundersen, Daniel; Boden, Leslie I; Dennerlein, Jack T; Hashimoto, Dean; Katz, Jeffrey N; McLellan, Deborah L; Okechukwu, Cassandra A; Pronk, Nicolaas P; Revette, Anna; Wagner, Gregory R

2018-05-01

To present a measure of effective workplace organizational policies, programs, and practices that focuses on working conditions and organizational facilitators of worker safety, health and well-being: the workplace integrated safety and health (WISH) assessment. Development of this assessment used an iterative process involving a modified Delphi method, extensive literature reviews, and systematic cognitive testing. The assessment measures six core constructs identified as central to best practices for protecting and promoting worker safety, health and well-being: leadership commitment; participation; policies, programs, and practices that foster supportive working conditions; comprehensive and collaborative strategies; adherence to federal and state regulations and ethical norms; and data-driven change. The WISH Assessment holds promise as a tool that may inform organizational priority setting and guide research around causal pathways influencing implementation and outcomes related to these approaches.

Finding common ground in implementation: towards a theory of gradual commonality.

PubMed

Ter Haar, Marian; Aarts, Noelle; Verhoeven, Piet

2016-03-01

This article reports on an empirical study that aimed to design a practice-based theory about collaboration on the local implementation of a nationally developed health-promoting intervention. The study's objective is to better understand the dynamic process of complex collaboration. The research is based on a Delphi study among some 100 individuals in local and regional networks, in which various professionals work together to implement the BeweegKuur, which translates as 'course of exercise'. The BeweegKuur is a combined lifestyle intervention aimed at promoting sufficient physical exercise and a healthy diet among people in the Netherlands who are overweight and at risk of diabetes. The Delphi study in three rounds systematically and interactively constructs a common perspective on implementation, reflecting stakeholders' ideas about the collaboration and providing an insight into how these ideas are influenced by the context of the implementation. The statistical and qualitative analyses of the responses to the feedback in the Delphi study form the basis for this practice-based theory on complex collaboration, called the theory of gradual commonality. During interaction, consensus gradually emerges about co-creation as a collaboration strategy. Co-creation leaves room for various ways of achieving the ambitions of the BeweegKuur. This article discusses the importance of this practice-based theory and the value of the Delphi research strategy for promoting health. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Clinical reasoning in unimodal interventions in patients with non-specific neck pain in daily physiotherapy practice, a Delphi study.

PubMed

Maissan, Francois; Pool, Jan; Stutterheim, Eric; Wittink, Harriet; Ostelo, Raymond

2018-06-02

Neck pain is the fourth major cause of disability worldwide but sufficient evidence regarding treatment is not available. This study is a first exploratory attempt to gain insight into and consensus on the clinical reasoning of experts in patients with non-specific neck pain. First, we aimed to inventory expert opinions regarding the indication for physiotherapy when, other than neck pain, no positive signs and symptoms and no positive diagnostic tests are present. Secondly, we aimed to determine which measurement instruments are being used and when they are used to support and objectify the clinical reasoning process. Finally, we wanted to establish consensus among experts regarding the use of unimodal interventions in patients with non-specific neck pain, i.e. their sequential linear clinical reasoning. A Delphi study. A Web-based Delphi study was conducted. Fifteen experts (teachers and researchers) participated. Pain alone was deemed not be an indication for physiotherapy treatment. PROMs are mainly used for evaluative purposes and physical tests for diagnostic and evaluative purposes. Eighteen different variants of sequential linear clinical reasoning were investigated within our Delphi study. Only 6 out of 18 variants of sequential linear clinical reasoning reached more than 50% consensus. Pain alone is not an indication for physiotherapy. Insight has been obtained into which measurement instruments are used and when they are used. Consensus about sequential linear lines of clinical reasoning was poor. Copyright © 2018 Elsevier Ltd. All rights reserved.

Reconsidering Planning and Management of Medical Devices Procurement in Public Health Services in Cyprus

PubMed Central

Theodorou, Mamas; Georgiou, Marina; Nikolentzos, Athanasios; Bellali, Thalia

2015-01-01

Hospital procurement is a crucial field for any health care system, not only for economic reasons but also for reasons related to the quality and safety of the services provided. That is why the process of procurement is, in most countries, governed by a strict legal framework and policy mechanisms. This study investigates the problems and inefficiencies associated with the procurement of medical devices in public hospitals in Cyprus and formulates empirically documented proposals for improvement. Using the Delphi method, a group of 38 experts approach the procurement system in Cyprus from different angles, achieving high rates of consensus on 35 different statements on the weaknesses and problems of the current medical device procurement system, as well as presenting proposals and recommendations for improvement. The findings are highly valuable for future policy initiatives in Cyprus in the light of the economic crisis and the expected implementation of the new General Health Insurance System (GeSY), which the Government of the Republic of Cyprus and the Troika has agreed. PMID:26153175

Developing a Canadian Curriculum for Simulation-Based Education in Obstetrics and Gynaecology: A Delphi Study.

PubMed

Craig, Catherine; Posner, Glenn D

2017-09-01

As obstetrics and gynaecology (Ob/Gyn) residency training programs move towards a competence-based approach to training and assessment, the development of a national standardized simulation curriculum is essential. The primary goal of this study was to define the fundamental content for the Canadian Obstetrics and Gynecology Simulation curriculum. A modified Delphi technique was used to achieve consensus in three rounds by surveying residency program directors or their local simulation educator delegates in 16 accredited Canadian Ob/Gyn residency programs. A consensus rate of 80% was agreed upon. Survey results were collected over 11 months in 2016. Response rates for the Delphi were 50% for the first round, 81% for the second round, and 94% for the third round. The first survey resulted in 84 suggested topics. These were organized into four categories: obstetrics high acuity low frequency events, obstetrics common events, gynaecology high acuity low frequency events, and gynaecology common events. Using the modified Delphi method, consensus was reached on 6 scenarios. This study identified the content for a national simulation-based curriculum for Ob/Gyn residency training programs and is the first step in the development of this curriculum. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Wu, Fei Ling; Liao, Li-Ling

2017-01-16

To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation. Hospitals and community health centres in Taiwan. A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011. 15 Chinese healthcare practitioners with more than 6 months' experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process. Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique. The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Healthcare Quality Indicators for Physiotherapy Management in Hip and Knee Osteoarthritis and Rheumatoid Arthritis: A Delphi Study.

PubMed

Peter, W F; Hurkmans, E J; van der Wees, P J; Hendriks, E J M; van Bodegom-Vos, L; Vliet Vlieland, T P M

2016-12-01

The aim of the present study was to develop healthcare quality indicators (HCQIs) for the physiotherapy (PT) management of patients with hip or knee osteoarthritis (HKOA) or rheumatoid arthritis (RA) in the Netherlands. Two multidisciplinary expert panels, including patients, were instituted. A draft HCQI set was derived from recommendations included in two existing Dutch PT guidelines for HKOA and RA. The panels suggested additional topics, after which a Delphi procedure was performed. All propositions were scored for their potential to represent good-quality PT care (score range 0-9). Based on predefined rules, the Delphi panel HCQIs were discussed and selected. Lastly, every indicator was rephrased, resulting in its output consisting of a numerator and denominator, to facilitate comparisons within and among practices. After two Delphi rounds, two final sets of 17 HCQI - one for HKOA and one for RA - were composed, both containing 16 process indicators (regarding initial assessment, treatment and evaluation) and one outcome indicator. Two sets of HCQIs for PT management in HKOA and RA were developed for measuring the quality of PT care in daily clinical practice. Each indicator was formulated in a measurable way. Future research should focus on the feasibility of both indicator sets for daily clinical practice. Copyright © 2016 John Wiley & Sons, Ltd.

Paratonia: a Delphi procedure for consensus definition.

PubMed

Hobbelen, Johannes S M; Koopmans, Raymond T C M; Verhey, Frans R J; Van Peppen, Roland P S; de Bie, Rob A

2006-01-01

Paratonia is a motor problem that develops during the course of dementia. Definitions of paratonia used in the literature differ considerably, which has clinical implications and may lead to an undesirable heterogeneity in study populations. For this reason, we initiated a Delphi procedure with known experts in the field to establish an operational consensus definition of paratonia. The Delphi procedure involved an anonymous and multistage approach presented as a questionnaire, with each stage building on the results of the previous one in order to reach consensus on the definition of paratonia. Eight of 17 experts agreed to participate in the study. After 4 rounds, the participants reached consensus on the following definition: paratonia is a form of hypertonia with an involuntary variable resistance during passive movement. The nature of paratonia may change with progression of dementia (eg, from active assistance (aka Mitgehen) to active resistance). The degree of resistance depends on the speed of movement (eg, slow > low resistance, fast > high resistance). The degree of paratonia is proportional to the amount of force applied and increases with progression of dementia. The resistance to passive movement is in any direction and there is no clasp-knife phenomenon. The Delphi procedure resulted in a comprehensive, operational definition of paratonia. Future research should focus on the reliability and validity of this definition.

A proposed minimum data set for international primary care optometry: a modified Delphi study.

PubMed

Davey, Christopher J; Slade, Sarah V; Shickle, Darren

2017-07-01

To identify a minimum list of metrics of international relevance to public health, research and service development which can be extracted from practice management systems and electronic patient records in primary optometric practice. A two stage modified Delphi technique was used. Stage 1 categorised metrics that may be recorded as being part of a primary eye examination by their importance to research using the results from a previous survey of 40 vision science and public health academics. Delphi stage 2 then gauged the opinion of a panel of seven vision science academics and achieved consensus on contentious metrics and methods of grading/classification. A consensus regarding inclusion and response categories was achieved for nearly all metrics. A recommendation was made of 53 metrics which would be appropriate in a minimum data set. This minimum data set should be easily integrated into clinical practice yet allow vital data to be collected internationally from primary care optometry. It should not be mistaken for a clinical guideline and should not add workload to the optometrist. A pilot study incorporating an additional Delphi stage prior to implementation is advisable to refine some response categories. © 2017 The Authors. Ophthalmic and Physiological Optics published by John Wiley & Sons Ltd on behalf of College of Optometrists.

Consensus of microbiology reporting of ear swab results to primary care clinicians in patients with otitis externa.

PubMed

Geyer, M; Howell-Jones, R; Cunningham, R; McNulty, C

2011-01-01

Otitis externa is a ubiquitous inflammatory disease; although it arises most commonly from an infection, there is no consensus in the UK for the reporting of ear swab culture results. This study aims to review current microbiology laboratory reporting of ear swab specimens to primary care and reach an evidence-based consensus for a reporting policy. Fifty consecutive ear swab reports were reviewed from each of 12 laboratories in the South West region to determine and discuss reporting practice. The Health Protection Agency (HPA) GP Microbiology Laboratory Use Group reviewed the underlying evidence and worked towards a consensus of expert microbiology opinion for laboratory reporting of ear swab results using a modified version of the Delphi technique. A total of 487 reports from primary care were reviewed (54% female; 46% male). Cultures most commonly yielded Pseudomonas species (36%), Staphylococcus species (21%), Streptococcus species (15%) and fungi (11%). Five reporting policies were agreed: Policy 1: Common pathogens such as group A beta-haemolytic streptococci, Streptococcus pneumoniae, Staphylococcus aureus - Always reported by name with antibiotic susceptibilities. Policy 2: Pseudomonas species - Always reported, but antibiotic susceptibilities only reported in severe disease. Policy 3: Aspergillus, Candida, coliforms and Proteus species, as well as non-group A streptococci and anaerobes - Only reported if moderate numbers of colonies and it is the predominant organism present; if appropriate report antibiotic susceptibilities. Policy 4: Coagulase-negative staphylococci, diphtheroids and enterococci - Not reported by name; generic terms used and antibiotic susceptibilities not reported. Policy 5: When antibiotic susceptibilities reported these must include susceptibility to a topical antibiotic. It is suggested that laboratories should consider adopting this evidence-based reporting consensus for ear swab culture results from primary care patients with otitis externa.

76 FR 46852 - Workers From Kelly Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-03

... Services, Working On-Site at Delphi Automotive Systems, LLC, Powertrain Division, El Paso, TX; Amended..., 2011, applicable to leased workers from Kelly Services working on-site at Delphi Automotive Systems... automotive components. The notice will be published soon in the Federal Register. At the request of the State...

Lessons Learned from Teaching Scratch as an Introduction to Object-Oriented Programming in Delphi

ERIC Educational Resources Information Center

van Zyl, Sukie; Mentz, Elsa; Havenga, Marietjie

2016-01-01

As part of curriculum changes in South Africa, an introductory programming language, Scratch, must first be taught before switching to the well-established teaching of Delphi. The nature of programming in Scratch is considerably different from that in Delphi. It was assumed that the teaching of Scratch as introductory programming language could…

Advantages and Limitations of the e-Delphi Technique: Implications for Health Education Researchers

ERIC Educational Resources Information Center

Donohoe, Holly; Stellefson, Michael; Tennant, Bethany

2012-01-01

In the last 30 years, the application of the Delphi technique has been increasing. With the recent availability and established popularity of Internet-based research tools, the Internet has been identified as a means for mitigating Delphi limitations, maximizing its advantages, and expanding the breadth of its application. The discourse on the…

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

... DEPARTMENT OF LABOR Employment and Training Administration [TA-W-62,069; TA-W-62,069A] Delphi Corporation, Automotive Holding Group, Plant 6, Currently Known as General Motors Corporation Including On-Site Leased Workers From Securitas, EDS, Bartech, Mays Chemicals, Interim Physicians, LLC and HSS Material Management, Flint, MI; Delphi...

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

DEVELOPMENT OF A PHYSICAL PERFORMANCE ASSESSMENT CHECKLIST FOR ATHLETES WHO SUSTAINED A LOWER EXTREMITY INJURY IN PREPARATION FOR RETURN TO SPORT: A DELPHI STUDY

PubMed Central

Haines, Sara; Baker, Tricia

2013-01-01

Purpose/Background: To develop a consensus on the critical constructs necessary to be included in a physical performance assessment checklist (PPAC) to assess an athlete's ability for return to sport following a lower extremity injury. Methods: The study used a 3‐round Delphi method to finalize the PPAI originally developed by a panel of experts. Fourteen Delphi representative sample participants were randomly derived from the authors of peer‐reviewed publications of lower extremity injuries. Nine participants completed all 3 rounds. Results: Throughout the 3 rounds, the 10 initial constructs were modified and revised to produce the finalized PPAC consisting of 12 constructs necessary to consider for an athlete's return to sport after a lower extremity injury. Conclusions: This instrument can be used as a checklist to advocate for prospective batteries of physical performance tests to incorporate the elements identified by this study. Level of Evidence: 5 PMID:23439809

Determinants of adolescents' ineffective and improved coping with cyberbullying: a Delphi study.

PubMed

Jacobs, Niels C L; Dehue, Francine; Völlink, Trijntje; Lechner, Lilian

2014-06-01

The study's aim was to obtain an overview of all relevant variables involved in ineffective coping behavior and improvement in coping behavior as it pertains to cyberbullying among adolescents, in order to systematically develop a theory- and evidence-based intervention. This was done by means of a three round online Delphi study. First, 20 key experts listed possible relevant determinants. Next, 70 experts scored these determinants on their relevance and finally, experts rerated relevance of each determinant based on group median scores. The experts agreed that 115 items are relevant for ineffective (62) or improvement in (53) coping behavior. New found determinants were the extent to which one can adjust behavior upon feedback, impulsivity, self-confidence, communication style, personality, decision-making skills, conflict resolution skills, previous participation in personal resilience training, social relationships, rumors and self-disclosure. We conclude that the Delphi technique is useful in discovering new and relevant determinants of behavior. Copyright © 2014 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Development of an antibiotic spectrum score based on veterans affairs culture and susceptibility data for the purpose of measuring antibiotic de-escalation: a modified Delphi approach.

PubMed

Madaras-Kelly, Karl; Jones, Makoto; Remington, Richard; Hill, Nicole; Huttner, Benedikt; Samore, Matthew

2014-09-01

Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score. Web-based modified Delphi method. Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases-focused listservs. Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants' judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated. Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively. Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Delphi Study to Determine Rehabilitation Research Priorities for Older Adults With Cancer.

PubMed

Lyons, Kathleen Doyle; Radomski, Mary Vining; Alfano, Catherine M; Finkelstein, Marsha; Sleight, Alix G; Marshall, Timothy F; McKenna, Raymond; Fu, Jack B

2017-05-01

To solicit expert opinions and develop consensus around the research that is needed to improve cancer rehabilitation for older adults. Delphi methods provided a structured process to elicit and prioritize research questions from national experts. National, Web-based survey. Members (N=32) of the American Congress of Rehabilitation Medicine completed at least 1 of 3 investigator-developed surveys. Not applicable. In the first survey, participants identified up to 5 research questions that needed to be answered to improve cancer rehabilitation for older adults. In 2 subsequent surveys, participants viewed the compilation of questions, rated the importance of each question, and identified the 5 most important questions. This generated priority scores for each question. Consensus scores were created to describe the degree of agreement around the priority of each question. Highest priority research concerns the epidemiology and measurement of function and disability in older adult cancer survivors; the effects of cancer rehabilitation interventions on falls, disability, participation, survival, costs, quality of care, and health care utilization; and testing models of care that facilitate referrals from oncology to rehabilitation providers as part of coordinated, multicomponent care. A multipronged approach is needed to fill these gaps, including targeted funding opportunities developed with an advisory panel of cancer rehabilitation experts, development of a research network to facilitate novel collaborations and grant proposals, and coordinated efforts of clinical groups to advocate for funding, practice change, and policy change. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

A forecasting study on Chinese television development (1986 to 2001).

PubMed

Sun, L

1988-01-01

Given its widespread availability and impact on social values, television is expected to play an important role in China's modernization drive. Necessary to this process is a detailed analysis of the framework in which the technical aspects of television's development are related to political, economic, telecommunications, and social factors. To facilitate this analysis, a Delphi survey was conducted in 1986 as was a cross-impact analysis assisted by computer modelling. Entitled "Future Development of Chinese Television, 1986-2001," the Delphi survey sought to provide decision makers with operationally meaningful assistance in the form of information and analysis. The responses from experts suggested that, if economic growth can be sustained over the next 5 years, telecommunications development will receive top priority in state planning. Cross-impact analysis helps to clarify and promote better understanding of the complex relationships among future events and trends. This analysis tended to confirm the hypothesis that a nongovernmental television station is unlikely to emerge before 1991. Crucial to the success of any television policy (such as cable television service or videotext systems) is legislative support. The appearance of a nongovernmental television station would have a considerable impact on the private sector in China and lead to competition in programming quality, attracting audiences, and further commercialization. While the future development of Chinese television is dependent on economic factors such as purchasing power and the quality of life, its development can thus also be expected to exert a strong influence on economic life.

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review.

PubMed

Humphrey-Murto, Susan; Varpio, Lara; Wood, Timothy J; Gonsalves, Carol; Ufholz, Lee-Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

2017-10-01

Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results. Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor. Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori. Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Defining food literacy and its components.

PubMed

Vidgen, Helen Anna; Gallegos, Danielle

2014-05-01

Food literacy has emerged as a term to describe the everyday practicalities associated with healthy eating. The term is increasingly used in policy, practice, research and by the public; however, there is no shared understanding of its meaning. The purpose of this research was to develop a definition of food literacy which was informed by the identification of its components. This was considered from two perspectives: that of food experts which aimed to reflect the intention of existing policy and investment, and that of individuals, who could be considered experts in the everyday practicalities of food provisioning and consumption. Given that food literacy is likely to be highly contextual, this second study focused on disadvantaged young people living in an urban area who were responsible for feeding themselves. The Expert Study used a Delphi methodology (round one n=43). The Young People's Study used semi-structured, life-course interviews (n=37). Constructivist Grounded Theory was used to analyse results. This included constant comparison of data within and between studies. From this, eleven components of food literacy were identified which fell into the domains of: planning and management; selection; preparation; and eating. These were used to develop a definition for the term "food literacy". Copyright © 2014 Elsevier Ltd. All rights reserved.

Evidence-based algorithm for diagnosis and assessment in psoriatic arthritis: results by Italian DElphi in psoriatic Arthritis (IDEA).

PubMed

Lapadula, G; Marchesoni, A; Salaffi, F; Ramonda, R; Salvarani, C; Punzi, L; Costa, L; Caso, F; Simone, D; Baiocchi, G; Scioscia, C; Di Carlo, M; Scarpa, R; Ferraccioli, G

2016-12-16

Psoriatic arthritis (PsA) is a chronic inflammatory disease involving skin, peripheral joints, entheses, and axial skeleton. The disease is frequently associated with extrarticular manifestations (EAMs) and comorbidities. In order to create a protocol for PsA diagnosis and global assessment of patients with an algorithm based on anamnestic, clinical, laboratory and imaging procedures, we established a DElphi study on a national scale, named Italian DElphi in psoriatic Arthritis (IDEA). After a literature search, a Delphi poll, involving 52 rheumatologists, was performed. On the basis of the literature search, 202 potential items were identified. The steering committee planned at least two Delphi rounds. In the first Delphi round, the experts judged each of the 202 items using a score ranging from 1 to 9 based on its increasing clinical relevance. The questions posed to experts were How relevant is this procedure/observation/sign/symptom for assessment of a psoriatic arthritis patient? Proposals of additional items, not included in the questionnaire, were also encouraged. The results of the poll were discussed by the Steering Committee, which evaluated the necessity for removing selected procedures or adding additional ones, according to criteria of clinical appropriateness and sustainability. A total of 43 recommended diagnosis and assessment procedures, recognized as items, were derived by combination of the Delphi survey and two National Expert Meetings, and grouped in different areas. Favourable opinion was reached in 100% of cases for several aspects covering the following areas: medical (familial and personal) history, physical evaluation, imaging tool, second level laboratory tests, disease activity measurement and extrarticular manifestations. After performing PsA diagnosis, identification of specific disease activity scores and clinimetric approaches were suggested for assessing the different clinical subsets. Further, results showed the need for investigation on the presence of several EAMs and risk factors. In the context of any area, a rank was assigned for each item by Expert Committee members, in order to create the logical sequence of the algorithm. The final list of recommended diagnosis and assessment procedures, by the Delphi survey and the two National Expert Meetings, was also reported as an algorithm. This study shows results obtained by the combination of a DElphi survey of a group of Italian rheumatologists and two National Expert Meetings, created with the aim of establishing a clinical procedure and algorithm for the diagnosis and the assessment of PsA patients. In order to find accurate and practical diagnostic and assessment items in clinical practice, we have focused our attention on evaluating the different PsA domains. Hence, we conceived the IDEA algorithm in order to address PsA diagnosis and assessment in the context of daily clinical practice. The IDEA algorithm might eventually lead to a multidimensional approach and could represent a useful and practical tool for addressing diagnosis and for assessing the disease appropriately. However, the elaborated algorithm needs to be further investigated in daily practice, for evidencing and proving its eventual efficacy in detecting and staging PsA and its heterogeneous spectrum appropriately.

An examination of the research priorities for a hospice service in New Zealand: A Delphi study.

PubMed

de Vries, Kay; Walton, Jo; Nelson, Katherine; Knox, Rhondda

2016-06-01

Palliative care research is relatively diverse and prioritizing research in this field is dependent on multiple factors such as complex ethical decisions in designing and conducting the research; access to participants who may be deemed "vulnerable" and an increasingly medically focused approach to care. The aim of this study was to inform organizational decision-making and policy development regarding future research priorities for a hospice service in New Zealand. A modified three-round Delphi technique was employed. Participants were drawn from one dedicated specialist palliative care service that delivers care in the community, day-care, hospice inpatient, aged residential care, and acute hospital palliative care service. A purposive sample included palliative care staff (n = 10, 18, 9, for rounds 1-3, respectively) volunteers (n = 10, 12, 11); and patients and family carers (n = 6, 8, for rounds 1 and 2). Patients and family carers were not involved in the third round. At final ranking of six research themes encompassing 23 research topics were identified by staff and volunteers. These were: symptom management; aged care; education; community; patient and family; and bereavement support and young people. Patients and family carers agreed on four themes, made up of 10 research topics. These were: decision-making, bereavement and loss, symptom management; and recognition of need and response of service. The study generated a rich set of research themes and specific research topics. The perspectives of staff and volunteers are significantly different from those of patients and family members, in spite of the recognition by all concerned that palliative care services work within a philosophy of patient-centered care. Open discussion of ideas has the potential to engage both staff and patients and carers in quality improvement initiatives, and to reinforce the value of research for patient care.

A modified Delphi method toward multidisciplinary consensus on functional convalescence recommendations after abdominal surgery.

PubMed

van Vliet, Daphne C R; van der Meij, Eva; Bouwsma, Esther V A; Vonk Noordegraaf, Antonie; van den Heuvel, Baukje; Meijerink, Wilhelmus J H J; van Baal, W Marchien; Huirne, Judith A F; Anema, Johannes R

2016-12-01

Evidence-based information on the resumption of daily activities following uncomplicated abdominal surgery is scarce and not yet standardized in medical guidelines. As a consequence, convalescence recommendations are generally not provided after surgery, leading to patients' insecurity, needlessly delayed recovery and prolonged sick leave. The aim of this study was to generate consensus-based multidisciplinary convalescence recommendations, including advice on return to work, applicable for both patients and physicians. Using a modified Delphi method among a multidisciplinary panel of 13 experts consisting of surgeons, occupational physicians and general practitioners, detailed recommendations were developed for graded resumption of 34 activities after uncomplicated laparoscopic cholecystectomy, laparoscopic and open appendectomy, laparoscopic and open colectomy and laparoscopic and open inguinal hernia repair. A sample of occupational physicians, general practitioners and surgeons assessed the recommendations on feasibility in daily practice. The response of this group of care providers was discussed with the experts in the final Delphi questionnaire round. Out of initially 56 activities, the expert panel selected 34 relevant activities for which convalescence recommendations were developed. After four Delphi rounds, consensus was reached for all of the 34 activities for all the surgical procedures. A sample of occupational physicians, general practitioners and surgeons regarded the recommendations as feasible in daily practice. Multidisciplinary convalescence recommendations regarding uncomplicated laparoscopic cholecystectomy, appendectomy (laparoscopic, open), colectomy (laparoscopic, open) and inguinal hernia repair (laparoscopic, open) were developed by a modified Delphi procedure. Further research is required to evaluate whether these recommendations are realistic and effective in daily practice.

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method.

PubMed

Neveu, Marie-Emmanuelle; Debras, Elodie; Niro, Julien; Fernandez, Hervé; Panel, Pierre

2017-12-01

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements. Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents. From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills. We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

Military Medical Leadership in Uniformed Medical Students: Creating a New Assessment Instrument Using the Delphi Method

DTIC Science & Technology

2015-12-17

healthcare management and have not focused on assessing leadership among student physicians. A systematic review of 80 Delphi method studies by...medical students ( Research Question 1), to create a leadership assessment instrument based on those important components ( Research Question 2), and... research question 2 (RQ2) saw the creation of a three page assessment instrument to assess medical leadership in student physicians. Based on critical

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)

PubMed Central

Downes, Martin J; Brennan, Marnie L; Williams, Hywel C; Dean, Rachel S

2016-01-01

Objectives The aim of this study was to develop a critical appraisal (CA) tool that addressed study design and reporting quality as well as the risk of bias in cross-sectional studies (CSSs). In addition, the aim was to produce a help document to guide the non-expert user through the tool. Design An initial scoping review of the published literature and key epidemiological texts was undertaken prior to the formation of a Delphi panel to establish key components for a CA tool for CSSs. A consensus of 80% was required from the Delphi panel for any component to be included in the final tool. Results An initial list of 39 components was identified through examination of existing resources. An international Delphi panel of 18 medical and veterinary experts was established. After 3 rounds of the Delphi process, the Appraisal tool for Cross-Sectional Studies (AXIS tool) was developed by consensus and consisted of 20 components. A detailed explanatory document was also developed with the tool, giving expanded explanation of each question and providing simple interpretations and examples of the epidemiological concepts being examined in each question to aid non-expert users. Conclusions CA of the literature is a vital step in evidence synthesis and therefore evidence-based decision-making in a number of different disciplines. The AXIS tool is therefore unique and was developed in a way that it can be used across disciplines to aid the inclusion of CSSs in systematic reviews, guidelines and clinical decision-making. PMID:27932337

Policy recommendations for rare disease centres of expertise.

PubMed

Syed, Ahmed M; Camp, Rob; Mischorr-Boch, Christina; Houÿez, Francois; Aro, Arja R

2015-10-01

Rare diseases are a serious public health concern and are a priority in the EU. This study aims to develop policy recommendations for rare disease centres of expertise (CoEs) in order to improve standards and quality of care. A modified 3-round Delphi technique was used. Participants included rare diseases patients, carers, patient representatives and healthcare professionals (HCPs) from CoEs in two countries-Denmark and the UK. The results suggest the need to make improvements within current CoE environments, access to CoEs and the need for coordination and cooperation of services within and outside CoEs. It is recommended that CoEs are not overly 'medicalised', while at the same time they should be established as research facilities. The importance of including patient representatives in CoE performance management was also highlighted. Raising awareness and provision of appropriate training amongst non-specialist HCPs is seen as a priority for early and correct diagnosis and ensuring high quality care. Similarly, provision of targeted information about patients' illness and care was considered essential along with access to social assistance within CoEs. Policy recommendations were developed in areas previously recognised as having gaps. Their implementation is expected to strengthen and improve current care provision for rare disease patients. In member states where national plans and strategies are being developed, it is recommended to replicate the methodological approach used in this study as it has proven to be a helpful tool in rare disease centres of expertise policy development. Copyright © 2015 Elsevier Ltd. All rights reserved.

USING THE DELPHI TECHNIQUE TO DEVELOP EFFECTIVENESS INDICATORS FOR SOCIAL MARKETING COMMUNICATION TO REDUCE HEALTH-RISK BEHAVIORS AMONG YOUTH.

PubMed

Vantamay, Nottakrit

2015-09-01

This study aimed to develop effectiveness indicators for social marketing communication to reduce health-risk behaviors among Thai youth by using the Delphi technique. The Delphi technique is a research approach used to gain consensus through a series of two or more rounds of questionnaire surveys where information and results are fed back to panel members between each round and it has been extensively used to generate many indicators relevant to health behaviors. The Delphi technique was conducted in 3 rounds by consulting a panel of 15 experts in the field of social marketing communication for public health campaigns in Thailand. We found forty-nine effectiveness indicators in eight core components reached consensus. These components were: 1) attitude about health-risk behavior reduction, 2) subjective norms, 3) perceived behavioral control, 4) intention to reduce health-risk behaviors, 5) practices for reducing health-risk behaviors, 6) knowledge about the dangers and impact of health-risk behaviors, 7) campaign brand equity, and 8) communication networks. These effectiveness indicators could be applied by health promotion organizations for evaluating the effectiveness of social marketing communication to effectively reduce health-risk behaviors among youth.

Determining the Criteria and Their Weights for Medical Schools' Ranking: A National Consensus.

PubMed

Mojtahedzadeh, Rita; Mohammadi, Aeen; Kohan, Noushin; Gharib, Mitra; Zolfaghari, Mitra

2016-06-01

Delphi as a consensus development technique enables anonymous, systematic refinement of expert opinion with the aim of arriving at a combined or consensual position. In this study, we determined the criteria and their weights for Iranian Medical Schools' ranking through a Delphi process. An expert committee devised 13 proposed criteria with 32 indicators with their weights, which were arranged hierarchically in the form of a tree diagram. We used the Delphi technique to reach a consensus on these criteria and weights among the deans of 38 public Iranian medical schools. For this purpose, we devised and sent a questionnaire to schools and asked them to suggest or correct the criteria and their weights. We repeated this process in two rounds till all the schools reached an acceptable consensus on them. All schools reached a consensus on the set of 13 criteria and 30 indicators and their weights in three main contexts of education, research and facilities, and equipment which were used for Medical Schools' ranking. Using Delphi technique for devising the criteria and their weights in evaluation processes such as ranking makes their results more acceptable among universities.

Ascertaining top evidence in emergency medicine: A modified Delphi study.

PubMed

Bazak, Stephanie J; Sherbino, Jonathan; Upadhye, Suneel; Chan, Teresa

2018-06-21

CLINICIAN'S CAPSULE What is known about the topic? EM is a specialty with a broad knowledge base making it daunting for a junior resident to know where to begin the acquisition of evidence-based knowledge. What did the study ask? What list of "top papers" was formulated in the field of EM using a national Canadian Delphi approach to achieve an expert consensus? What did the study find? A list was produced of top studies relevant for Canadian EM physicians in training. Why does this study matter to clinicians? The list produced can be used as an educational resource for junior residents.

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Development of quality standards in inflammatory bowel disease management and design of an evaluation tool of nursing care.

PubMed

Torrejón, Antonio; Oltra, Lorena; Hernández-Sampelayo, Paloma; Marín, Laura; García-Sánchez, Valle; Casellas, Francesc; Alfaro, Noelia; Lázaro, Pablo; Vera, María Isabel

2013-01-01

nursing management of inflammatory bowel disease (IBD) is highly relevant for patient care and outcomes. However, there is evidence of substantial variability in clinical practices. The objectives of this study were to develop standards of healthcare quality for nursing management of IBD and elaborate the evaluation tool "Nursing Care Quality in IBD Assessment" (NCQ-IBD) based on these standards. a 178-item healthcare quality questionnaire was developed based on a systematic review of IBD nursing management literature. The questionnaire was used to perform two 2-round Delphi studies: Delphi A included 27 IBD healthcare professionals and Delphi B involved 12 patients. The NCQ-IBD was developed from the list of items resulting from both Delphi studies combined with the Scientific Committee´s expert opinion. the final NCQ-IBD consists of 90 items, organized in13 sections measuring the following aspects of nursing management of IBD: infrastructure, services, human resources, type of organization, nursing responsibilities, nurse-provided information to the patient, nurses training, annual audits of nursing activities, and nursing research in IBD. Using the NCQ-IBD to evaluate these components allows the rating of healthcare quality for nursing management of IBD into 4 categories: A (highest quality) through D (lowest quality). the use of the NCQ-IBD tool to evaluate nursing management quality of IBD identifies areas in need of improvement and thus contribute to an enhancement of care quality and reduction in clinical practice variations.

Using Linear Regression To Determine the Number of Factors To Retain in Factor Analysis and the Number of Issues To Retain in Delphi Studies and Other Surveys.

ERIC Educational Resources Information Center

Jurs, Stephen; And Others

The scree test and its linear regression technique are reviewed, and results of its use in factor analysis and Delphi data sets are described. The scree test was originally a visual approach for making judgments about eigenvalues, which considered the relationships of the eigenvalues to one another as well as their actual values. The graph that is…

Development of the Assessment Items of Debris Flow Using the Delphi Method

NASA Astrophysics Data System (ADS)

Byun, Yosep; Seong, Joohyun; Kim, Mingi; Park, Kyunghan; Yoon, Hyungkoo

2016-04-01

In recent years in Korea, Typhoon and the localized extreme rainfall caused by the abnormal climate has increased. Accordingly, debris flow is becoming one of the most dangerous natural disaster. This study aimed to develop the assessment items which can be used for conducting damage investigation of debris flow. Delphi method was applied to classify the realms of assessment items. As a result, 29 assessment items which can be classified into 6 groups were determined.

A Delphi forecast of technology in education

NASA Technical Reports Server (NTRS)

Robinson, B. E.

1973-01-01

The results are reported of a Delphi forecast of the utilization and social impacts of large-scale educational telecommunications technology. The focus is on both forecasting methodology and educational technology. The various methods of forecasting used by futurists are analyzed from the perspective of the most appropriate method for a prognosticator of educational technology, and review and critical analysis are presented of previous forecasts and studies. Graphic responses, summarized comments, and a scenario of education in 1990 are presented.

Using the modified Delphi method to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy.

PubMed

Zang, Lei; Fan, Ning; Hai, Yong; Lu, S B; Su, Q J; Yang, J C; Du, Peng; Gao, Y J

2015-06-01

Although cervical radiculopathy is very common, there is no standard treatment for this condition, with little high-level evidence available to guide the treatment choice. Thus, this study aimed to review the current data on the management of cervical radiculopathy; and, further, to establish a new Chinese clinical consensus of the treatments for cervical radiculopathy using the Delphi method. First, a systematic review of the previously established treatment guidelines and of articles related to cervical radiculopathy was conducted to establish a protocol for the clinical consensus of the treatment for cervical radiculopathy. Second, from February 2012 to June 2014, we performed a modified Delphi survey in which the current professional opinions from 30 experienced experts, representing almost all of the Chinese provinces, were gathered. Three rounds were performed, and consensus was defined as ≥70% agreement. Consensus of the treatments for cervical radiculopathy was reached on seven aspects, including the proportion of patients requiring only non-surgical therapies; the effectiveness of neck immobilization, physiotherapy, pharmacologic treatment; surgical indications; contraindications; surgery. The modified Delphi study conducted herein reached a consensus concerning several treatment issues for cervical radiculopathy. In the absence of high-level evidence, at present, these expert opinion findings will help guide health care providers to define the appropriate treatment in their regions. Items with no consensus provide excellent areas for future research.

Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

ERIC Educational Resources Information Center

Hatcher, Tim; Colton, Sharon

2007-01-01

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Preliminary identification of key clinical domains for outcome evaluation in fibromyalgia using the Delphi method: the Italian experience.

PubMed

Salaffi, F; Ciapetti, A; Sarzi Puttini, P; Atzeni, F; Iannuccelli, C; Di Franco, M; Cazzola, M; Bazzichi, L

2012-03-19

Fibromyalgia (FM) is a complex syndrome that, in Italy, affects at least 2% of the adult population. It is characterized by chronic widespread musculoskeletal pain often accompanied by multiple other symptoms. The aim of this study was to identify a set of clinical domains for FM considered relevant by both clinicians and patients using a consensus process. Consensus was achieved using the Delphi method based on questionnaires and systematic, controlled opinion feedback. The Delphi exercise involved a panel of 252 rheumatologists and 86 patients with FM as defined by the American College of Rheumatology criteria. All of the patients and clinicians were asked to rank the relative different domains of FM in order of priority. The content validity index (CVI) was used to establish the percentage agreement. The importance of each item was ranked on a 0-3 Likert scale. The frequency, mean relevance scores, and frequency importance product were also calculated. The Delphi exercise showed that the domains ranked highest by patients were similar to those of the clinicians, with the exception of tender point intensity (considered relevant by the clinicians but not by the patients) and environmental sensitivity (considered important by the patients but not by the clinicians). A final 8-item model was developed which was considered to demonstrate adequate validity. The Delphi exercises identified and ranked relevant key clinical domains that need to be assessed in FM research. On the basis of these results, a new patient-reported composite outcome index can be developed and used in clinical trials.

A cross-validation Delphi method approach to the diagnosis and treatment of personality disorders in older adults.

PubMed

Rosowsky, Erlene; Young, Alexander S; Malloy, Mary C; van Alphen, S P J; Ellison, James M

2018-03-01

The Delphi method is a consensus-building technique using expert opinion to formulate a shared framework for understanding a topic with limited empirical support. This cross-validation study replicates one completed in the Netherlands and Belgium, and explores US experts' views on the diagnosis and treatment of older adults with personality disorders (PD). Twenty-one geriatric PD experts participated in a Delphi survey addressing diagnosis and treatment of older adults with PD. The European survey was translated and administered electronically. First-round consensus was reached for 16 out of 18 items relevant to diagnosis and specific mental health programs for personality disorders in older adults. Experts agreed on the usefulness of establishing criteria for specific types of treatments. The majority of psychologists did not initially agree on the usefulness of pharmacotherapy. Expert consensus was reached following two subsequent rounds after clarification addressing medication use. Study results suggest consensus among regarding psychosocial treatments. Limited acceptance amongst US psychologists about the suitability of pharmacotherapy for late-life PDs contrasted with the views expressed by experts surveyed in Netherlands and Belgium studies.

Developing standards for an integrated approach to workplace facilitation for interprofessional teams in health and social care contexts: a Delphi study.

PubMed

Martin, Anne; Manley, Kim

2018-01-01

Integration of health and social care forms part of health and social care policy in many countries worldwide in response to changing health and social care needs. The World Health Organization's appeal for systems to manage the global epidemiologic transition advocates for provision of care that crosses boundaries between primary, community, hospital, and social care. However, the focus on structural and process changes has not yielded the full benefit of expected advances in care delivery. Facilitating practice in the workplace is a widely recognised cornerstone for developments in the delivery of health and social care as collaborative and inclusive relationships enable frontline staff to develop effective workplace cultures that influence whether transformational change is achieved and maintained. Workplace facilitation embraces a number of different purposes which may not independently lead to better quality of care or improved patient outcomes. Holistic workplace facilitation of learning, development, and improvement supports the integration remit across health and social care systems and avoids duplication of effort and waste of valuable resources. To date, no standards to guide the quality and effectiveness of integrated facilitation have been published. This study aimed to identify key elements constitute standards for an integrated approach to facilitating work-based learning, development, improvement, inquiry, knowledge translation, and innovation in health and social care contexts using a three rounds Delphi survey of facilitation experts from 10 countries. Consensus about priority elements was determined in the final round, following an iteration process that involved modifications to validate content. The findings helped to identify key qualities and skills facilitators need to support interprofessional teams to flourish and optimise performance. Further research could evaluate the impact of skilled integrated facilitation on health and social care outcomes and the well-being of frontline interprofessional teams.

Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study.

PubMed

Jeon, Yun-Hee; Conway, Jane; Chenoweth, Lynn; Weise, Janelle; Thomas, Tamsin Ht; Williams, Anna

2015-04-01

To establish validity of a clinical leadership framework for aged care middle managers (The Aged care Clinical Leadership Qualities Framework). Middle managers in aged care have responsibility not only for organisational governance also and operational management but also quality service delivery. There is a need to better define clinical leadership abilities in aged care middle managers, in order to optimise their positional authority to lead others to achieve quality outcomes. A Delphi method. Sixty-nine experts in aged care were recruited, representing rural, remote and metropolitan community and residential aged care settings. Panellists were asked to rate the proposed framework in terms of the relevance and importance of each leadership quality using four-point Likert scales, and to provide comments. Three rounds of consultation were conducted. The number and corresponding percentage of the relevance and importance rating for each quality was calculated for each consultation round, as well as mean scores. Consensus was determined to be reached when a percentage score reached 70% or greater. Twenty-three panellists completed all three rounds of consultation. Following the three rounds of consultation, the acceptability and face validity of the framework was confirmed. The study confirmed the framework as useful in identifying leadership requirements for middle managers in Australian aged care settings. The framework is the first validated framework of clinical leadership attributes for middle managers in aged care and offers an initial step forward in clarifying the aged care middle manager role. The framework provides clarity in the breadth of role expectations for the middle managers and can be used to inform an aged care specific leadership program development, individuals' and organisations' performance and development processes; and policy and guidelines about the types of activities required of middle managers in aged care. © 2014 John Wiley & Sons Ltd.

Providing mental health first aid in the workplace: a Delphi consensus study.

PubMed

Bovopoulos, Nataly; Jorm, Anthony F; Bond, Kathy S; LaMontagne, Anthony D; Reavley, Nicola J; Kelly, Claire M; Kitchener, Betty A; Martin, Angela

2016-08-02

Mental health problems are common in the workplace, but workers affected by such problems are not always well supported by managers and co-workers. Guidelines exist for the public on how to provide mental health first aid, but not specifically on how to tailor one's approach if the person of concern is a co-worker or employee. A Delphi consensus study was carried out to develop guidelines on additional considerations required when offering mental health first aid in a workplace context. A systematic search of websites, books and journal articles was conducted to develop a questionnaire with 246 items containing actions that someone may use to offer mental health first aid to a co-worker or employee. Three panels of experts from English-speaking countries were recruited (23 consumers, 26 managers and 38 workplace mental health professionals), who independently rated the items over three rounds for inclusion in the guidelines. The retention rate of the expert panellists across the three rounds was 61.7 %. Of the 246 items, 201 items were agreed to be important or very important by at least 80 % of panellists. These 201 endorsed items included actions on how to approach and offer support to a co-worker, and additional considerations where the person assisting is a supervisor or manager, or is assisting in crisis situations such as acute distress. The guidelines outline strategies for a worker to use when they are concerned about the mental health of a co-worker or employee. They will be used to inform future tailoring of Mental Health First Aid training when it is delivered in workplace settings and could influence organisational policies and procedures.

Defining the Medical Library Association research agenda: methodology and final results from a consensus process

PubMed Central

Eldredge, Jonathan D.; Harris, Martha R.; Ascher, Marie T.

2009-01-01

Objective: Using a group consensus methodology, the research sought to generate a list of the twelve to fifteen most important and answerable research questions in health sciences librarianship as part of a broader effort to implement the new Medical Library Association (MLA) research policy. Methods: The delphi method was used. The committee distributed a brief survey to all estimated 827 MLA leaders and 237 MLA Research Section members, requesting they submit what they considered to be the most important and answerable research questions facing the profession. The submitted questions were then subjected to 2 rounds of voting to produce a short list of top-ranked questions. Results: The survey produced 62 questions from 54 MLA leaders and MLA Research Section members, who responded from an estimated potential population of 1,064 targeted colleagues. These questions were considered by the process participants to be the most important and answerable research questions facing the profession. Through 2 rounds of voting, these 62 questions were reduced to the final 12 highest priority questions. Conclusion: The modified delphi method accomplished its desired survey and consensus goals. Future survey and consensus processes will be revised to generate more initial questions and to distill a larger number of ranked prioritized research questions. PMID:19626143

Integration or transformation? Looking in the future of Information and Communication Technology in education in Vietnam.

PubMed

Peeraer, Jef; Van Petegem, Peter

2015-02-01

Over the last two decades, crucial factors for Information and Communication Technology (ICT) in education have improved significantly in Vietnam. Nevertheless, it is clear that, as in other countries, no educational revolution is taking place. We argue that there is a need for a broad dialogue on the future of ICT in education in Vietnam as discussion of ideas about future possibilities can be instrumental in rationalizing and generating educational change. We explore how a group of key players representing the public and private sector as well as development partners in the field look at the future of ICT in education in the country. Following the Delphi method, these key players assessed in different survey rounds the current situation of ICT in education, identified a series of targets and were asked to assess these targets in respect of their importance. The key players reached a consensus that the purpose of technology integration is to achieve learning goals and enhance learning. However, there is more controversy on targets that could potentially transform education practice in Vietnam. We discuss the value of the Delphi technique and argue for increased participation of all involved stakeholders in policy development on ICT in education. Copyright © 2014 Elsevier Ltd. All rights reserved.

Identifying Psychological Contract Breaches to Guide Improvements in Faculty Recruitment, Retention, and Development

PubMed Central

Desselle, Shane P.; Draugalis, JoLaine R.; Spies, Alan R.; Davis, Tamra S.; Bolino, Mark

2012-01-01

Objective. To identify pharmacy faculty members’ perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. Methods. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Results. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. Conclusion. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development. PMID:22919084

Identifying psychological contract breaches to guide improvements in faculty recruitment, retention, and development.

PubMed

Peirce, Gretchen L; Desselle, Shane P; Draugalis, JoLaine R; Spies, Alan R; Davis, Tamra S; Bolino, Mark

2012-08-10

To identify pharmacy faculty members' perceptions of psychological contract breaches that can be used to guide improvements in faculty recruitment, retention, and development. A list of psychological contract breaches was developed using a Delphi procedure involving a panel of experts assembled through purposive sampling. The Delphi consisted of 4 rounds, the first of which elicited examples of psychological contract breaches in an open-ended format. The ensuing 3 rounds consisting of a survey and anonymous feedback on aggregated group responses. Usable responses were obtained from 11 of 12 faculty members who completed the Delphi procedure. The final list of psychological contract breaches included 27 items, after modifications based on participant feedback in subsequent rounds. The psychological contract breach items generated in this study provide guidance for colleges and schools of pharmacy regarding important aspects of faculty recruitment, retention, and development.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study.

PubMed

Garvin, Lynn A; Simon, Steven R

2017-05-26

Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. The aim of this study was to develop and prioritize measures of digital patient engagement based on patients' use of the US Department of Veterans Affairs (VA)'s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. All 12 experts completed the study's three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian's three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients' use of VA's My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. ©Lynn A Garvin, Steven R Simon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.05.2017.

Research priorities in medical education at Shiraz University of Medical Sciences:categories and subcategories in the Iranian context

PubMed Central

NABEIEI, PARISA; AMINI, MITRA; GHANAVATI, SHIRIN; MARHAMATI, SAADAT

2016-01-01

Introduction Research in education is a globally significant issue without a long history. Due to the importance of the issue in Health System Development programs, this study intended to determine research priorities in medical education, considering their details and functions. By determining barriers existing in research in education progress, it is tried to make research priorities more functional by recommending acceptable strategies. Methods This is a qualitative-descriptive study in two descriptive phases. The goal of these phases was to determine research priorities subcategories in medical education by Nominal Group Technique (NGT) and two rounds of Delphi method. Through the first phase, subcategories of research priorities were determined, using Nominal Group Technique under medical education experts’ supervision. Through two rounds of Delphi, a questionnaire was constructed based on the subcategories. Eventually, research priorities were determined based on their highest score (scores more than 7 out of 10). Results In the first phase (NGT), 35 priorities in 5 major fields of medical education were presented. In the second phase, priorities were scored, using Delphi method. Medical Ethics and professionalism gained the highest scores (7.63±1.26) and educational evaluation the lowest (7.28±1.52). In this stage, 7 items were omitted but 2 of them were added again after experts’ revision in the third round of Delphi. Conclusion According to the results of the present study and based on previous studies, it really seems that the fields of “Learning and Teaching Approaches” and “Medical Ethics and Professionalism” were more important. Because of financial and resource limitations in our country and the importance of research priorities, it is recommended to frequently study “research priorities determination program” at universities. PMID:26793723

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study

PubMed Central

Li, Lingfeng; Braithwaite, Ronald Scott

2015-01-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research. PMID:26180968

HIV and Alcohol Research Priorities of City, State, and Federal Policymakers: Results of a Delphi Study.

PubMed

Uyei, Jennifer; Li, Lingfeng; Braithwaite, Ronald Scott

2015-09-01

We identified the research areas related to HIV and alcohol consumption that were of highest priority to city, state, and federal policymakers. From June to July 2014, we conducted a 3-round Delphi study to elicit from experts a list of alcohol- and HIV-related clinical trial research questions that were important to fund and rank order the list to identify questions of highest priority. Translating evidence into practice must be improved because some questions that have been extensively studied with results published in peer-reviewed journals were identified by the panel as areas needing additional research.

Preferred reporting items for studies mapping onto preference-based outcome measures: The MAPS statement.

PubMed

Petrou, Stavros; Rivero-Arias, Oliver; Dakin, Helen; Longworth, Louise; Oppe, Mark; Froud, Robert; Gray, Alastair

2015-08-01

'Mapping' onto generic preference-based outcome measures is increasingly being used as a means of generating health utilities for use within health economic evaluations. Despite publication of technical guides for the conduct of mapping research, guidance for the reporting of mapping studies is currently lacking. The MAPS (MApping onto Preference-based measures reporting Standards) statement is a new checklist, which aims to promote complete and transparent reporting of mapping studies. The primary audiences for the MAPS statement are researchers reporting mapping studies, the funders of the research, and peer reviewers and editors involved in assessing mapping studies for publication.A de novo list of 29 candidate reporting items and accompanying explanations was created by a working group comprised of six health economists and one Delphi methodologist. Following a two-round, modified Delphi survey with representatives from academia, consultancy, health technology assessment agencies and the biomedical journal editorial community, a final set of 23 items deemed essential for transparent reporting, and accompanying explanations, was developed. The items are contained in a user friendly 23 item checklist. They are presented numerically and categorised within six sections, namely: (i) title and abstract; (ii) introduction; (iii) methods; (iv) results; (v) discussion; and (vi) other. The MAPS statement is best applied in conjunction with the accompanying MAPS explanation and elaboration document.It is anticipated that the MAPS statement will improve the clarity, transparency and completeness of reporting of mapping studies. To facilitate dissemination and uptake, the MAPS statement is being co-published by eight health economics and quality of life journals, and broader endorsement is encouraged. The MAPS working group plans to assess the need for an update of the reporting checklist in five years' time.This statement was published jointly in Applied Health Economics and Health Policy, Health and Quality of Life Outcomes, International Journal of Technology Assessment in Health Care, Journal of Medical Economics, Medical Decision Making, PharmacoEconomics, and Quality of Life Research.

Development of a scale for the evaluation of patients’ rights prerequisites at educational hospitals in Iran: a study using the Delphi technique

PubMed Central

Aazami, Sanaz; Mozafari, Mosayeb

2015-01-01

The patients’ rights status is one of the essential elements in defining norms related to the concept of clinical governance system. In addition, the patients’ rights status is an important index for quality of care offered in the health care system. However, the lack of a coherent instrument makes it difficult to evaluate patients’ rights status in hospitals and clinics. The aim of this study was to develop an instrument for the evaluation of patients’ rights prerequisites at educational hospitals in Iran. This study was conducted using the modified Delphi technique. In this study, 36 experts in the fields of law, medicine, and professional ethics were participated. The panel of experts participated in 3 rounds. First, experts were asked to judge some pre-identified items, and then, excluded items were judged again in the second round. At the end of the third round, all of the agreed items were included in the final list to form an evaluative scale on practice of patients’ rights. Experts were asked to judge a total 171 items in 3 rounds. Around 31% (n = 53) of items obtained the panel’s approval to be included in the final version of the scale. The experts’ opinions were collected using face-to-face interviews and electronic email during a 6-month period of data collection from October 2013 to February 2014. This study developed a 53-item scale for evaluation of patients’ rights prerequisites in educational hospitals in Iran. This scale was developed in 7 areas of commitments including university education, research, supervision, process management, physical structure, organizational policy, and human resources management. This study developed an evaluative scale to assess the practice of patients’ rights in educational hospitals. The items in the final version of this scale were obtained from a consensus of experts and the instrument can be used to evaluate the context and prerequisites for practice of patients’ rights in Iranian educational hospitals. PMID:27354900

Effectiveness guidance document (EGD) for acupuncture research - a consensus document for conducting trials

PubMed Central

2012-01-01

Background There is a need for more Comparative Effectiveness Research (CER) to strengthen the evidence base for clinical and policy decision-making. Effectiveness Guidance Documents (EGD) are targeted to clinical researchers. The aim of this EGD is to provide specific recommendations for the design of prospective acupuncture studies to support optimal use of resources for generating evidence that will inform stakeholder decision-making. Methods Document development based on multiple systematic consensus procedures (written Delphi rounds, interactive consensus workshop, international expert review). To balance aspects of internal and external validity, multiple stakeholders including patients, clinicians and payers were involved. Results Recommendations focused mainly on randomized studies and were developed for the following areas: overall research strategy, treatment protocol, expertise and setting, outcomes, study design and statistical analyses, economic evaluation, and publication. Conclusion The present EGD, based on an international consensus developed with multiple stakeholder involvement, provides the first systematic methodological guidance for future CER on acupuncture. PMID:22953730

Consumerism 2: preregistration nursing and midwifery curricula.

PubMed

Fox, Jane

This article, the second of two parts, presents findings from a four-stage study exploring the extent to which consumerism and its related aspects have been incorporated into the preregistration nursing and midwifery curriculum. The study was undertaken in recognition that NHS policy (as considered in the first article: Vol 12(5): 321-6) increasingly gave emphasis to the development of a health service that was more consumer and user focused. The study involved use of a Delphi panel, postal questionnaire, review of curriculum documentation, and timetables, together with a small focused group discussion. Findings indicate some aspects relevant to consumerism in health care, e.g. communication and ethical principles were included in the curriculum. Other aspects, such as advocacy, quality assurance, and lay health beliefs, were viewed logically from the perspective of the professional role. In essence, no curriculum transparently addressed consumerism in a central and focused way, although midwifery--and to some extent mental health, learning disabilities, and child branches--gave more overt attention to consumerism than adult branches.

Three decision-making aids: brainstorming, nominal group, and Delphi technique.

PubMed

McMurray, A R

1994-01-01

The methods of brainstorming, Nominal Group Technique, and the Delphi technique can be important resources for nursing staff development educators who wish to expand their decision-making skills. Staff development educators may find opportunities to use these methods for such tasks as developing courses, setting departmental goals, and forecasting trends for planning purposes. Brainstorming, Nominal Group Technique, and the Delphi technique provide a structured format that helps increase the quantity and quality of participant responses.

Final Report of the AMC Committee-Armament. Armament Development Center Concept Plan. Volume 2

DTIC Science & Technology

1974-12-01

Considerations 111-22 Section C Operational Considerations 111-26 Section D Community Economic Impact 111-35 Statements Section E Delphi Benefit Analysis 111-37...Cost Analysis 111-3 B Personnel Considerations III-22 C Operational Considerations 111-26 D Community Economic Impact Statements 111-35 E Delphi ...sidered to be minimal. 111-36 S SECTION E. Delphi Benefit Analysis 1. Introduction. The assessment and comparison of the relative benefits of the various

Development of a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan: a modified Delphi method.

PubMed

Kizawa, Yoshiyuki; Tsuneto, Satoru; Tamba, Kaichiro; Takamiya, Yusuke; Morita, Tatsuya; Bito, Seiji; Otaki, Junji

2012-07-01

There is currently no consensus syllabus of palliative medicine for undergraduate medical education in Japan, although the Cancer Control Act proposed in 2007 covers the dissemination of palliative care. To develop a nationwide consensus syllabus of palliative medicine for undergraduate medical education in Japan using a modified Delphi method. We adopted the following three-step method: (1) a workshop to produce the draft syllabus; (2) a survey-based provisional syllabus; (3) Delphi rounds and a panel meeting (modified Delphi method) to produce the working syllabus. Educators in charge of palliative medicine from 63% of the medical schools in Japan collaborated to develop a survey-based provisional syllabus before the Delphi rounds. A panel of 32 people was then formed for the modified Delphi rounds comprising 28 educators and experts in palliative medicine, one cancer survivor, one bereaved family member, and two medical students. The final consensus syllabus consists of 115 learning objectives across seven sections as follows: basic principles; disease process and comprehensive assessment; symptom management; psychosocial care; cultural, religious, and spiritual issues; ethical issues; and legal frameworks. Learning objectives were categorized as essential or desirable (essential: 66; desirable: 49). A consensus syllabus of palliative medicine for undergraduate medical education was developed using a clear and innovative methodology. The final consensus syllabus will be made available for further dissemination of palliative care education throughout the country.

Core Outcome Domains for early phase clinical trials of sound-, psychology-, and pharmacology-based interventions to manage chronic subjective tinnitus in adults: the COMIT'ID study protocol for using a Delphi process and face-to-face meetings to establish consensus.

PubMed

Fackrell, Kathryn; Smith, Harriet; Colley, Veronica; Thacker, Brian; Horobin, Adele; Haider, Haúla F; Londero, Alain; Mazurek, Birgit; Hall, Deborah A

2017-08-23

The reporting of outcomes in clinical trials of subjective tinnitus indicates that many different tinnitus-related complaints are of interest to investigators, from perceptual attributes of the sound (e.g. loudness) to psychosocial impacts (e.g. quality of life). Even when considering one type of intervention strategy for subjective tinnitus, there is no agreement about what is critically important for deciding whether a treatment is effective. The main purpose of this observational study is, therefore to, develop Core Outcome Domain Sets for the three different intervention strategies (sound, psychological, and pharmacological) for adults with chronic subjective tinnitus that should be measured and reported in every clinical trial of these interventions. Secondary objectives are to identify the strengths and limitations of our study design for recruiting and reducing attrition of participants, and to explore uptake of the core outcomes. The 'Core Outcome Measures in Tinnitus: International Delphi' (COMIT'ID) study will use a mixed-methods approach that incorporates input from health care users at the pre-Delphi stage, a modified three-round Delphi survey and final consensus meetings (one for each intervention). The meetings will generate recommendations by stakeholder representatives on agreed Core Outcome Domain Sets specific to each intervention. A subsequent step will establish a common cross-cutting Core Outcome Domain Set by identifying the common outcome domains included in all three intervention-specific Core Outcome Domain Sets. To address the secondary objectives, we will gather feedback from participants about their experience of taking part in the Delphi process. We aspire to conduct an observational cohort study to evaluate uptake of the core outcomes in published studies at 7 years following Core Outcome Set publication. The COMIT'ID study aims to develop a Core Outcome Domain Set that is agreed as critically important for deciding whether a treatment for subjective tinnitus is effective. Such a recommendation would help to standardise future clinical trials worldwide and so we will determine if participation increases use of the Core Outcome Set in the long term. This project has been registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

IFNA approved Chinese Anaesthesia Nurse Education Program: A Delphi method.

PubMed

Hu, Jiale; Fallacaro, Michael D; Jiang, Lili; Wu, Junyan; Jiang, Hong; Shi, Zhen; Ruan, Hong

2017-09-01

Numerous nurses work in operating rooms and recovery rooms or participate in the performance of anaesthesia in China. However, the scope of practice and the education for Chinese Anaesthesia Nurses is not standardized, varying from one geographic location to another. Furthermore, most nurses are not trained sufficiently to provide anaesthesia care. This study aimed to develop the first Anaesthesia Nurse Education Program in Mainland China based on the Educational Standards of the International Federation of Nurse Anaesthetists. The Delphi technique was applied to develop the scope of practice, competencies for Chinese Anaesthesia Nurses and education program. In 2014 the Anaesthesia Nurse Education Program established by the hospital applied for recognition by the International Federation of Nurse Anaesthetists. The Program's curriculum was evaluated against the IFNA Standards and recognition was awarded in 2015. The four-category, 50-item practice scope, and the three-domain, 45-item competency list were identified for Chinese Anaesthesia Nurses. The education program, which was established based on the International Federation of Nurse Anaesthetists educational standards and Chinese context, included nine curriculum modules. In March 2015, 13 candidates received and passed the 21-month education program. The Anaesthesia Nurse Education Program became the first program approved by the International Federation of Nurse Anaesthetists in China. Policy makers and hospital leaders can be confident that anaesthesia nurses graduating from this Chinese program will be prepared to demonstrate high level patient care as reflected in the recognition by IFNA of their adoption of international nurse anaesthesia education standards. Copyright © 2017 Elsevier Ltd. All rights reserved.

Identifying educational priorities for occupational therapy students to prepare for mental health practice in Australia and New Zealand: Opinions of practising occupational therapists.

PubMed

Scanlan, Justin Newton; Pépin, Geneviève; Haracz, Kirsti; Ennals, Priscilla; Webster, Jayne S; Meredith, Pamela J; Batten, Rachel; Bowman, Siann; Bonassi, Marianne; Bruce, Rosie

2015-10-01

The effective preparation of occupational therapy students for mental health practice is critical to facilitate positive consumer outcomes, underpin optimal practice and support new graduates' professional identity. This project was established to determine a set of 'educational priorities' for occupational therapy students to prepare them for current (and future) entry-level practice in mental health, from the perspective of mental health occupational therapists in Australia and New Zealand. The study included two phases. In Phase One, participants identified what they considered to be important educational priorities for occupational therapy students to prepare them for practice in mental health. For Phase Two, an 'expert panel' was assembled to review and rank these using a Policy Delphi approach. Eighty-five participants provided educational priorities in Phase One. These were grouped into a total of 149 educational themes. In Phase Two, the expert panel (consisting of 37 occupational therapists from diverse locations and practice settings) prioritised these themes across three Delphi rounds. A final priority list was generated dividing educational themes into three prioritised categories: 29 'Essential', 25 'Important' and 44 'Optional' priorities. Highest-ranked priorities were: clinical reasoning, client-centred practice, therapeutic use of self, functional implications of mental illness, therapeutic use of occupation and mental health fieldwork experience. The priority list developed as part of this project provides additional information to support the review of occupational therapy curricula across Australia and New Zealand to ensure that new graduates are optimally prepared for mental health practice. © 2015 Occupational Therapy Australia.

Leadership content important in athletic training education with implications for allied health care.

PubMed

Kutz, Matthew R; Scialli, Joan

2008-01-01

A two-phase exploratory and comparative research study using a Delphi technique and a web-based national survey was done to determine leadership content (i.e., theories, styles, or practices) important to include in athletic training education. Eighteen athletic training experts participated in the Delphi technique, followed by 161 athletic trainers completing the national survey. Consensus of experts was reached after two rounds (77% interrater agreement, alpha = 0.80 and alpha = 0.93 per respective round) and identified 31 leadership content items important to include in athletic training education. The national sample then rated importance of each leadership content area for inclusion in four types of athletic training education programs (entry-level baccalaureate, entry-level master's degree, postgraduate certifications, and doctoral degree). The respondents ranked the leadership content in order of importance according to mean (mean = 1.53 +/- 0.84 to 2.55 +/- 0.55; scale, 0-3). Twenty-two content items (63%) were rated at least "very important" (mean > or = 2.0). Exploratory factor analysis established construct validity and organized leadership content by three factors: managerial leadership and knowledge management; leadership theories; and leadership issues, trends, and policies (alpha = 0.84-0.91). Repeated-measures analysis of variance (Sidak post-hoc adjustments) established criterion-related concurrent validity, which found increasing levels of importance as education type progressed (F = 4.88, p = 0.003-32.56, p = 0.000). Adding leadership content within athletic training enhances the professionalization of students, facilitates leadership competency among students and practicing professionals enrolled in postcertification educational programs, and facilitates job placement and role.

Dupuytren disease: European hand surgeons, hand therapists, and physical medicine and rehabilitation physicians agree on a multidisciplinary treatment guideline: results from the HANDGUIDE study.

PubMed

Huisstede, Bionka M A; Hoogvliet, Peter; Coert, J Henk; Fridén, Jan

2013-12-01

Multidisciplinary treatment guidelines for Dupuytren disease can aid in optimizing the quality of care for patients with this disorder. Therefore, this study aimed to achieve consensus on a multidisciplinary treatment guideline for Dupuytren disease. A European Delphi consensus strategy was initiated. A systematic review reporting on the effectiveness of interventions was conducted and used as an evidence-based starting point for this study. In total, 39 experts (hand surgeons, hand therapists, and physical medicine and rehabilitation physicians) participated in the Delphi consensus strategy. Each Delphi round consisted of a questionnaire, an analysis, and a feedback report. After four Delphi rounds, consensus was achieved on the description, symptoms, and diagnosis of Dupuytren disease. No nonsurgical interventions were included in the guideline. Needle and open fasciotomy, and a limited fasciectomy and dermofasciectomy, were seen as suitable surgical techniques for Dupuytren disease. Factors relevant for choosing one of these surgical techniques were identified and divided into patient-related (age, comorbidity), disease-related (palpable cord, previous surgery in the same area, skin involvement, time of recovery, recurrences), and surgeon-related (years of experience) factors. Associations of these factors with the choice of a specific surgical technique were reported in the guideline. Postsurgical rehabilitation should always include instructions and exercise therapy; postsurgical splinting should be performed on indication. Relevant details for the use of surgical and postsurgical interventions were described. This treatment guideline is likely to promote further discussion on related clinical and scientific issues and may therefore contribute to better treatment of patients with Dupuytren disease.

Designing Excellence and Quality Model for Training Centers of Primary Health Care: A Delphi Method Study.

PubMed

Tabrizi, Jafar-Sadegh; Farahbakhsh, Mostafa; Shahgoli, Javad; Rahbar, Mohammad Reza; Naghavi-Behzad, Mohammad; Ahadi, Hamid-Reza; Azami-Aghdash, Saber

2015-10-01

Excellence and quality models are comprehensive methods for improving the quality of healthcare. The aim of this study was to design excellence and quality model for training centers of primary health care using Delphi method. In this study, Delphi method was used. First, comprehensive information were collected using literature review. In extracted references, 39 models were identified from 34 countries and related sub-criteria and standards were extracted from 34 models (from primary 39 models). Then primary pattern including 8 criteria, 55 sub-criteria, and 236 standards was developed as a Delphi questionnaire and evaluated in four stages by 9 specialists of health care system in Tabriz and 50 specialists from all around the country. Designed primary model (8 criteria, 55 sub-criteria, and 236 standards) were concluded with 8 criteria, 45 sub-criteria, and 192 standards after 4 stages of evaluations by specialists. Major criteria of the model are leadership, strategic and operational planning, resource management, information analysis, human resources management, process management, costumer results, and functional results, where the top score was assigned as 1000 by specialists. Functional results had the maximum score of 195 whereas planning had the minimum score of 60. Furthermore the most and the least sub-criteria was for leadership with 10 sub-criteria and strategic planning with 3 sub-criteria, respectively. The model that introduced in this research has been designed following 34 reference models of the world. This model could provide a proper frame for managers of health system in improving quality.

Taxonomy of the common dolphins of the Eastern Pacific Ocean

USGS Publications Warehouse

Banks, R.C.; Brownell, R.

1969-01-01

Delphinus bairdii Dall is a species of dolphin distinct from D. delphis Linnaeus, with which it has usually been synonymized. D. bairdii has a longer rostrum relative to the zygomatic width of the skull; the ratio of these measurements falls at 1.55 or above for bairdii and 1.53 and below for delphis. In the eastern Pacific Ocean, D. bairdii is found in the Gulf of California and along the west coast of Baja California, Mexico; D. delphis is presently found in the waters off California. Until approximately the beginning of the present century, bairdii occurred farther north in the eastern Pacific Ocean, at least to the Monterey Bay area of California. Restriction of bairdii to more southerly waters, probably as an indirect result of a change in water temperature, may have permitted delphis to move into inshore Californian waters. The Pacific population of D. delphis has a somewhat shorter rostrum than the Atlantic population, and is perhaps subspecifically different. A thorough analysis of the entire genus Delphinus is needed before the relationship of all the populations can be understood and names properly applied.

Structured reporting for fibrosing lung disease: a model shared by radiologist and pulmonologist.

PubMed

Sverzellati, Nicola; Odone, Anna; Silva, Mario; Polverosi, Roberta; Florio, Carlo; Cardinale, Luciano; Cortese, Giancarlo; Addonisio, Giancarlo; Zompatori, Maurizio; Dalpiaz, Giorgia; Piciucchi, Sara; Larici, Anna Rita

2018-04-01

To apply the Delphi exercise with iterative involvement of radiologists and pulmonologists with the aim of defining a structured reporting template for high-resolution computed tomography (HRCT) of patients with fibrosing lung disease (FLD). The writing committee selected the HRCT criteria-the Delphi items-for rating from both radiology panelists (RP) and pulmonology panelists (PP). The Delphi items were first rated by RPs as "essential", "optional", or "not relevant". The items rated "essential" by < 80% of the RP were selected for the PP rating. The format of reporting was rated by both RP and PP. A total of 42 RPs and 12 PPs participated to the survey. In both Delphi round 1 and 2, 10/27 (37.7%) items were rated "essential" by more than 80% of RP. The remaining 17/27 (63.3%) items were rated by the PP in round 3, with 2/17 items (11.7%) rated "essential" by the PP. PP proposed additional items for conclusion domain, which were rated by RPs in the fourth round. Poor consensus was observed for the format of reporting. This study provides a template for structured report of FLD that features essential items as agreed by expert thoracic radiologists and pulmonologists.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Consensus on the management of intracranial germ-cell tumours.

PubMed

Murray, Matthew J; Bartels, Ute; Nishikawa, Ryo; Fangusaro, Jason; Matsutani, Masao; Nicholson, James C

2015-09-01

The management of intracranial germ-cell tumours is complex because of varied clinical presentations, tumour sites, treatments and outcomes, and the need for multidisciplinary input. Participants of the 2013 Third International CNS Germ Cell Tumour Symposium (Cambridge, UK) agreed to undertake a multidisciplinary Delphi process to identify consensus in the clinical management of intracranial germ-cell tumours. 77 delegates from the symposium were selected as suitable experts in the field and were invited to participate in the Delphi survey, of which 64 (83%) responded to the invitation. Invited participants represented multiple disciplines from Asia, Australasia, Europe, and the Americas. 38 consensus statements encompassing aspects of intracranial germ-cell tumour work-up, staging, treatment, and follow-up were prepared. To achieve consensus, statements required at least 70% agreement from at least 60% of respondents. Overall, 34 (89%) of 38 statements met consensus criteria. This international Delphi approach has defined key areas of consensus that will help guide and streamline clinical management of patients with intracranial germ-cell tumours. Additionally, the Delphi approach identified areas of different understanding and clinical practice internationally in the management of these tumours, areas which should be the focus of future collaborative studies. Such efforts should translate into improved patient outcomes. Copyright © 2015 Elsevier Ltd. All rights reserved.

An opportunity in difficulty: Japan-Korea-Taiwan expert Delphi consensus on surgical difficulty during laparoscopic cholecystectomy.

PubMed

Iwashita, Yukio; Hibi, Taizo; Ohyama, Tetsuji; Honda, Goro; Yoshida, Masahiro; Miura, Fumihiko; Takada, Tadahiro; Han, Ho-Seong; Hwang, Tsann-Long; Shinya, Satoshi; Suzuki, Kenji; Umezawa, Akiko; Yoon, Yoo-Seok; Choi, In-Seok; Huang, Wayne Shih-Wei; Chen, Kuo-Hsin; Watanabe, Manabu; Abe, Yuta; Misawa, Takeyuki; Nagakawa, Yuichi; Yoon, Dong-Sup; Jang, Jin-Young; Yu, Hee Chul; Ahn, Keun Soo; Kim, Song Cheol; Song, In Sang; Kim, Ji Hoon; Yun, Sung Su; Choi, Seong Ho; Jan, Yi-Yin; Shan, Yan-Shen; Ker, Chen-Guo; Chan, De-Chuan; Wu, Cheng-Chung; Lee, King-Teh; Toyota, Naoyuki; Higuchi, Ryota; Nakamura, Yoshiharu; Mizuguchi, Yoshiaki; Takeda, Yutaka; Ito, Masahiro; Norimizu, Shinji; Yamada, Shigetoshi; Matsumura, Naoki; Shindoh, Junichi; Sunagawa, Hiroki; Gocho, Takeshi; Hasegawa, Hiroshi; Rikiyama, Toshiki; Sata, Naohiro; Kano, Nobuyasu; Kitano, Seigo; Tokumura, Hiromi; Yamashita, Yuichi; Watanabe, Goro; Nakagawa, Kunitoshi; Kimura, Taizo; Yamakawa, Tatsuo; Wakabayashi, Go; Mori, Rintaro; Endo, Itaru; Miyazaki, Masaru; Yamamoto, Masakazu

2017-04-01

We previously identified 25 intraoperative findings during laparoscopic cholecystectomy (LC) as potential indicators of surgical difficulty per nominal group technique. This study aimed to build a consensus among expert LC surgeons on the impact of each item on surgical difficulty. Surgeons from Japan, Korea, and Taiwan (n = 554) participated in a Delphi process and graded the 25 items on a seven-stage scale (range, 0-6). Consensus was defined as (1) the interquartile range (IQR) of overall responses ≤2 and (2) ≥66% of the responses concentrated within a median ± 1 after stratification by workplace and LC experience level. Response rates for the first and the second-round Delphi were 92.6% and 90.3%, respectively. Final consensus was reached for all the 25 items. 'Diffuse scarring in the Calot's triangle area' in the 'Factors related to inflammation of the gallbladder' category had the strongest impact on surgical difficulty (median, 5; IQR, 1). Surgeons agreed that the surgical difficulty increases as more fibrotic change and scarring develop. The median point for each item was set as the difficulty score. A Delphi consensus was reached among expert LC surgeons on the impact of intraoperative findings on surgical difficulty. © 2017 Japanese Society of Hepato-Biliary-Pancreatic Surgery.

Return to play after hamstring injuries in football (soccer): a worldwide Delphi procedure regarding definition, medical criteria and decision-making.

PubMed

van der Horst, Nick; Backx, Fjg; Goedhart, Edwin A; Huisstede, Bionka Ma

2017-11-01

There are three major questions about return to play (RTP) after hamstring injuries: How should RTP be defined? Which medical criteria should support the RTP decision? And who should make the RTP decision? The study aimed to provide a clear RTP definition and medical criteria for RTP and to clarify RTP consultation and responsibilities after hamstring injury. The study used the Delphi procedure. The results of a systematic review were used as a starting point for the Delphi procedure. Fifty-eight experts in the field of hamstring injury management selected by 28 FIFA Medical Centres of Excellence worldwide participated. Each Delphi round consisted of a questionnaire, an analysis and an anonymised feedback report. After four Delphi rounds, with more than 83% response for each round, consensus was achieved that RTP should be defined as 'the moment a player has received criteria-based medical clearance and is mentally ready for full availability for match selection and/or full training'. The experts reached consensus on the following criteria to support the RTP decision: medical staff clearance, absence of pain on palpation, absence of pain during strength and flexibility testing, absence of pain during/after functional testing, similar hamstring flexibility, performance on field testing, and psychological readiness. It was also agreed that RTP decisions should be based on shared decision-making, primarily via consultation with the athlete, sports physician, physiotherapist, fitness trainer and team coach. The consensus regarding aspects of RTP should provide clarity and facilitate the assessment of when RTP is appropriate after hamstring injury, so as to avoid or reduce the risk of injury recurrence because of a premature RTP. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Defining and identifying concepts of medication literacy: An international perspective.

PubMed

Pouliot, Annie; Vaillancourt, Régis; Stacey, Danielle; Suter, Philippe

2017-11-08

Multiple concepts to define health literacy in the context of medication use exist, such as medication literacy, pharmacotherapy literacy, pharmacy health literacy; however, no studies have looked at consensus among experts internationally. A Delphi process was used to achieve consensus on the statements about medication literacy. Experts for the Delphi were selected from a review of the literature and suggestions from an international survey conducted with members of the International Pharmaceutical Federation on medication literacy. The preliminary Delphi questionnaire was built using the statements about medication literacy found in the scientific literature. Responses and comments were analyzed using a pre-established method and communicated to the experts after each round of Delphi. Statements with an agreement of at least 80% were accepted and used to develop a definition of medication literacy. The Delphi process started with 21 experts and included 4 rounds. Overall, 30 statements regarding medication literacy were accepted and divided into 4 clusters representing: (1) type of information necessary for optimal and safe use of medication, (2) skills and abilities, (3) format of information, and (4) outcomes. These statements were used to propose 2 different definitions of medication literacy. One of the definitions was preferred by 75% of the expert panel, which provided further comments for improvements. Of the 11 experts who answered the final questionnaire, nine strongly agreed with the refined definition. Medication literacy is the degree to which individuals can obtain, comprehend, communicate, calculate and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g. written, oral and visual). Future studies should focus on how this definition can be operationalized to support the role that pharmacists and other healthcare providers. Copyright © 2017 Elsevier Inc. All rights reserved.

Revised Conceptual Framework of Parent-to-Parent Support for Parents of Children Who Are Deaf or Hard of Hearing: A Modified Delphi Study.

PubMed

Henderson, Rebecca J; Johnson, Andrew M; Moodie, Sheila T

2016-06-01

A scoping review of the literature was conducted, resulting in the development of a conceptual framework of parent-to-parent support for parents with children who are Deaf or hard of hearing. This is the 2nd stage of a dual-stage scoping review. This study sought stakeholder opinion and feedback with an aim to achieve consensus on the constructs, components, and design of the initial conceptual framework. A modified electronic Delphi study was completed with 21 handpicked experts from 7 countries who have experience in provision, research, or experience in the area of parent-to-parent support. Participants completed an online questionnaire using an 11-point Likert scale (strongly disagree to strongly agree) and open-ended questions to answer various questions related to the descriptor terms, definitions, constructs, components, and overall design of the framework. Participant responses led to the revision of the original conceptual framework. The findings from this dual-stage scoping review and electronic Delphi study provide a conceptual framework that defines the vital contribution of parents in Early Hearing Detection and Intervention programs that will be a useful addition to these programs.

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

Prioritizing Measures of Digital Patient Engagement: A Delphi Expert Panel Study

PubMed Central

2017-01-01

Background Establishing a validated scale of patient engagement through use of information technology (ie, digital patient engagement) is the first step to understanding its role in health and health care quality, outcomes, and efficient implementation by health care providers and systems. Objective The aim of this study was to develop and prioritize measures of digital patient engagement based on patients’ use of the US Department of Veterans Affairs (VA)’s MyHealtheVet (MHV) portal, focusing on the MHV/Blue Button and Secure Messaging functions. Methods We aligned two models from the information systems and organizational behavior literatures to create a theory-based model of digital patient engagement. On the basis of this model, we conducted ten key informant interviews to identify potential measures from existing VA studies and consolidated the measures. We then conducted three rounds of modified Delphi rating by 12 national eHealth experts via Web-based surveys to prioritize the measures. Results All 12 experts completed the study’s three rounds of modified Delphi ratings, resulting in two sets of final candidate measures representing digital patient engagement for Secure Messaging (58 measures) and MHV/Blue Button (71 measures). These measure sets map to Donabedian’s three types of quality measures: (1) antecedents (eg, patient demographics); (2) processes (eg, a novel measure of Web-based care quality); and (3) outcomes (eg, patient engagement). Conclusions This national expert panel study using a modified Delphi technique prioritized candidate measures to assess digital patient engagement through patients’ use of VA’s My HealtheVet portal. The process yielded two robust measures sets prepared for future piloting and validation in surveys among Veterans. PMID:28550008

[University studies plan in geriatric medicine developed using a modified Delphi technique].

PubMed

Vilches-Moraga, Arturo; Ariño-Blasco, Sergio; Verdejo-Bravo, Carlos; Mateos-Nozal, Jesús

2015-01-01

The increase in the number of frail elderly people has led to the necessity that all doctors of the future acquire sufficient knowledge on human ageing and the skills in the management of the patient of advanced age, as well as the diseases associated with ageing. Few countries offer geriatric medicine within undergraduate training. The purpose of the present project was to obtain a consensus between European geriatricians on the minimum requirements that medical students must achieve at the end of their university degree course. A modified Delphi process was used. Firstly, experts in education and geriatrics proposed a set of learning objectives based on a review of the literature. Three Delphi rounds were then performed, in which a panel of 49 experts representing 29 countries affiliated to the European Union of Medical Specialists took part. This enabled them to reach a consensus on a definitive study plan. The number of disagreements after the Delphi rounds 1 and 2 were 81 and 53, respectively. Full agreement was reached after the third round. The definitive study plan consisted of detailed objectives grouped under 10 general training objectives. A consensus has been reached between European geriatricians that sets specific training objectives for medical students. Great efforts will be required for the introduction of these requirements, given the variability there is in the quality of teaching in geriatrics. This study plan is a first step in helping to improve geriatrics teaching in faculties of medicine, and will also serve as a basis to make advances in the training in post-graduate geriatrics throughout Europe. Copyright © 2014 SEGG. Published by Elsevier Espana. All rights reserved.

Defining the Bobath concept using the Delphi technique.

PubMed

Raine, Sue

2006-03-01

The Bobath concept, based on the work of Berta and Karel Bobath, offers therapists working in the field of neurological rehabilitation a framework for their clinical interventions. It is the most commonly used approach in the UK. Although they recognize that over the last half-century the concept has undergone considerable developments, proponents of the Bobath concept have been criticized for not publishing these changes. The aim of the present study was to use the Delphi technique to enable experts in the field to define the current Bobath concept. A four-round Delphi study design was used. The sample included all members of the British Bobath Tutor's Association, who are considered experts in the field. Initial statements were identified from the literature, with respondents generating additional statements during the study. The level of agreement was determined using a five-point Likert scale. The respondents were then provided with feedback on group opinions and given an opportunity to re-rate each statement. The level of group consensus was set at 80%. Fifteen experts took part. The response rate was 85% in the first round, and 93% in each subsequent round. Ten statements from the literature were rated with a further 12 generated by the experts. Thirteen statements achieved consensus for agreement and seven for disagreement. The Delphi study was an effective research tool, maintaining anonymity of responses and exploring expert opinions on the Bobath concept. The experts stated that Bobath's work has been misunderstood if it is considered as the inhibition of spasticity and the facilitation of normal movement, as described in some literature. They agreed that the Bobath concept was developed by the Bobaths as a living concept, understanding that as therapists' knowledge base grows their view of treatment broadens.

The scientifically substantiated art of teaching: A study in the development of standards in the new academic field of neuroeducation (mind, brain, and education science)

NASA Astrophysics Data System (ADS)

Tokuhama-Espinosa, Tracey Noel

Concepts from neuroeducation, commonly referred in the popular press as "brain-based learning," have been applied indiscreetly and inconsistently to classroom teaching practices for many years. While standards exist in neurology, psychology and pedagogy, there are no agreed upon standards in their intersection, neuroeducation, and a formal bridge linking the fields is missing. This study used grounded theory development to determine the parameters of the emerging neuroeducational field based on a meta-analysis of the literature over the past 30 years, which included over 2,200 documents. This research results in a new model for neuroeducation. The design of the new model was followed by a Delphi survey of 20 international experts from six different countries that further refined the model contents over several months of reflection. Finally, the revised model was compared to existing information sources, including popular press, peer review journals, academic publications, teacher training textbooks and the Internet, to determine to what extent standards in neuroeducation are met in the current literature. This study determined that standards in the emerging field, now labeled Mind, Brain, and Education: The Science of Teaching and Learning after the Delphi rounds, are the union of standards in the parent fields of neuroscience, psychology, and education. Additionally, the Delphi expert panel agreed upon the goals of the new discipline, its history, the thought leaders, and a model for judging quality information. The study culminated in a new model of the academic discipline of Mind, Brain, and Education science, which explains the tenets, principles and instructional guidelines supported by the meta-analysis of the literature and the Delphi response.

Using the Delphi method to develop nursing-sensitive quality indicators for the NICU.

PubMed

Chen, Lin; Huang, Li-Hua; Xing, Mei-Yuan; Feng, Zhi-Xian; Shao, Le-Wen; Zhang, Mei-Yun; Shao, Rong-Ya

2017-02-01

To develop nursing-sensitive quality indicators consistent with current medical practices in Chinese neonatal intensive care units. The development of nursing-sensitive quality indicators has become a top priority in nursing management. To the best of our knowledge, there has been no objective, scientific and sensitive evaluation of the quality of neonatal intensive care unit nursing in China. A modified Delphi technique was used to seek opinions from experts about what should be used and prioritised as indicators of quality care in neonatal intensive care unit nursing. Based on a literature review, we identified 21 indicators of nursing-sensitive quality in the neonatal intensive care unit. Our group of 11 consultants chose 13 indicators to be discussed using the Delphi method. In October and November 2014, 39 neonatal intensive care unit experts in 18 tertiary hospitals spread across six provinces participated in two rounds of Delphi panels. Of the 13 indicators discussed, 11 were identified as indicators of nursing-sensitive quality in the neonatal intensive care unit: rate of nosocomial infections, rate of accidental endotracheal extubation, rate of errors in medication administration, rate of treatment for pain, rate of peripheral venous extravasation, rate of compliance with handwashing techniques, incidence of pressure ulcers, incidence of noise, the bed-to-care ratio, the proportion of nurses with greater than five years neonatal intensive care unit experience and incidence of retinopathy. The 11 neonatal intensive care unit nursing-sensitive indicators identified by the Delphi method integrated with basic Chinese practices provide a basis for nursing management and the monitoring of nursing quality. This study identified nursing-sensitive quality indicators for neonatal intensive care unit care that are suitable for current clinical practice in China. © 2016 John Wiley & Sons Ltd.

Evaluating the construct of triage acuity against a set of reference vignettes developed via modified Delphi method.

PubMed

Twomey, Michèle; Wallis, Lee A; Myers, Jonathan E

2014-07-01

To evaluate the construct of triage acuity as measured by the South African Triage Scale (SATS) against a set of reference vignettes. A modified Delphi method was used to develop a set of reference vignettes. Delphi participants completed a 2-round consensus-building process, and independently assigned triage acuity ratings to 100 written vignettes unaware of the ratings given by others. Triage acuity ratings were summarised for all vignettes, and only those that reached 80% consensus during round 2 were included in the reference set. Triage ratings for the reference vignettes given by two independent experts using the SATS were compared with the ratings given by the international Delphi panel. Measures of sensitivity, specificity, associated percentages for over-triage/under-triage were used to evaluate the construct of triage acuity (as measured by the SATS) by examining the association between the ratings by the two experts and the international panel. On completion of the Delphi process, 42 of the 100 vignettes reached 80% consensus on their acuity rating and made up the reference set. On average, over all acuity levels, sensitivity was 74% (CI 64% to 82%), specificity 92% (CI 87% to 94%), under-triage occurred 14% (CI 8% to 23%) and over-triage 12% (CI 8% to 23%) of the time. The results of this study provide an alternative to evaluating triage scales against the construct of acuity as measured with the SATS. This method of using 80% consensus vignettes may, however, systematically bias the validity estimate towards better performance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Alchemy of the Oracle: The Delphi Technique.

ERIC Educational Resources Information Center

Wilhelm, William J.

2001-01-01

Discusses the origins and foundations of the Delphi technique. Outlines procedures for using it in research to obtain the insights of experts. Addresses limitations of the technique. (Contains 44 references.) (SK)

Environmental initiative prioritization with a Delphi approach: a case study.

PubMed

Gokhale, A A

2001-08-01

India is fast finding its place in the industrialized world and that is beginning to raise its environmental consciousness. The Delphi technique was used to prioritize specific needs and articulate a sustainable urban improvement strategy for the city of Mumbai (formerly Bombay). The Delphi technique is a means of achieving consensual validity among raters by providing them feedback regarding other raters' responses. Mumbai has several indigenous environmental groups that were tapped for activists and leaders; the study was conducted using ten environmentalists. In the initial phases the responses resulted in a range of possible program alternatives. The last two stages helped to seek out information that generated a consensus on the part of the respondent group. Statistical analysis methods included a hierarchical cluster analysis, mean, median, mode, and percent of agreement calculations using SPSS software. The face-to-face discussion in phase 4 clarified some issues and helped the group as a whole to outline the strategy for putting in place the essential elements of a framework to improve the quality of life in an urban environment.

Nursing Information Systems Requirements: A Milestone for Patient Outcome and Patient Safety Improvement.

PubMed

Farzandipour, Mehrdad; Meidani, Zahra; Riazi, Hossein; Sadeqi Jabali, Monireh

2016-12-01

Considering the integral role of understanding users' requirements in information system success, this research aimed to determine functional requirements of nursing information systems through a national survey. Delphi technique method was applied to conduct this study through three phases: focus group method modified Delphi technique and classic Delphi technique. A cross-sectional study was conducted to evaluate the proposed requirements within 15 general hospitals in Iran. Forty-three of 76 approved requirements were clinical, and 33 were administrative ones. Nurses' mean agreements for clinical requirements were higher than those of administrative requirements; minimum and maximum means of clinical requirements were 3.3 and 3.88, respectively. Minimum and maximum means of administrative requirements were 3.1 and 3.47, respectively. Research findings indicated that those information system requirements that support nurses in doing tasks including direct care, medicine prescription, patient treatment management, and patient safety have been the target of special attention. As nurses' requirements deal directly with patient outcome and patient safety, nursing information systems requirements should not only address automation but also nurses' tasks and work processes based on work analysis.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method

PubMed Central

Yeh, James S.; Van Hoof, Thomas J.; Fischer, Michael A.

2016-01-01

Background Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. Objective To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. Methods This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. Results The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Conclusion Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process. PMID:27066195

The use of qualitative methods to inform Delphi surveys in core outcome set development.

PubMed

Keeley, T; Williamson, P; Callery, P; Jones, L L; Mathers, J; Jones, J; Young, B; Calvert, M

2016-05-04

Core outcome sets (COS) help to minimise bias in trials and facilitate evidence synthesis. Delphi surveys are increasingly being used as part of a wider process to reach consensus about what outcomes should be included in a COS. Qualitative research can be used to inform the development of Delphi surveys. This is an advance in the field of COS development and one which is potentially valuable; however, little guidance exists for COS developers on how best to use qualitative methods and what the challenges are. This paper aims to provide early guidance on the potential role and contribution of qualitative research in this area. We hope the ideas we present will be challenged, critiqued and built upon by others exploring the role of qualitative research in COS development. This paper draws upon the experiences of using qualitative methods in the pre-Delphi stage of the development of three different COS. Using these studies as examples, we identify some of the ways that qualitative research might contribute to COS development, the challenges in using such methods and areas where future research is required. Qualitative research can help to identify what outcomes are important to stakeholders; facilitate understanding of why some outcomes may be more important than others, determine the scope of outcomes; identify appropriate language for use in the Delphi survey and inform comparisons between stakeholder data and other sources, such as systematic reviews. Developers need to consider a number of methodological points when using qualitative research: specifically, which stakeholders to involve, how to sample participants, which data collection methods are most appropriate, how to consider outcomes with stakeholders and how to analyse these data. A number of areas for future research are identified. Qualitative research has the potential to increase the research community's confidence in COS, although this will be dependent upon using rigorous and appropriate methodology. We have begun to identify some issues for COS developers to consider in using qualitative methods to inform the development of Delphi surveys in this article.

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

Using a Delphi Method to Identify Human Factors Contributing to Nursing Errors.

PubMed

Roth, Cheryl; Brewer, Melanie; Wieck, K Lynn

2017-07-01

The purpose of this study was to identify human factors associated with nursing errors. Using a Delphi technique, this study used feedback from a panel of nurse experts (n = 25) on an initial qualitative survey questionnaire followed by summarizing the results with feedback and confirmation. Synthesized factors regarding causes of errors were incorporated into a quantitative Likert-type scale, and the original expert panel participants were queried a second time to validate responses. The list identified 24 items as most common causes of nursing errors, including swamping and errors made by others that nurses are expected to recognize and fix. The responses provided a consensus top 10 errors list based on means with heavy workload and fatigue at the top of the list. The use of the Delphi survey established consensus and developed a platform upon which future study of nursing errors can evolve as a link to future solutions. This list of human factors in nursing errors should serve to stimulate dialogue among nurses about how to prevent errors and improve outcomes. Human and system failures have been the subject of an abundance of research, yet nursing errors continue to occur. © 2016 Wiley Periodicals, Inc.

Survey indicated that core outcome set development is increasingly including patients, being conducted internationally and using Delphi surveys.

PubMed

Biggane, Alice M; Brading, Lucy; Ravaud, Philippe; Young, Bridget; Williamson, Paula R

2018-02-17

There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas

PubMed Central

Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-01-01

Introduction The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. Methods and analysis We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. Ethics and dissemination We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. PMID:28780546

A DELPHI STUDY OF RISK FACTORS FOR ACHILLES TENDINOPATHY- OPINIONS OF WORLD TENDON EXPERTS

PubMed Central

Watson, Paul J.; Barry, Simon

2016-01-01

Background and Purpose Achilles tendinopathy can be a debilitating chronic condition for both active and inactive individuals. The identification of risk facors is important both in preventing but also treating tendinopathy, many factors have been proposed but there is a lack of primary epidemiological data. The purpose of this study was to develop a statement of expert consensus on risk factors for Achilles tendinopathy in active and sedentary patient populations to inform a primary epidemiological study. Study design Delphi study Methods and Measures An online Delphi study was completed inviting participation from world tendon experts. The consensus was developed using three rounds of the Delphi technique. The first round developed a complete list of potential risk factors, the second round refined this list but also separated the factors into two population groups – active/athletic and inactive/sedentary. The third round ranked this list in order of perceived importance. Results Forty-four experts were invited to participate, 16 participated in the first round (response rate 40%) and two dropped out in the second round (resulting in a response rate of 35%). A total of 27 intrinsic and eight extrinsic risk factors were identified during round one. During round two only 12 intrinsic and five extrinsic risk factors were identified as important in active/athletic tendinopathy while 14 intrinsic and three extrinsic factors were identified as important for inactive/sedentary tendinopathy. Conclusions Risk factors for Achilles tendinopathy were identified based on expert consensus, and these factors provide a basis for primary epidemiological studies. Plantarflexor strength was identified as the primary modifiable factor in the active/athletic group while systemic factors were identified as important in the inactive/sedentary group, many of the potential factors suggested for either group were non-modifiable. Non-modifiable factors include: previous tendinopathy, previous injury, advancing age, sex, steroid exposure, and antibiotic treatment. Level of evidence Level V PMID:27757281

Control Strategies for HCCI Mixed-Mode Combustion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wagner, Robert M; Edwards, Kevin Dean

2010-03-01

Delphi Automotive Systems and ORNL established this CRADA to expand the operational range of Homogenous Charge Compression Ignition (HCCI) mixed-mode combustion for gasoline en-gines. ORNL has extensive experience in the analysis, interpretation, and control of dynamic engine phenomena, and Delphi has extensive knowledge and experience in powertrain compo-nents and subsystems. The partnership of these knowledge bases was important to address criti-cal barriers associated with the realistic implementation of HCCI and enabling clean, efficient operation for the next generation of transportation engines. The foundation of this CRADA was established through the analysis of spark-assisted HCCI data from a single-cylinder research engine.more » This data was used to (1) establish a conceptual kinetic model to better understand and predict the development of combustion instabilities, (2) develop a low-order model framework suitable for real-time controls, and (3) provide guidance in the initial definition of engine valve strategies for achieving HCCI operation. The next phase focused on the development of a new combustion metric for real-time characterization of the combustion process. Rapid feedback on the state of the combustion process is critical to high-speed decision making for predictive control. Simultaneous to the modeling/analysis studies, Delphi was focused on the development of engine hardware and the engine management system. This included custom Delphi hardware and control systems allowing for flexible control of the valvetrain sys-tem to enable HCCI operation. The final phase of this CRADA included the demonstration of conventional and spark assisted HCCI on the multi-cylinder engine as well as the characterization of combustion instabilities, which govern the operational boundaries of this mode of combustion. ORNL and Delphi maintained strong collaboration throughout this project. Meetings were held on a bi-weekly basis with additional reports, presentation, and meetings as necessary to maintain progress. Delphi provided substantial support through modeling, hardware, data exchange, and technical consultation. This CRADA was also successful at establishing important next steps to further expanding the use of an HCCI engine for improved fuel efficiency and emissions. These topics will be address in a follow-on CRADA. The objectives are: (1) Improve fundamental understanding of the development of combustion instabilities with HCCI operation through modeling and experiments; (2) Develop low-order model and feedback combustion metrics which are well suited to real-time predictive controls; and (3) Construct multi-cylinder engine system with advanced Delphi technologies and charac-terize HCCI behavior to better understand limitations and opportunities for expanded high-efficiency operation.« less

Developing Quality Indicators for Family Support Services in Community Team-Based Mental Health Care

PubMed Central

Olin, S. Serene; Kutash, Krista; Pollock, Michele; Burns, Barbara J.; Kuppinger, Anne; Craig, Nancy; Purdy, Frances; Armusewicz, Kelsey; Wisdom, Jennifer; Hoagwood, Kimberly E.

2013-01-01

Quality indicators for programs integrating parent-delivered family support services for children’s mental health have not been systematically developed. Increasing emphasis on accountability under the Affordable Care Act highlights the importance of quality-benchmarking efforts. Using a modified Delphi approach, quality indicators were developed for both program level and family support specialist level practices. These indicators were pilot tested with 21 community-based mental health programs. Psychometric properties of these indicators are reported; variations in program and family support specialist performance suggest the utility of these indicators as tools to guide policies and practices in organizations that integrate parent-delivered family support service components. PMID:23709287

Core outcome sets for prevention and treatment of postpartum haemorrhage: an international Delphi consensus study.

PubMed

Meher, Shireen; Cuthbert, Anna; Kirkham, Jamie J; Williamson, Paula; Abalos, Edgardo; Aflaifel, Nasreen; Bhutta, Zulfiqar A; Bishop, Alina; Blum, Jennifer; Collins, Peter; Devane, Declan; Ducloy-Bouthors, Anne-Sophie; Fawole, Bukola; Gülmezoglu, A Metin; Gutteridge, Kathryn; Gyte, Gill; Homer, Caroline S E; Mallaiah, Shuba; Smith, Jeffrey M; Weeks, Andrew D; Alfirevic, Zarko

2018-06-19

To develop core outcome sets (COS) for studies evaluating interventions for (1) prevention and (2) treatment of PPH, and recommendations on how to report the COS. A two-round Delphi survey and face-to-face meeting. Health care professionals and women's representatives. Outcomes were identified from systematic reviews of PPH studies and stakeholder consultation. Participants scored each outcome in the Delphi on a Likert scale between 1 (not important) and 9 (critically important). Results were discussed at the face-to-face meeting to agree the final COS. Consensus at the meeting was defined as ≥ 70% of participants scoring the outcome as critically important (7-9). Lectures, discussion and voting were used to agree how to report COS outcomes. outcomes from systematic reviews and consultations. Both Delphi rounds were completed by 152/205 (74%) participants for prevention and 143/197 (73%) for treatment. For prevention of PPH, nine core outcomes were selected: blood loss, shock, maternal death, use of additional uterotonics, blood transfusion, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. For treatment of PPH, 12 core outcomes were selected: blood loss, shock, coagulopathy, hysterectomy, organ dysfunction, maternal death, blood transfusion, use of additional haemostatic intervention, transfer for higher level of care, women's sense of wellbeing, acceptability and satisfaction with the intervention, breastfeeding and adverse effects. Recommendations were developed on how to report these outcomes where possible. These COS will help standardise outcome reporting in PPH trials. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Evaluating methods to establish habitat suitability criteria: A case study in the upper Delaware River Basin, USA

USGS Publications Warehouse

Galbraith, Heather S.; Blakeslee, Carrie J.; Cole, Jeffrey C.; Talbert, Colin; Maloney, Kelly O.

2016-01-01

Defining habitat suitability criteria (HSC) of aquatic biota can be a key component to environmental flow science. HSC can be developed through numerous methods; however, few studies have evaluated the consistency of HSC developed by different methodologies. We directly compared HSC for depth and velocity developed by the Delphi method (expert opinion) and by two primary literature meta-analyses (literature-derived range and interquartile range) to assess whether these independent methods produce analogous criteria for multiple species (rainbow trout, brown trout, American shad, and shallow fast guild) and life stages. We further evaluated how these two independently developed HSC affect calculations of habitat availability under three alternative reservoir management scenarios in the upper Delaware River at a mesohabitat (main channel, stream margins, and flood plain), reach, and basin scale. In general, literature-derived HSC fell within the range of the Delphi HSC, with highest congruence for velocity habitat. Habitat area predicted using the Delphi HSC fell between the habitat area predicted using two literature-derived HSC, both at the basin and the site scale. Predicted habitat increased in shallow regions (stream margins and flood plain) using literature-derived HSC while Delphi-derived HSC predicted increased channel habitat. HSC generally favoured the same reservoir management scenario; however, no favoured reservoir management scenario was the most common outcome when applying the literature range HSC. The differences found in this study lend insight into how different methodologies can shape HSC and their consequences for predicted habitat and water management decisions. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

Guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trial Protocols: The SPIRIT-PRO Extension.

PubMed

Calvert, Melanie; Kyte, Derek; Mercieca-Bebber, Rebecca; Slade, Anita; Chan, An-Wen; King, Madeleine T; Hunn, Amanda; Bottomley, Andrew; Regnault, Antoine; Chan, An-Wen; Ells, Carolyn; O'Connor, Daniel; Revicki, Dennis; Patrick, Donald; Altman, Doug; Basch, Ethan; Velikova, Galina; Price, Gary; Draper, Heather; Blazeby, Jane; Scott, Jane; Coast, Joanna; Norquist, Josephine; Brown, Julia; Haywood, Kirstie; Johnson, Laura Lee; Campbell, Lisa; Frank, Lori; von Hildebrand, Maria; Brundage, Michael; Palmer, Michael; Kluetz, Paul; Stephens, Richard; Golub, Robert M; Mitchell, Sandra; Groves, Trish

2018-02-06

Patient-reported outcome (PRO) data from clinical trials can provide valuable evidence to inform shared decision making, labeling claims, clinical guidelines, and health policy; however, the PRO content of clinical trial protocols is often suboptimal. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was published in 2013 and aims to improve the completeness of trial protocols by providing evidence-based recommendations for the minimum set of items to be addressed, but it does not provide PRO-specific guidance. To develop international, consensus-based, PRO-specific protocol guidance (the SPIRIT-PRO Extension). The SPIRIT-PRO Extension was developed following the Enhancing Quality and Transparency of Health Research (EQUATOR) Network's methodological framework for guideline development. This included (1) a systematic review of existing PRO-specific protocol guidance to generate a list of potential PRO-specific protocol items (published in 2014); (2) refinements to the list and removal of duplicate items by the International Society for Quality of Life Research (ISOQOL) Protocol Checklist Taskforce; (3) an international stakeholder survey of clinical trial research personnel, PRO methodologists, health economists, psychometricians, patient advocates, funders, industry representatives, journal editors, policy makers, ethicists, and researchers responsible for evidence synthesis (distributed by 38 international partner organizations in October 2016); (4) an international Delphi exercise (n = 137 invited; October 2016 to February 2017); and (5) consensus meeting (n = 30 invited; May 2017). Prior to voting, consensus meeting participants were informed of the results of the Delphi exercise and given data from structured reviews evaluating the PRO protocol content of 3 defined samples of trial protocols. The systematic review identified 162 PRO-specific protocol recommendations from 54 sources. The ISOQOL Taskforce (n = 21) reduced this to 56 items, which were considered by 138 international stakeholder survey participants and 99 Delphi panelists. The final wording of the SPIRIT-PRO Extension was agreed on at a consensus meeting (n = 29 participants) and reviewed by external group of experts during a consultation period. Eleven extensions and 5 elaborations to the SPIRIT 2013 checklist were recommended for inclusion in clinical trial protocols in which PROs are a primary or key secondary outcome. Extension items focused on PRO-specific issues relating to the trial rationale, objectives, eligibility criteria, concepts used to evaluate the intervention, time points for assessment, PRO instrument selection and measurement properties, data collection plan, translation to other languages, proxy completion, strategies to minimize missing data, and whether PRO data will be monitored during the study to inform clinical care. The SPIRIT-PRO guidelines provide recommendations for items that should be addressed and included in clinical trial protocols in which PROs are a primary or key secondary outcome. Improved design of clinical trials including PROs could help ensure high-quality data that may inform patient-centered care.

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology.

PubMed

Melchiors, Jacob; Henriksen, Mikael Johannes Vuokko; Dikkers, Frederik G; Gavilán, Javier; Noordzij, J Pieter; Fried, Marvin P; Novakovic, Daniel; Fagan, Johannes; Charabi, Birgitte W; Konge, Lars; von Buchwald, Christian

2018-05-01

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis. We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool. FIFTY PANELISTS COMPLETED THE DELPHI PROCESS. THE MEDIAN AGE OF THE PANELISTS WAS 44 YEARS (RANGE 33-64 YEARS). MEDIAN EXPERIENCE IN OTORHINOLARYNGOLOGY WAS 15 YEARS (RANGE 6-35 YEARS). TWENTY-FIVE WERE SPECIALIZED IN LARYNGOLOGY, 16 WERE HEAD AND NECK SURGEONS, AND NINE WERE GENERAL OTORHINOLARYNGOLOGISTS. AN ASSESSMENT TOOL WAS CREATED CONSISTING OF TWELVE DISTINCT ITEMS.: Conclusion The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.

Development of the Austrian Nursing Minimum Data Set (NMDS-AT): the third Delphi Round, a quantitative online survey.

PubMed

Ranegger, Renate; Hackl, Werner O; Ammenwerth, Elske

2015-01-01

A Nursing Minimum Data Set (NMDS) aims at systematically describing nursing care in terms of patient problems, nursing activities, and patient outcomes. In an earlier Delphi study, 56 data elements were proposed to be included in an Austrian Nursing Minimum Data Set (NMDS-AT). To identify the most important data elements of this list, and to identify appropriate coding systems. Online Delphi-based survey with 88 experts. 43 data elements were rated as relevant for an NMDS-AT (strong agreement of more than half of the experts): nine data elements concerning the institution, patient demographics, and medical condition; 18 data elements concerning patient problems by using nursing diagnosis; seven data elements concerning nursing outcomes, and nine data elements concerning nursing interventions. As classification systems, national classification systems were proposed besides ICNP, NNN, and nursing-sensitive indicators. The resulting proposal for an NMDS-AT will now be tested with routine data.

MOMENT--Management of Otitis Media with Effusion in Cleft Palate: protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Harman, Nicola L; Bruce, Iain A; Callery, Peter; Tierney, Stephanie; Sharif, Mohammad Owaise; O'Brien, Kevin; Williamson, Paula R

2013-03-12

Cleft palate (CP) has an incidence of approximately 1 in 700. Children with CP are also susceptible to otitis media with effusion (OME), with approximately 90% experiencing nontrivial OME. There are several approaches to the management of OME in children with CP. The Management of Otitis Media with Effusion in Children with Cleft Palate (MOMENT) study is a feasibility study that includes the development of a core outcome set for use in future trials of the management of OME in children with CP. The MOMENT study will include a systematic review of the literature to identify a list of outcomes that have previously been reported. This list of outcomes will be used in a Delphi study with cleft clinicians. The Delphi study is anticipated to include three rounds. The first round will ask clinicians to score the outcome list and to add any outcomes they think are relevant. The second round involves presentation of scores according to stakeholder group and the opportunity for participants to rescore outcomes. To ensure that the opinion of parents and children are sought, qualitative interviews will be completed with a purposive sample in parallel. In the final round of the Delphi process, participants will be shown the distribution of scores, for each outcome, for all stakeholder groups separately as well as a summary of the results concerning outcomes from the qualitative interviews with parents. A final consensus meeting will be held with all stakeholders, including parents and children, to review outcomes. A core outcome set represents the minimum that should be measured in a clinical trial for a particular condition. The MOMENT study will aim to identify a core outcome set that can be used in future trials of the management of OME, improving the consistency of research in this clinical area.

Defining personal utility in genomics: A Delphi study.

PubMed

Kohler, J N; Turbitt, E; Lewis, K L; Wilfond, B S; Jamal, L; Peay, H L; Biesecker, L G; Biesecker, B B

2017-09-01

Individual genome sequencing results are valued by patients in ways distinct from clinical utility. Such outcomes have been described as components of "personal utility," a concept that broadly encompasses patient-endorsed benefits, that is operationally defined as non-clinical outcomes. No empirical delineation of these outcomes has been reported. To address this gap, we administered a Delphi survey to adult participants in a National Institute of Health (NIH) clinical exome study to extract the most highly endorsed outcomes constituting personal utility. Forty research participants responded to a Delphi survey to rate 35 items identified by a systematic literature review of personal utility. Two rounds of ranking resulted in 24 items that represented 14 distinct elements of personal utility. Elements most highly endorsed by participants were: increased self-knowledge, knowledge of "the condition," altruism, and anticipated coping. Our findings represent the first systematic effort to delineate elements of personal utility that may be used to anticipate participant expectation and inform genetic counseling prior to sequencing. The 24 items reported need to be studied further in additional clinical genome sequencing studies to assess generalizability in other populations. Further research will help to understand motivations and to predict the meaning and use of results. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Development of a methodology for strategic environmental assessment: application to the assessment of golf course installation policy in Taiwan.

PubMed

Chen, Ching-Ho; Wu, Ray-Shyan; Liu, Wei-Lin; Su, Wen-Ray; Chang, Yu-Min

2009-01-01

Some countries, including Taiwan, have adopted strategic environmental assessment (SEA) to assess and modify proposed policies, plans, and programs (PPPs) in the planning phase for pursuing sustainable development. However, there were only some sketchy steps focusing on policy assessment in the system of Taiwan. This study aims to develop a methodology for SEA in Taiwan to enhance the effectiveness associated with PPPs. The proposed methodology comprises an SEA procedure involving PPP management and assessment in various phases, a sustainable assessment framework, and an SEA management system. The SEA procedure is devised based on the theoretical considerations by systems thinking and the regulative requirements in Taiwan. The positive and negative impacts on ecology, society, and economy are simultaneously considered in the planning (including policy generation and evaluation), implementation, and control phases of the procedure. This study used the analytic hierarchy process, Delphi technique, and systems analysis to develop a sustainable assessment framework. An SEA management system was built based on geographic information system software to process spatial, attribute, and satellite image data during the assessment procedure. The proposed methodology was applied in the SEA of golf course installation policy in 2001 as a case study, which was the first SEA in Taiwan. Most of the 82 existing golf courses in 2001 were installed on slope lands and caused a serious ecological impact. Assessment results indicated that 15 future golf courses installed on marginal lands (including buffer zones, remedied lands, and wastelands) were acceptable because the comprehensive environmental (ecological, social, and economic) assessment value was better based on environmental characteristics and management regulations of Taiwan. The SEA procedure in the planning phase for this policy was completed but the implementation phase of this policy was not begun because the related legislation procedure could not be arranged due to a few senators' resistance. A self-review of the control phase was carried out in 2006 using this methodology. Installation permits for 12 courses on slope lands were terminated after 2001 and then 27 future courses could be installed on marginal lands. The assessment value of this policy using the data on ecological, social, and economic conditions from 2006 was higher than that using the data from 2001. The analytical results illustrate that the proposed methodology can be used to effectively and efficiently assist the related authorities for SEA.

Curriculum development for a national cardiotocography education program: a Delphi survey to obtain consensus on learning objectives.

PubMed

Thellesen, Line; Hedegaard, Morten; Bergholt, Thomas; Colov, Nina P; Hoegh, Stinne; Sorensen, Jette L

2015-08-01

To define learning objectives for a national cardiotocography (CTG) education program based on expert consensus. A three-round Delphi survey. One midwife and one obstetrician from each maternity unit in Denmark were appointed based on CTG teaching experience and clinical obstetric experience. Following national and international guidelines, the research group determined six topics as important when using CTG: fetal physiology, equipment, indication, interpretation, clinical management, and communication/responsibility. In the first Delphi round, participants listed one to five learning objectives within the predefined topics. Responses were analyzed by a directed approach to content analysis. Phrasing was modified in accordance with Bloom's taxonomy. In the second and third Delphi rounds, participants rated each objective on a five-point relevance scale. Consensus was predefined as objectives with a mean rating value of ≥ 3. A prioritized list of CTG learning objectives. A total of 42 midwives and obstetricians from 21 maternity units were invited to participate, of whom 26 completed all three Delphi rounds, representing 18 maternity units. The final prioritized list included 40 objectives. The highest ranked objectives emphasized CTG interpretation and clinical management. The lowest ranked objectives emphasized fetal physiology. Mean ratings of relevance ranged from 3.15 to 5.00. National consensus on CTG learning objectives was achieved using the Delphi methodology. This was an initial step in developing a valid CTG education program. A prioritized list of objectives will clarify which topics to emphasize in a CTG education program. © 2015 Nordic Federation of Societies of Obstetrics and Gynecology.

Improving care standards for patients with spinal trauma combining a modified e-Delphi process and stakeholder interviews: a study protocol.

PubMed

Sharwood, Lisa N; Stanford, Ralph; Middleton, James W; Burns, Brian; Joseph, Anthony; Flower, Oliver; Rigby, Oran; Ball, Jonathon; Dhaliwal, Shelly

2017-01-19

Around 300 people sustain a new traumatic spinal cord injury (TSCI) in Australia each year; a relatively low incidence injury with extremely high long-term associated costs. Care standards are inconsistent nationally, lacking in consensus across important components of care such as prehospital spinal immobilisation, timing of surgery and timeliness of transfer to specialist services. This study aims to develop 'expertly defined' and agreed standards of care across the majority of disciplines involved for these patients. A modified e-Delphi process will be used to gain consensus for best practice across specific clinical early care areas for the patient with TSCI; invited participants will include clinicians across Australia with relevant and significant expertise. A rapid literature review will identify available evidence, including any current guidelines from 2005 to 2015. Level and strength of evidence identified, including areas of contention, will be used to formulate the first round survey questions and statements. Participants will undertake 2-3 online survey rounds, responding anonymously to questionnaires regarding care practices and indicating their agreement or otherwise with practice standard statements. Relevant key stakeholders, including patients, will also be interviewed face to face. Ethics approval for this study was obtained by the NSW Population & Health Services Research Ethics Committee on 14 January 2016 (HREC/12/CIPHS/74). Seeking comprehensive understanding of how the variation in early care pathways and treatment can be addressed to achieve optimal patient outcomes and economic costs; the overall aim is the agreement to a consistent approach to the triage, treatment, transport and definitive care of acute TSCI victims. The agreed practice standards of care will inform the development of a Clinical Pathway with practice change strategies for implementation. These standards will offer a benchmark for state-wide and potentially national policy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

PubMed Central

Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

2013-01-01

Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020

Functioning in Women with Cervical Cancer in Brazil: the Perspective of Experts.

PubMed

Castaneda, Luciana; Bergmann, Anke; Castro, Shamyr; Koifman, Rosalina

2018-05-09

 The objective of this study was to identify the perspective of the specialists about functioning in women with cervical cancer (CC).  A study was conducted with specialists using the Delphi methodology. The specialist contacts were found in oncology organizations and associations, as well as in a referral hospital in the treatment of CC. The questions that the experts answered covered the biopsychosocial domains of the International Classification of Functioning, Disability and Health (ICF).  Twenty-five specialists participated in the study. The experts' responses generated 485 significant concepts. The categories that presented the highest frequencies of reporting by the specialists were health services, systems and policies; structure of the reproductive system; health professionals and sexual function.  Regarding the perception of the specialists, this study concluded that 24 categories of ICF are the most relevant in the context of functioning in women with CC. The results suggest that the biopsychosocial perspective was incorporated in the experts' perceptions about the functioning phenomenon in women with CC in Brazil. Thieme Revinter Publicações Ltda Rio de Janeiro, Brazil.

Management of problematic behaviours among individuals on long-term opioid therapy: protocol for a Delphi study

PubMed Central

Merlin, Jessica S; Young, Sarah R; Azari, Soraya; Becker, William C; Liebschutz, Jane M; Pomeranz, Jamie; Roy, Payel; Saini, Shalini; Starrels, Joanna L; Edelman, E Jennifer

2016-01-01

Introduction Given the sharp rise in opioid prescribing and heightened recognition of opioid addiction and overdose, opioid safety has become a priority. Clinical guidelines on long-term opioid therapy (LTOT) for chronic pain consistently recommend routine monitoring and screening for problematic behaviours. Yet, there is no consensus definition regarding what constitutes a problematic behaviour, and recommendations for appropriate management to inform front-line providers, researchers and policymakers are lacking. This creates a barrier to effective guideline implementation. Thus, our objective is to present the protocol for a Delphi study designed to: (1) elicit expert opinion to identify the most important problematic behaviours seen in clinical practice and (2) develop consensus on how these behaviours should be managed in the context of routine clinical care. Methods/analysis We will include clinical experts, defined as individuals who provide direct patient care to adults with chronic pain who are on LTOT in an ambulatory setting, and for whom opioid prescribing for chronic non-malignant pain is an area of expertise. The Delphi study will be conducted online in 4 consecutive rounds. Participants will be asked to list problematic behaviours and identify which behaviours are most common and challenging. They will then describe how they would manage the most frequently occurring common and challenging behaviours, rating the importance of each management strategy. Qualitative analysis will be used to categorise behaviours and management strategies, and consensus will be based on a definition established a priori. Ethics/dissemination This study has been approved by the Institutional Review Board (IRB) of the University of Alabama at Birmingham (UAB). This study will generate Delphi-based expert consensus on the management of problematic behaviours that arise in individuals on LTOT, which we will publish and disseminate to appropriate professional societies. Ultimately, our findings will provide guidance to front-line providers, researchers and policymakers. PMID:27154486

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

ESPACOMP Medication Adherence Reporting Guidelines (EMERGE): a reactive-Delphi study protocol

PubMed Central

Helmy, R; Zullig, L L; Dunbar-Jacob, J; Hughes, D A; Vrijens, B; Wilson, I B; De Geest, S

2017-01-01

Introduction Medication adherence is fundamental to achieving optimal patient outcomes. Reporting research on medication adherence suffers from some issues—including conceptualisation, measurement and data analysis—that thwart its advancement. Using the ABC taxonomy for medication adherence as the conceptual basis, a steering committee of members of the European Society for Patient Adherence, COMpliance, and Persistence (ESPACOMP) launched an initiative to develop ESPACOMP Medication Adherence Reporting Guidelines (EMERGE). This paper is a protocol for a Delphi study that aims to build consensus among a group of topic experts regarding an item list that will support developing EMERGE. Methods and analysis This study uses a reactive-Delphi design where a group of topic experts will be asked to rate the relevance and clarity of an initial list of items, in addition to suggesting further items and/or modifications of the initial items. The initial item list, generated by the EMERGE steering committee through a structured process, consists of 26 items distributed in 2 sections: 4 items representing the taxonomy-based minimum reporting criteria, and 22 items organised according to the common reporting sections. A purposive sample of experts will be selected from relevant disciplines and diverse geographical locations. Consensus will be achieved through predefined decision rules to keep, delete or modify the items. An iterative process of online survey rounds will be carried out until consensus is reached. Ethics and dissemination An ethics approval was not required for the study according to the Swiss federal act on research involving human beings. The participating experts will be asked to give an informed consent. The results of this Delphi study will feed into EMERGE, which will be disseminated through peer-reviewed publications and presentations at conferences. Additionally, the steering committee will encourage their endorsement by registering the guidelines at the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network and other relevant organisations. PMID:28188154

Assisting Australians with mental health problems and financial difficulties: a Delphi study to develop guidelines for financial counsellors, financial institution staff, mental health professionals and carers.

PubMed

Bond, Kathy S; Chalmers, Kathryn J; Jorm, Anthony F; Kitchener, Betty A; Reavley, Nicola J

2015-06-03

There is a strong association between mental health problems and financial difficulties. Therefore, people who work with those who have financial difficulties (financial counsellors and financial institution staff) need to have knowledge and helping skills relevant to mental health problems. Conversely, people who support those with mental health problems (mental health professionals and carers) may need to have knowledge and helping skills relevant to financial difficulties. The Delphi expert consensus method was used to develop guidelines for people who work with or support those with mental health problems and financial difficulties. A systematic review of websites, books and journal articles was conducted to develop a questionnaire containing items about the knowledge, skills and actions relevant to working with or supporting someone with mental health problems and financial difficulties. These items were rated over three rounds by five Australian expert panels comprising of financial counsellors (n = 33), financial institution staff (n = 54), mental health professionals (n = 31), consumers (n = 20) and carers (n = 24). A total of 897 items were rated, with 462 items endorsed by at least 80 % of members of each of the expert panels. These endorsed statements were used to develop a set of guidelines for financial counsellors, financial institution staff, mental health professionals and carers about how to assist someone with mental health problems and financial difficulties. A diverse group of expert panel members were able to reach substantial consensus on the knowledge, skills and actions needed to work with and support people with mental health problems and financial difficulties. These guidelines can be used to inform policy and practice in the financial and mental health sectors.

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

The Cardiovascular Health in Ambulatory Care Research Team performance indicators for the primary prevention of cardiovascular disease: a modified Delphi panel study.

PubMed

Tu, Jack V; Maclagan, Laura C; Ko, Dennis T; Atzema, Clare L; Booth, Gillian L; Johnston, Sharon; Tu, Karen; Lee, Douglas S; Bierman, Arlene; Hall, Ruth; Bhatia, R Sacha; Gershon, Andrea S; Tobe, Sheldon W; Sanmartin, Claudia; Liu, Peter; Chu, Anna

2017-04-25

High-quality ambulatory care can reduce cardiovascular disease risk, but important gaps exist in the provision of cardiovascular preventive care. We sought to develop a set of key performance indicators that can be used to measure and improve cardiovascular care in the primary care setting. As part of the Cardiovascular Health in Ambulatory Care Research Team initiative, we established a 14-member multidisciplinary expert panel to develop a set of indicators for measuring primary prevention performance in ambulatory cardiovascular care. We used a 2-stage modified Delphi panel process to rate potential indicators, which were identified from the literature and national cardiovascular organizations. The top-rated indicators were pilot tested to determine their measurement feasibility with the use of data routinely collected in the Canadian health care system. A set of 28 indicators of primary prevention performance were identified, which were grouped into 5 domains: risk factor prevalence, screening, management, intermediate outcomes and long-term outcomes. The indicators reflect the major cardiovascular risk factors including smoking, obesity, hypertension, diabetes, dyslipidemia and atrial fibrillation. All indicators were determined to be amenable to measurement with the use of population-based administrative (physician claims, hospital admission, laboratory, medication), survey or electronic medical record databases. The Cardiovascular Health in Ambulatory Care Research Team indicators of primary prevention performance provide a framework for the measurement of cardiovascular primary prevention efforts in Canada. The indicators may be used by clinicians, researchers and policy-makers interested in measuring and improving the prevention of cardiovascular disease in ambulatory care settings. Copyright 2017, Joule Inc. or its licensors.

5. A PHOTO IMAGE FROM THE WEST SIDEWALK LOOKING EAST ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

5. A PHOTO IMAGE FROM THE WEST SIDEWALK LOOKING EAST TOWARD THE ENTRY GATES AND PORTIONS OF RILEY PARK - Delphi Bridge on U.S. Route 421, Spanning Deer Creek at U.S. Route 421, Delphi, Carroll County, IN

Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

PubMed

Turner, S; Ollerhead, E; Cook, A

2017-10-09

In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and logistically challenging. Identifying such research priorities can be particularly challenging for complex public health problems as there is a need to consult a number of experts across disciplines and with a range of expertise. This study investigated the use of Delphi-like survey methods in identifying important research priorities relating to health inequalities and framing tractable research questions for topic areas identified. The study was conducted in two phases, both using Delphi-like survey methods. Firstly, public health professionals with an interest in health inequalities were asked to identify research priorities. Secondly academic researchers were asked to frame tractable research questions relating to the priorities identified. These research priorities identified using Delphi-like survey methods were subsequently compared to those identified using different methods. A total of 52 public health professionals and 21 academics across the United Kingdom agreed to take part. The response rates were high, from public health professionals across three survey rounds (69%, 50% and 40%) and from academics across one round (52%), indicating that participants were receptive to the method and motivated to respond. The themes identified as encompassing the most important research priorities were mental health, healthy environment and health behaviours. Within these themes, the topic areas that emerged most strongly included community interventions for prevention of mental health problems and the food and alcohol environment. Some responses received from academic researchers were (as requested) in the form of tractable research questions, whereas others contributed further potential topic areas instead. Delphi-like survey methods are practical and productive as a means of obtaining opinions from a wide number of relevant experts identifying potential priority topic areas for research; however, this method is less appropriate for framing tractable research questions.

Insufficiently studied factors related to burnout in nursing: Results from an e-Delphi study

PubMed Central

2017-01-01

Objective This study aimed to identify potentially important factors in explaining burnout in nursing that have been insufficiently studied or ignored. Methods A three-round Delphi study via e-mail correspondence was conducted, with a group of 40 European experts. The e-Delphi questionnaire consisted of 52 factors identified from a literature review. Experts rated and scored the importance of factors in the occurrence of burnout and the degree of attention given by researchers to each of the variables listed, on a six-point Likert scale. We used the agreement percentage (>80%) to measure the level of consensus between experts. Furthermore, to confirm the level of consensus, we also calculated mean scores and modes. Regardless of the degree of consensus reached by the experts, we have calculated the mean of the stability of the answers for each expert (individual's qualitative stability) and the mean of the stability percentages of the experts (qualitative group stability). Results The response rate in the three rounds was 93.02% (n = 40). Eight new factors were suggested in the first round. After modified, the e-Delphi questionnaire in the second and third rounds had 60 factors. All the factors reached the third round with a consensus level above 80% in terms of the attention that researchers gave them in their studies. Moreover, the data show a total mean qualitative group stability of 96.21%. In the third round 9 factors were classified by experts as ‘studied very little’, 17 as ‘studied little’ and 34 as 'well studied' Conclusion Findings show that not all the factors that may influence nursing burnout have received the same attention from researchers. The panel of experts has identified factors that, although important in explaining burnout, have been poorly studied or even forgotten. Our results suggest that further study into factors such as a lack of recognition of part of the tasks that nurses perform, feminine stereotype or excessive bureaucracy is needed for a better understanding of this syndrome and improve the quality of life in nurses. PMID:28388660

The Delphi Technique in Identifying Learning Objectives for the Development of Science, Technology and Society Modules for Palestinian Ninth Grade Science Curriculum

NASA Astrophysics Data System (ADS)

Abualrob, Marwan M. A.; Gnanamalar Sarojini Daniel, Esther

2013-10-01

This article outlines how learning objectives based upon science, technology and society (STS) elements for Palestinian ninth grade science textbooks were identified, which was part of a bigger study to establish an STS foundation in the ninth grade science curriculum in Palestine. First, an initial list of STS elements was determined. Second, using this list, ninth grade science textbooks and curriculum document contents were analyzed. Third, based on this content analysis, a possible list of 71 learning objectives for the integration of STS elements was prepared. This list of learning objectives was refined by using a two-round Delphi technique. The Delphi study was used to rate and to determine the consensus regarding which items (i.e. learning objectives for STS in the ninth grade science textbooks in Palestine) are to be accepted for inclusion. The results revealed that of the initial 71 objectives in round one, 59 objectives within round two had a mean score of 5.683 or higher, which indicated that the learning objectives could be included in the development of STS modules for ninth grade science in Palestine.

Working towards consensus on methods used to elicit participant-reported safety data in uncomplicated malaria clinical drug studies: a Delphi technique study.

PubMed

Mandimika, Nyaradzo; Barnes, Karen I; Chandler, Clare I R; Pace, Cheryl; Allen, Elizabeth N

2017-01-28

Eliciting adverse event (AE) and non-study medication data reports from clinical research participants is integral to evaluating drug safety. However, using different methods to question participants yields inconsistent results, compromising the interpretation, comparison and pooling of data across studies. This is particularly important given the widespread use of anti-malarials in vulnerable populations, and their increasing use in healthy, but at-risk individuals, as preventive treatment or to reduce malaria transmission. Experienced and knowledgeable anti-malarial drug clinical researchers were invited to participate in a Delphi technique study, to facilitate consensus on what are considered optimal (relevant, important and feasible) methods, tools, and approaches for detecting participant-reported AE and non-study medication data in uncomplicated malaria treatment studies. Of 72 invited, 25, 16 and 10 panellists responded to the first, second and third rounds of the Delphi, respectively. Overall, 68% (68/100) of all questioning items presented for rating achieved consensus. When asking general questions about health, panellists agreed on the utility of a question/concept about any change in health, taking care to ensure that such questions/concepts do not imply causality. Eighty-nine percent (39/44) of specific signs and symptoms questions were rated as optimal. For non-study medications, a general question and most structured questioning items were considered an optimal approach. The use of mobile phones, patient diaries, rating scales as well as openly engaging with participants to discuss concerns were also considered optimal complementary data-elicitation tools. This study succeeded in reaching consensus within a section of the anti-malarial drug clinical research community about using a general question concept, and structured questions for eliciting data about AEs and non-study medication reports. The concepts and items considered in this Delphi to be relevant, important and feasible should be further investigated for potential inclusion in a harmonized approach to collect participant-elicited anti-malarial drug safety data. This, in turn, should improve understanding of anti-malarial drug safety.

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study

PubMed Central

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-01-01

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors. PMID:27187425

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Identifying Ethical Issues in Mental Health Research with Minors Adolescents: Results of a Delphi Study.

PubMed

Hiriscau, Elisabeta Ioana; Stingelin-Giles, Nicola; Wasserman, Danuta; Reiter-Theil, Stella

2016-05-11

Research with minors, especially for preventive purposes, e.g., suicide prevention, investigating risk or self-destructive behaviors such as deviance, drug abuse, or suicidal behavior, is ethically sensitive. We present a Delphi study exploring the ethical implications of the needs formulated by researchers in an international pre-conference who would benefit from ethics support and guidance in conducting Mental Health Research with minors. The resulting List of Ethical Issues (LEI) was submitted to a 2-rounds Delphi process via the Internet, including 34 multidisciplinary experts. In the first round, the experts reviewed the LEI and completed a questionnaire. Results from this round were analyzed and grouped in nine categories comprising 40 items. In the second round, the experts had to agree/disagree with the needs expressed in the LEI leading to a final list of 25 ethical issues considered relevant for Mental Health Research with minors such as: confidentiality of the sensitive data, competence for consenting alone and risk of harm and stigma related to the methodology used in research. It was shown that studies like SEYLE (Saving and Empowering Young Lives in Europe) trigger among researchers wishes to obtain specific recommendations helping to comply with standards for good practice in conducting research with minors.

Successful and Unsuccessful Multicultural Supervisory Behaviors: A Delphi Poll

ERIC Educational Resources Information Center

Dressel, Jeana L.; Consoli, Andres J.; Kim, Bryan S.K.; Atkinson, Donald R.

2007-01-01

Using the Delphi method, university counseling center supervisors with significant experience in multicultural supervision generated and ranked elements of successful and unsuccessful multicultural supervision. Twenty-seven of 35 successful elements and 24 of 33 unsuccessful elements involved cultural considerations. Multicultural supervision was…

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration

PubMed Central

Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F.; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-01-01

Purpose Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. Methods A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. Results The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. Conclusion This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field. PMID:28831446

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration.

PubMed

Segelov, Eva; Chan, David; Lawrence, Ben; Pavlakis, Nick; Kennecke, Hagen F; Jackson, Christopher; Law, Calvin; Singh, Simron

2017-08-01

Neuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan. A three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan. The Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established. This modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field.

Operationalising elaboration theory for simulation instruction design: a Delphi study.

PubMed

Haji, Faizal A; Khan, Rabia; Regehr, Glenn; Ng, Gary; de Ribaupierre, Sandrine; Dubrowski, Adam

2015-06-01

The aim of this study was to assess the feasibility of incorporating the Delphi process within the simplifying conditions method (SCM) described in elaboration theory (ET) to identify conditions impacting the complexity of procedural skills for novice learners. We generated an initial list of conditions impacting the complexity of lumbar puncture (LP) from key informant interviews (n = 5) and a literature review. Eighteen clinician-educators from six different medical specialties were subsequently recruited as expert panellists. Over three Delphi rounds, these panellists rated: (i) their agreement with the inclusion of the simple version of the conditions in a representative ('epitome') training scenario, and (ii) how much the inverse (complex) version increases LP complexity for a novice. Cronbach's α-values were used to assess inter-rater agreement. All panellists completed Rounds 1 and 2 of the survey and 17 completed Round 3. In Round 1, Cronbach's α-values were 0.89 and 0.94 for conditions that simplify and increase LP complexity, respectively; both values increased to 0.98 in Rounds 2 and 3. With the exception of 'high CSF (cerebral spinal fluid) pressure', panellists agreed with the inclusion of all conditions in the simplest (epitome) training scenario. Panellists rated patient movement, spinal anatomy, patient cooperativeness, body habitus, and the presence or absence of an experienced assistant as having the greatest impact on the complexity of LP. This study demonstrated the feasibility of using expert consensus to establish conditions impacting the complexity of procedural skills, and the benefits of incorporating the Delphi method into the SCM. These data can be used to develop and sequence simulation scenarios in a progressively challenging manner. If the theorised learning gains associated with ET are realised, the methods described in this study may be applied to the design of simulation training for other procedural and non-procedural skills, thereby advancing the agenda of theoretically based instruction design in health care simulation. © 2015 John Wiley & Sons Ltd.

Competency model for dentists in China: Results of a Delphi study

PubMed Central

Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

Objective With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Methods Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Results Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. Conclusion In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China. PMID:29566048

Expert consensus for performing right heart catheterisation for suspected pulmonary arterial hypertension in systemic sclerosis: a Delphi consensus study with cluster analysis.

PubMed

Avouac, Jérôme; Huscher, Dörte; Furst, Daniel E; Opitz, Christian F; Distler, Oliver; Allanore, Yannick

2014-01-01

To establish an expert consensus on which criteria are the most appropriate in clinical practice to refer patients with systemic sclerosis (SSc) for right heart catheterisation (RHC) when pulmonary hypertension (PH) is suspected. A three stage internet based Delphi consensus exercise involving worldwide PH experts was designed. In the first stage, a comprehensive list of domains and items combining evidence based indications and expert opinions were obtained. In the second and third stages, experts were asked to rate each item selected in the list. After each of stages 2 and 3, the number of items and criteria were reduced according to a cluster analysis. A literature search and the opinions of 47 experts participating in Delphi stage 1 provided a list of seven domains containing 142 criteria. After stages 2 and 3, these domains and tools were reduced to three domains containing eight tools: clinical (progressive dyspnoea over the past 3 months, unexplained dyspnoea, worsening of WHO dyspnoea functional class, any finding on physical examination suggestive of elevated right heart pressures and any sign of right heart failure), echocardiography (systolic pulmonary artery pressure >45 mm Hg and right ventricle dilation) and pulmonary function tests (diffusion lung capacity for carbon monoxide <50% without pulmonary fibrosis). Among experts in pulmonary arterial hypertension-SSc, a core set of criteria for clinical practice to refer SSc patients for RHC has been defined by Delphi consensus methods. Although these indications are recommended by this expert group to be used as an interim tool, it will be necessary to formally validate the present tools in further studies.

The development of ethical guidelines for nurses' collegiality using the Delphi method.

PubMed

Kangasniemi, Mari; Arala, Katariina; Becker, Eve; Suutarla, Anna; Haapa, Toni; Korhonen, Anne

2017-08-01

Nurses' collegiality is topical because patient care is complicated, requiring shared knowledge and working methods. Nurses' collaboration has been supported by a number of different working models, but there has been less focus on ethics. This study aimed to develop nurses' collegiality guidelines using the Delphi method. Two online panels of Finnish experts, with 35 and 40 members, used the four-step Delphi method in December 2013 and January 2014. They reformulated the items of nurses' collegiality identified by the literature and rated based on validity and importance. Content analysis and descriptive statistical methods were used to analyze the data, and the nurses' collegiality guidelines were formulated. Ethical considerations: Organizational approval was received, and an informed consent was obtained from all participants. Information about the voluntary nature of participation was provided. During the first Delphi panel round, a number of items were reformulated and added, resulting in 32 reformulated items. As a result of the second round, 8 of the 32 items scored an agreement rate of more than 75%, with the most rated item being collegiality means that professionals respect each other. The item with second highest rating was collegiality has a common objective: what is best for patients, followed by the third highest which was professional ethics is the basis of collegiality. Nurses' collegiality and its content are well recognized in clinical practice but seldom studied. Collegiality can be supported by guidelines, and nurses working in clinical practice, together with teachers and managers, have shared responsibilities to support and develop it. More research in different nursing environments is needed to improve understanding of the content and practice of nursing collegiality.

[Use of a Delphi survey to assess the hospital economic impact of innovative products: The example of idarucizumab a dabigatran-specific reversal agent].

PubMed

Jamet, N; Thivilliers, A P; Paubel, P; Chevalier, D; Bourguignon, S; Bézie, Y

2017-11-01

The economic impact of therapeutic innovations on the hospital patient management cannot be easily estimated. The objective of this study is to illustrate the use of a Delphi survey as a support tool to identify the changes following the use of idarucizumab in dabigatran-treated patients with uncontrolled/life-threatening bleeding or who required emergency surgery/urgent procedures. The Delphi questionnaires have been administrated to 8 emergency physicians or anesthetists from 6 different hospital centers. Following the answers, an economic valorization has been carried out on every parameter on which a consensus was reached (at least 4 answers showing an identical trend). A mean management cost for each etiology with and without the use of idarucizumab has thus been identified. For gastro-intestinal and other life-threatening bleedings (excepted intracranial bleedings), the total management cost of the hospital stay was respectively 6058 € (-35%) and 6219 € (-34%) following the use of the reversal agent. The hospital management cost for intracranial bleeding is slightly increasing to 9790 € (+3%). The cost of a stay for emergency surgery decreases to 6962€ (-2%). This study shows a positive economic impact following the use of the dabigatran-specific reversal agent for patients with uncontrolled/life-threatening bleeding excepted in the case of intracranial bleeding. Moreover, it points out that a Delphi survey is an easy way to predict the hospital economic impact of a therapeutic innovation when no other evaluation is possible. Copyright © 2017 Académie Nationale de Pharmacie. Published by Elsevier Masson SAS. All rights reserved.

Competency model for dentists in China: Results of a Delphi study.

PubMed

Geng, Yunxia; Zhao, Liying; Wang, Yu; Jiang, Yiyuan; Meng, Kai; Zheng, Dongxiang

2018-01-01

With the increasing awareness of the importance of oral health, patients have an increasing need for integrated care from dentists. In China, the dentistry examination consists of two parts: a practical skills examination and a comprehensive medical examination; to date, no assessment methods that are based on specialized dentistry competencies, unlike the United States, Canada, and other countries, have been established. Therefore, the purpose of this study was to construct a competency model for dentists in China in order to guide the development, admission, training and assessment of dentists. Using a literature review, focus group interviews and in-depth personal interviews, a dentist competency index was developed with an expert consultation questionnaire. A panel of 20 specialist experts was chosen from ten national medical universities to carry out two rounds of Delphi expert analysis, using the boundary value method to filter the indicators and the Analytic Hierarchy Process to calculate the weights of the primary indicators. Two rounds of Delphi results showed that the expert authority, enthusiasm, and coordination coefficients were high. Constructs of the competency model that included seven primary indicators and 62 secondary indicators determined the weight of each index. The seven primary indicators included the following: clinical skills and medical services, disease prevention and health promotion, interpersonal communication skills, core values and professionalism, medical knowledge and lifelong learning ability, teamwork ability and scientific research ability. In conclusion, the use of the Delphi method to construct an initial model of Chinese physician competency is scientific and feasible. The initial competency model conforms to the characteristics and quality requirements of dentists in China and has a strong scientific basis. The dentist competency model should be used in the National Dental Licensing Examination in China.

Developing Resident-Sensitive Quality Measures: A Model From Pediatric Emergency Medicine.

PubMed

Schumacher, Daniel J; Holmboe, Eric S; van der Vleuten, Cees; Busari, Jamiu O; Carraccio, Carol

2017-12-05

To begin closing the gap with respect to quality measures available for use among residents, the authors sought to identify and develop resident-sensitive quality measures (RSQMs) for use in the pediatric emergency department (PED) setting. In May 2016, the authors reviewed National Quality Measures Clearinghouse (NQMC) measures to identify resident-sensitive measures. To create additional measures focused on common, acute illnesses (acute asthma exacerbation, bronchiolitis, closed head injury [CHI]) in the PED, the authors used a nominal group technique (NGT) and Delphi process from September to December 2016. To achieve a local focus for developing these measures, all NGT and Delphi participants were from Cincinnati Children's Hospital Medical Center. Delphi participants rated measures developed through the NGT in two areas: importance of measure to quality care and likelihood that measure represents the work of a resident. The review of NQMC measures identified 28 of 183 as being potentially resident-sensitive. The NGT produced 67 measures for asthma, 46 for bronchiolitis, and 48 for CHI. These were used in the first round of the Delphi process. After two rounds, 18 measures for asthma, 21 for bronchiolitis, and 22 for CHI met automatic inclusion criteria. In round three, participants categorized the potential final measures by their top 10 and next 5. This study describes a template for identifying and developing RSQMs that may promote high-quality care delivery during and following training. Next steps should include implementing and seeking validity evidence for the locally developed measures.

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors

PubMed Central

Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

Background The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Methods Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. Findings All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. Conclusions This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention. PMID:26726801

A Delphi Consensus of the Crucial Steps in Gastric Bypass and Sleeve Gastrectomy Procedures in the Netherlands.

PubMed

Kaijser, Mirjam A; van Ramshorst, Gabrielle H; Emous, Marloes; Veeger, Nic J G M; van Wagensveld, Bart A; Pierie, Jean-Pierre E N

2018-04-09

Bariatric procedures are technically complex and skill demanding. In order to standardize the procedures for research and training, a Delphi analysis was performed to reach consensus on the practice of the laparoscopic gastric bypass and sleeve gastrectomy in the Netherlands. After a pre-round identifying all possible steps from literature and expert opinion within our study group, questionnaires were send to 68 registered Dutch bariatric surgeons, with 73 steps for bypass surgery and 51 steps for sleeve gastrectomy. Statistical analysis was performed to identify steps with and without consensus. This process was repeated to reach consensus of all necessary steps. Thirty-eight participants (56%) responded in the first round and 32 participants (47%) in the second round. After the first Delphi round, 19 steps for gastric bypass (26%) and 14 for sleeve gastrectomy (27%) gained full consensus. After the second round, an additional amount of 10 and 12 sub-steps was confirmed as key steps, respectively. Thirteen steps in the gastric bypass and seven in the gastric sleeve were deemed advisable. Our expert panel showed a high level of consensus expressed in a Cronbach's alpha of 0.82 for the gastric bypass and 0.87 for the sleeve gastrectomy. The Delphi consensus defined 29 steps for gastric bypass and 26 for sleeve gastrectomy as being crucial for correct performance of these procedures to the standards of our expert panel. These results offer a clear framework for the technical execution of these procedures.

From the Medical Board of the National Psoriasis Foundation: Treatment targets for plaque psoriasis.

PubMed

Armstrong, April W; Siegel, Michael P; Bagel, Jerry; Boh, Erin E; Buell, Megan; Cooper, Kevin D; Callis Duffin, Kristina; Eichenfield, Lawrence F; Garg, Amit; Gelfand, Joel M; Gottlieb, Alice B; Koo, John Y M; Korman, Neil J; Krueger, Gerald G; Lebwohl, Mark G; Leonardi, Craig L; Mandelin, Arthur M; Menter, M Alan; Merola, Joseph F; Pariser, David M; Prussick, Ronald B; Ryan, Caitriona; Shah, Kara N; Weinberg, Jeffrey M; Williams, MaryJane O U; Wu, Jashin J; Yamauchi, Paul S; Van Voorhees, Abby S

2017-02-01

An urgent need exists in the United States to establish treatment goals in psoriasis. We aim to establish defined treatment targets toward which clinicians and patients with psoriasis can strive to inform treatment decisions, reduce disease burden, and improve outcomes in practice. The National Psoriasis Foundation conducted a consensus-building study among psoriasis experts using the Delphi method. The process consisted of: (1) literature review, (2) pre-Delphi question selection and input from general dermatologists and patients, and (3) 4 Delphi rounds. A total of 25 psoriasis experts participated in the Delphi process. The most preferred instrument was body surface area (BSA). The most preferred time for evaluating patient response after starting new therapies was at 3 months. The acceptable response at 3 months postinitiation was either BSA 3% or less or BSA improvement 75% or more from baseline. The target response at 3 months postinitiation was BSA 1% or less. During the maintenance period, evaluation every 6 months was most preferred. The target response at every 6 months maintenance evaluation is BSA 1% or less. Although BSA is feasible in practice, it does not encompass health-related quality of life, costs, and risks of side effects. With defined treatment targets, clinicians and patients can regularly evaluate treatment responses and perform benefit-risk assessments of therapeutic options individualized to the patient. Copyright © 2016 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

[Austrian guideline for palliative sedation therapy (long version) : Results of a Delphi process of the Austrian Palliative Society (OPG)].

PubMed

Weixler, Dietmar; Roider-Schur, Sophie; Likar, Rudolf; Bozzaro, Claudia; Daniczek, Thomas; Feichtner, Angelika; Gabl, Christoph; Hammerl-Ferrari, Bernhard; Kletecka-Pulker, Maria; Körtner, Ulrich H J; Kössler, Hilde; Meran, Johannes G; Miksovsky, Aurelia; Pusswald, Bettina; Wienerroither, Thomas; Watzke, Herbert

2017-02-01

Palliative sedation therapy (PST) is an important and ethically accepted therapy in the care of selected palliative care patients with otherwise unbearable suffering from refractory distress. PST is increasingly used in end-of-life care. Austria does not have a standardized ethical guideline for this exceptional practice near end of life, but there is evidence that practice varies throughout the country. The Austrian Palliative Society (OPG) nominated a multidisciplinary working group of 16 palliative care experts and ethicists who established the national guideline on the basis of recent review work with the aim to adhere to the Europeans Association of Palliative Care's (EAPC) framework on palliative sedation therapy respecting Austrians legal, structural and cultural background. Consensus was achieved by a four-step sequential Delphi process. The Delphi-process was strictly orientated to the recently published EUROIMPACT-sedation-study-checklist and to the AGREE-2-tool. Additionally national stakeholders participated in the reflection of the results. As a result of a rigorous consensus process the long version of the Austrian National Palliative Sedation Guideline contains 112 statements within eleven domains and is supplemented by a philosophers excursus on suffering. By establishing a national guideline for palliative sedation therapy using the Delphi technique for consensus and stakeholder involvement the Austrian Palliative Society aims to ensure nationwide good practice of palliative sedation therapy. Screening for the practicability and efficacy of this guideline will be a future task.

An International Consensus Definition of the Wish to Hasten Death and Its Related Factors.

PubMed

Balaguer, Albert; Monforte-Royo, Cristina; Porta-Sales, Josep; Alonso-Babarro, Alberto; Altisent, Rogelio; Aradilla-Herrero, Amor; Bellido-Pérez, Mercedes; Breitbart, William; Centeno, Carlos; Cuervo, Miguel Angel; Deliens, Luc; Frerich, Gerrit; Gastmans, Chris; Lichtenfeld, Stephanie; Limonero, Joaquín T; Maier, Markus A; Materstvedt, Lars Johan; Nabal, María; Rodin, Gary; Rosenfeld, Barry; Schroepfer, Tracy; Tomás-Sábado, Joaquín; Trelis, Jordi; Villavicencio-Chávez, Christian; Voltz, Raymond

2016-01-01

The desire for hastened death or wish to hasten death (WTHD) that is experienced by some patients with advanced illness is a complex phenomenon for which no widely accepted definition exists. This lack of a common conceptualization hinders understanding and cooperation between clinicians and researchers. The aim of this study was to develop an internationally agreed definition of the WTHD. Following an exhaustive literature review, a modified nominal group process and an international, modified Delphi process were carried out. The nominal group served to produce a preliminary definition that was then subjected to a Delphi process in which 24 experts from 19 institutions from Europe, Canada and the USA participated. Delphi responses and comments were analysed using a pre-established strategy. All 24 experts completed the three rounds of the Delphi process, and all the proposed statements achieved at least 79% agreement. Key concepts in the final definition include the WTHD as a reaction to suffering, the fact that such a wish is not always expressed spontaneously, and the need to distinguish the WTHD from the acceptance of impending death or from a wish to die naturally, although preferably soon. The proposed definition also makes reference to possible factors related to the WTHD. This international consensus definition of the WTHD should make it easier for clinicians and researchers to share their knowledge. This would foster an improved understanding of the phenomenon and help in developing strategies for early therapeutic intervention.

75 FR 41521 - Delphi Corporation, Automotive Holding Group, Instrument Cluster Plant, Currently Known as...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-16

..., Automotive Holding Group, Instrument Cluster Plant, Currently Known as General Motors Corporation, Including... Corporation, Automotive Holding Group, Instrument Cluster Plant, including on-site leased workers from... Material Management working on-site at Delphi Corporation, Automotive Holding Group, Instrument Cluster...

14 CFR Special Federal Aviation... - Rules for use of portable oxygen concentrator systems on board aircraft

Code of Federal Regulations, 2011 CFR

2011-01-01

... Concentrator: means the AirSep FreeStyle, AirSep LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen... LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen One, Inogen One G2, International...

14 CFR Special Federal Aviation... - Rules for use of portable oxygen concentrator systems on board aircraft

Code of Federal Regulations, 2012 CFR

2012-01-01

... Concentrator: means the AirSep FreeStyle, AirSep LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen... LifeStyle, Delphi RS-00400, DeVilbiss Healthcare iGo, Inogen One, Inogen One G2, International...

Creation and Delphi-method refinement of pediatric disaster triage simulations.

PubMed

Cicero, Mark X; Brown, Linda; Overly, Frank; Yarzebski, Jorge; Meckler, Garth; Fuchs, Susan; Tomassoni, Anthony; Aghababian, Richard; Chung, Sarita; Garrett, Andrew; Fagbuyi, Daniel; Adelgais, Kathleen; Goldman, Ran; Parker, James; Auerbach, Marc; Riera, Antonio; Cone, David; Baum, Carl R

2014-01-01

There is a need for rigorously designed pediatric disaster triage (PDT) training simulations for paramedics. First, we sought to design three multiple patient incidents for EMS provider training simulations. Our second objective was to determine the appropriate interventions and triage level for each victim in each of the simulations and develop evaluation instruments for each simulation. The final objective was to ensure that each simulation and evaluation tool was free of bias toward any specific PDT strategy. We created mixed-methods disaster simulation scenarios with pediatric victims: a school shooting, a school bus crash, and a multiple-victim house fire. Standardized patients, high-fidelity manikins, and low-fidelity manikins were used to portray the victims. Each simulation had similar acuity of injuries and 10 victims. Examples include children with special health-care needs, gunshot wounds, and smoke inhalation. Checklist-based evaluation tools and behaviorally anchored global assessments of function were created for each simulation. Eight physicians and paramedics from areas with differing PDT strategies were recruited as Subject Matter Experts (SMEs) for a modified Delphi iterative critique of the simulations and evaluation tools. The modified Delphi was managed with an online survey tool. The SMEs provided an expected triage category for each patient. The target for modified Delphi consensus was ≥85%. Using Likert scales and free text, the SMEs assessed the validity of the simulations, including instances of bias toward a specific PDT strategy, clarity of learning objectives, and the correlation of the evaluation tools to the learning objectives and scenarios. After two rounds of the modified Delphi, consensus for expected triage level was >85% for 28 of 30 victims, with the remaining two achieving >85% consensus after three Delphi iterations. To achieve consensus, we amended 11 instances of bias toward a specific PDT strategy and corrected 10 instances of noncorrelation between evaluations and simulation. The modified Delphi process, used to derive novel PDT simulation and evaluation tools, yielded a high degree of consensus among the SMEs, and eliminated biases toward specific PDT strategies in the evaluations. The simulations and evaluation tools may now be tested for reliability and validity as part of a prehospital PDT curriculum.

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Identifying Critical Issues and Problems in Technology Education Using a Modified-Delphi Technique.

ERIC Educational Resources Information Center

Wicklein, Robert C.

1993-01-01

Critical issues for technology education (TE) identified by a 25-member Delphi panel were identification of the knowledge base, curriculum development approaches, interdisciplinary approaches, and teacher education reform. Problems identified included inadequate marketing/public relations, teacher shortage, lack of content consensus, and…

Legislative priorities for transportation safety in Virginia : a pilot application of a modified delphi technique : final report.

DOT National Transportation Integrated Search

1985-01-01

Using a modified version of the Delphi technique, a panel of transportation safety experts developed the following list of legislative priorities for submission to the Department of Motor Vehicles (DMV) Legislative Package for the 1986 session of the...

Development Of A Solid Oxide Fuel Cell Stack By Delphi And Battelle

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mukerjee, Subhasish; Shaffer, Steven J.; Zizelman, James

2003-01-20

Delphi and Battelle are developing a Solid Oxide Fuel Cell (SOFC) stack for transportation and residential applications. This paper describes the status of development of the Generation 2 stack and key progress made in addressing some of the challenges in this technology.

Japanese Clinical Guidelines for Endoscopic Treatment of Pancreatolithiasis.

PubMed

Inui, Kazuo; Igarashi, Yoshinori; Irisawa, Atsushi; Ohara, Hirotaka; Tazuma, Susumu; Hirooka, Yoshiki; Fujita, Naotaka; Miyakawa, Hiroyuki; Sata, Naohiro; Shimosegawa, Tooru; Tanaka, Masao; Shiratori, Keiko; Sugiyama, Masanori; Takeyama, Yoshifumi

2015-10-01

In addition to surgery, procedures for patients with pancreatolithiasis are developing; therefore, establishing practical guidelines for the management of pancreatolithiasis is required. Three committees (the professional committee for asking clinical questions (CQs) and statements by Japanese endoscopists, the expert panel committee for rating statements by the modified Delphi method, and the evaluating committee by moderators) were organized. Eight endoscopists and a surgeon for pancreatolithiasis made the CQs and statements from a total of 694 reports of published literature by PubMed search (from 1983 to 2012). The expert panelists individually rated these clinical statements using a modified Delphi approach, in which a clinical statement receiving a median score greater than 7 on a 9-point scale from the panel was regarded as valid. The professional committee made 3, 7, and 10 CQs and statements for the concept and pathogenesis, diagnosis, and treatment, respectively. The expert panelists regarded them as valid after a 2-round modified Delphi approach. After evaluation by the moderators, the Japanese clinical guidelines for pancreatolithiasis were established. Further discussions and studies for international guidelines are needed.

The transculturality of 'gut feelings'. Results from a French Delphi consensus survey.

PubMed

Le Reste, Jean-Yves; Coppens, Magali; Barais, Marie; Nabbe, Patrice; Le Floch, Bernard; Chiron, Benoît; Dinant, Geert Jan; Berkhout, Christophe; Stolper, Erik; Barraine, Pierre

2013-12-01

General Practitioners (GPs) sometimes base their clinical decisions on 'gut feelings.' Research into the significance of this phenomenon with focus groups and a Delphi consensus procedure in the Netherlands provided a concept of 'gut feelings:' a sense of alarm, a sense of reassurance and several determinants. The transculturality of 'gut feelings' has been examined briefly until now as the issue is complex. To determine whether a consensus on 'gut feelings' in general practice in France could be obtained. Using a similar Delphi consensus procedure and the same six initial statements as in the Netherlands, and compare the French results with the seven final Dutch consensual statements. Qualitative research, including a Delphi consensus procedure after a forward-backward translation (FBT) of the initial Dutch statements of 'gut feelings.' A heterogeneous sample of 34 French expert GPs participated. FBT of the final French statements was undertaken for a content comparison with the Dutch. After three Delphi rounds, French GPs reached agreement on nine statements. Many similarities have been found between the Dutch and the French defining statements, with reservations concerning the 'sense of reassurance,' which French GPs seemed to feel more cautious about. 'Gut feelings' are a well-defined concept in France too. The Dutch and the French consensual statements seem very close. The transculturality of the concept is confirmed, which is a new indicator that 'gut feelings' are a self-contained concept.

Perspectives on academic health sciences libraries in the 1980s: indicators from a Delphi study.

PubMed Central

Matheson, N W

1982-01-01

A Delphi study was undertaken to identify the changes in library roles and functions that the directors of academic health sciences libraries believe will occur over the next decade. The methodology is described and the results are summarized. Two scenarios resulted: one, highly desirable; the other, highly probable. They overlap by 64%. Library directors expect moderate evolutionary changes in the next ten years. Users are perceived to be the force maintaining the status quo, while technology is the force advancing change. The adoption of technology is seen as desirable and within the libraries' span of control. Education and service roles of librarians will expand. Library and institutional priorities are seen as obstacles to change. PMID:7037086

Identifying and prioritising systematic review topics with public health stakeholders: A protocol for a modified Delphi study in Switzerland to inform future research agendas.

PubMed

Hoekstra, Dyon; Mütsch, Margot; Kien, Christina; Gerhardus, Ansgar; Lhachimi, Stefan K

2017-08-04

The Cochrane Collaboration aims to produce relevant and top priority evidence that responds to existing evidence gaps. Hence, research priority setting (RPS) is important to identify which potential research gaps are deemed most important. Moreover, RPS supports future health research to conform both health and health evidence needs. However, studies that are prioritising systematic review topics in public health are surprisingly rare. Therefore, to inform the research agenda of Cochrane Public Health Europe (CPHE), we introduce the protocol of a priority setting study on systematic review topics in several European countries, which is conceptualised as pilot. We will conduct a two-round modified Delphi study in Switzerland, incorporating an anonymous web-based questionnaire, to assess which topics should be prioritised for systematic reviews in public health. In the first Delphi round public health stakeholders will suggest relevant assessment criteria and potential priority topics. In the second Delphi round the participants indicate their (dis)agreement to the aggregated results of the first round and rate the potential review topics with the predetermined criteria on a four-point Likert scale. As we invite a wide variety of stakeholders we will compare the results between the different stakeholder groups. We have received ethical approval from the ethical board of the University of Bremen, Germany (principal investigation is conducted at the University of Bremen) and a certificate of non-objection from the Canton of Zurich, Switzerland (fieldwork will be conducted in Switzerland). The results of this study will be further disseminated through peer reviewed publication and will support systematic review author groups (i.a. CPHE) to improve the relevance of the groups´ future review work. Finally, the proposed priority setting study can be used as a framework by other systematic review groups when conducting a priority setting study in a different context. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

[What is Men's Health? A definition].

PubMed

Bardehle, D; Dinges, M; White, A

2016-07-01

Target of the study: Men's Health is increasingly coming into focus of health research, epidemiology, health care organization, and health policy. Over the past 10-15 years have been published by some countries and the EU Men's Health reports where problems of health noted in men. Starting point for a scientific study of men's health is the definition of "Men's Health". A group of German experts in the field of men's health has taken on this task. A literature review in international and national databases was performed for the years 1990-2014 by selected MeSH terms and for "experts for men's health". Another research concerned "gray literature" in Germany, especially health reports and web pages. This was followed by a conference of experts to define "Men's Health" using a modified Delphi method according to W. Zinn. From the expert group minimum criteria for a definition "Men's Health" were created and discussed, which must comply with the new definition of men's health. This definition was created in the third round of the Delphi method. The international literature review yielded 7 definitions of "Men's Health" in the English-speaking and 5 definitions in the German inkl. in the "gray" literature. Due to the developed by the Expert Group 7 minimum criteria 15 relevant topics were listed, of which by weighting 8 subject areas were considered relevant for a new definition. In comparison with the previous definitions none could fulfill these 8 criteria. Therefore, in the next step of the expert group a new definition "Men's Health" was elaborated. The definition has reference to the WHO concept of "health" and includes dimensions of health and disease, risk and protective factors that require special prevention and care services for all phases of life. All participants in the expert group agreed on the definition developed. The definition of Men's Health is a basis for further scientific work and practice to improve men's health in Germany and other countries. © Georg Thieme Verlag KG Stuttgart · New York.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey.

PubMed

Zill, Jördis M; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. 11 out of the 15 dimensions have been validated through experts' ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy.

Which Dimensions of Patient-Centeredness Matter? - Results of a Web-Based Expert Delphi Survey

PubMed Central

Zill, Jördis M.; Scholl, Isabelle; Härter, Martin; Dirmaier, Jörg

2015-01-01

Background Present models and definitions of patient-centeredness revealed a lack of conceptual clarity. Based on a prior systematic literature review, we developed an integrative model with 15 dimensions of patient-centeredness. The aims of this study were to 1) validate, and 2) prioritize these dimensions. Method A two-round web-based Delphi study was conducted. 297 international experts were invited to participate. In round one they were asked to 1) give an individual rating on a nine-point-scale on relevance and clarity of the dimensions, 2) add missing dimensions, and 3) prioritize the dimensions. In round two, experts received feedback about the results of round one and were asked to reflect and re-rate their own results. The cut-off for the validation of a dimension was a median < 7 on one of the criteria. Results 105 experts participated in round one and 71 in round two. In round one, one new dimension was suggested and included for discussion in round two. In round two, this dimension did not reach sufficient ratings to be included in the model. Eleven dimensions reached a median ≥ 7 on both criteria (relevance and clarity). Four dimensions had a median < 7 on one or both criteria. The five dimensions rated as most important were: patient as a unique person, patient involvement in care, patient information, clinician-patient communication and patient empowerment. Discussion 11 out of the 15 dimensions have been validated through experts’ ratings. Further research on the four dimensions that received insufficient ratings is recommended. The priority order of the dimensions can help researchers and clinicians to focus on the most important dimensions of patient-centeredness. Overall, the model provides a useful framework that can be used in the development of measures, interventions, and medical education curricula, as well as the adoption of a new perspective in health policy. PMID:26539990

Electronic-Imen-Delphi (EID): An Online Conferencing Procedure.

ERIC Educational Resources Information Center

Passig, David; Sharbat, Aviva

2000-01-01

Examines the efficiency of the Imen-Delphi (ID) technique as an electronic procedure for conferencing that helps participants clarify their opinions and expectations regarding preferable and possible futures. Describes an electronic version of the original ID procedure and tested its efficiency among a group of experts on virtual reality and…

A Delphi Survey on Citizenship Education in Asean Countries: Findings for Brunei

ERIC Educational Resources Information Center

Salleh, Hajah Sallimah Haji Mohammed; Laxman, Kumar; Jawawi, Rosmawijah

2015-01-01

The aim of the Delphi Survey was to elucidate Bruneian Education experts' responses to five questions regarding their knowledge and understanding of the charateristics of citizenship education viz. Environment, Coexistence, Culture, Social Justice and Equity, Democracy, Sustainable Development, Interdependence, Foreign Language, Social Welfare,…

Delphi Research Methodology Applied to Place-Based Watershed Education

ERIC Educational Resources Information Center

Vallor, Rosanna R.; Yates, Kimberly A.; Brody, Michael

2016-01-01

This research focuses on the results of the Flathead Watershed Delphi survey, a consensus-building methodology used to establish foundational knowledge, skills and dispositions for the Flathead Watershed Educators Guide, a place-based watershed curriculum for middle school grades based on the Flathead Watershed Sourcebook. Survey participants (n =…

The Delphi Method in Rehabilitation Counseling Research

ERIC Educational Resources Information Center

Vazquez-Ramos, Robinson; Leahy, Michael; Estrada Hernandez, Noel

2007-01-01

Rehabilitation researchers have found in the application of the Delphi method a more sophisticated way of obtaining consensus from experts in the field on certain matters. The application of this research methodology has affected and certainly advanced the body of knowledge of the rehabilitation counseling practice. However, the rehabilitation…

78 FR 48467 - Delphi Automotive Systems, LLC, Products and Service Solutions Division, Including On-Site Leased...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-08

... amending this certification to include all workers of Delphi Automotive Systems, LLC, Product and Service..., LLC, Products and Service Solutions Division, Including On-Site Leased Workers From Bartech Workforce Management, Kokomo, Indiana; Amended Certification Regarding Eligibility To Apply for Worker Adjustment...

Cross platform development using Delphi and Kylix

DOE Office of Scientific and Technical Information (OSTI.GOV)

McDonald, J.L.; Nishimura, H.; Timossi, C.

2002-10-08

A cross platform component for EPICS Simple Channel Access (SCA) has been developed for the use with Delphi on Windows and Kylix on Linux. An EPICS controls GUI application developed on Windows runs on Linux by simply rebuilding it, and vice versa. This paper describes the technical details of the component.

Use of the Delphi method for determining community growth goals inventory: the Nashville experience

Treesearch

Vishwa K. Varma

1977-01-01

The author discusses the growth-inducing pressures on Nashville, Tennessee, describes the application of the Delphi technique to develop an inventory of the community's growth goals, and suggests that the development of a list of community goals is a necessary first step toward growth management.

STEM integration in middle school career and technical education programs: A Delphi design study

NASA Astrophysics Data System (ADS)

Wu-Rorrer, Billy Ray

The purpose of this qualitative method study with a Delphi research design sought to determine how STEM programs can be effectively integrated into middle school career and technical education programs by local, state, and national educators, administrators, directors, specialists, and curriculum writers. The significance of the study is to provide leaders in CTE with a greater awareness, insight, and strategies about how CTE programs can more effectively integrate academics into career and technical education programs through STEM-related programming. The findings will increase the limited amount of available literature providing best practice strategies for the integration of STEM curriculum into middle school CTE programs. One basic question has guided this research: How can STEM programs be effectively integrated into middle school career and technical education programs? A total of twelve strategies were identified. The strategies of real-world applications and administrative buy-in were the two predominant strategies consistently addressed throughout the review of literature and all three sub-questions in the research study. The Delphi design study consisted of pilot round and three rounds of data collection on barriers, strategies, and professional development for STEM integration in middle school career and technical education programs. Four panelists participated in the pilot round, and 16 panel members not involved in the pilot round participated in the three rounds of questioning and consensus building. In the future, more comprehensive studies can build upon this foundational investigation of middle school CTE programs.

Phase 2 of CATALISE: a multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology.

PubMed

Bishop, Dorothy V M; Snowling, Margaret J; Thompson, Paul A; Greenhalgh, Trisha

2017-10-01

Lack of agreement about criteria and terminology for children's language problems affects access to services as well as hindering research and practice. We report the second phase of a study using an online Delphi method to address these issues. In the first phase, we focused on criteria for language disorder. Here we consider terminology. The Delphi method is an iterative process in which an initial set of statements is rated by a panel of experts, who then have the opportunity to view anonymised ratings from other panel members. On this basis they can either revise their views or make a case for their position. The statements are then revised based on panel feedback, and again rated by and commented on by the panel. In this study, feedback from a second round was used to prepare a final set of statements in narrative form. The panel included 57 individuals representing a range of professions and nationalities. We achieved at least 78% agreement for 19 of 21 statements within two rounds of ratings. These were collapsed into 12 statements for the final consensus reported here. The term 'Language Disorder' is recommended to refer to a profile of difficulties that causes functional impairment in everyday life and is associated with poor prognosis. The term, 'Developmental Language Disorder' (DLD) was endorsed for use when the language disorder was not associated with a known biomedical aetiology. It was also agreed that (a) presence of risk factors (neurobiological or environmental) does not preclude a diagnosis of DLD, (b) DLD can co-occur with other neurodevelopmental disorders (e.g. ADHD) and (c) DLD does not require a mismatch between verbal and nonverbal ability. This Delphi exercise highlights reasons for disagreements about terminology for language disorders and proposes standard definitions and nomenclature. © 2017 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Transferring skills in quality collaboratives focused on improving patient logistics.

PubMed

Weggelaar-Jansen, Anne Marie; van Wijngaarden, Jeroen

2018-04-02

A quality improvement collaborative, often used by the Institute for Healthcare Improvement, is used to educate healthcare professionals and improve healthcare at the same time. However, no prior research has been done on the knowledge and skills healthcare professionals need to achieve improvements or the extent to which quality improvement collaboratives help enhance both knowledge and skills. Our research focused on quality improvement collaboratives aiming to improve patient logistics and tried to identify which knowledge and skills are required and to what extent these were enhanced during the QIC. We defined skills important for logistic improvements in a three-phase Delphi study. Based on the Delphi results we made a questionnaire. We surveyed participants in a national quality improvement collaborative to assess the skills rated as 1) important, 2) available and 3) improved during the collaborative. At two sense-making meetings, experts reflected on our findings and hypothesized on how to improve (logistics) collaboratives. The Delphi study found 18 skills relevant for reducing patient access time and 21 for reducing throughput time. All skills retrieved from the Delphi study were scored as 'important' in the survey. Teams especially lacked soft skills connected to project and change management. Analytical skills increased the most, while more reflexive skills needed for the primary goal of the collaborative (reduce access and throughput times) increased modestly. At two sense-making meetings, attendees suggested four improvements for a quality improvement collaborative: 1) shift the focus to project- and change management skills; 2) focus more on knowledge transfer to colleagues; 3) teach participants to adapt the taught principles to their own situations; and 4) foster intra-project reflexive learning to translate gained insights to other projects (inter-project learning). Our findings seem to suggest that Quality collaboratives could benefit if more attention is paid to the transfer of 'soft skills' (e.g. change, project management and communication skills) and reflexive skills (e.g. adjusting logistics principles to specific situations and inter-project translation of experiences).